Apr 19 16:26:33 user devstack@n-api.service[61470]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 19 16:26:33 user devstack@n-api.service[61470]: *** Starting uWSGI 2.0.20-debian (64bit) on [Wed Apr 19 16:26:33 2023] *** Apr 19 16:26:33 user devstack@n-api.service[61470]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 19 16:26:33 user devstack@n-api.service[61470]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 19 16:26:33 user devstack@n-api.service[61470]: nodename: user Apr 19 16:26:33 user devstack@n-api.service[61470]: machine: x86_64 Apr 19 16:26:33 user devstack@n-api.service[61470]: clock source: unix Apr 19 16:26:33 user devstack@n-api.service[61470]: pcre jit disabled Apr 19 16:26:33 user devstack@n-api.service[61470]: detected number of CPU cores: 12 Apr 19 16:26:33 user devstack@n-api.service[61470]: current working directory: / Apr 19 16:26:33 user devstack@n-api.service[61470]: detected binary path: /usr/bin/uwsgi-core Apr 19 16:26:33 user devstack@n-api.service[61470]: your processes number limit is 63637 Apr 19 16:26:33 user devstack@n-api.service[61470]: your memory page size is 4096 bytes Apr 19 16:26:33 user devstack@n-api.service[61470]: detected max file descriptor number: 2048 Apr 19 16:26:33 user devstack@n-api.service[61470]: lock engine: pthread robust mutexes Apr 19 16:26:33 user devstack@n-api.service[61470]: thunder lock: enabled Apr 19 16:26:33 user devstack@n-api.service[61470]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 19 16:26:33 user devstack@n-api.service[61470]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 19 16:26:33 user devstack@n-api.service[61470]: Python main interpreter initialized at 0x5649c4f59990 Apr 19 16:26:33 user devstack@n-api.service[61470]: python threads support enabled Apr 19 16:26:33 user devstack@n-api.service[61470]: your server socket listen backlog is limited to 100 connections Apr 19 16:26:33 user devstack@n-api.service[61470]: your mercy for graceful operations on workers is 90 seconds Apr 19 16:26:33 user devstack@n-api.service[61470]: mapped 537436 bytes (524 KB) for 3 cores Apr 19 16:26:33 user devstack@n-api.service[61470]: *** Operational MODE: preforking *** Apr 19 16:26:33 user devstack@n-api.service[61470]: *** uWSGI is running in multiple interpreter mode *** Apr 19 16:26:33 user devstack@n-api.service[61470]: spawned uWSGI master process (pid: 61470) Apr 19 16:26:33 user devstack@n-api.service[61470]: spawned uWSGI worker 1 (pid: 61471, cores: 1) Apr 19 16:26:33 user devstack@n-api.service[61470]: spawned uWSGI worker 2 (pid: 61472, cores: 1) Apr 19 16:26:33 user devstack@n-api.service[61470]: spawned uWSGI worker 3 (pid: 61473, cores: 1) Apr 19 16:26:33 user devstack@n-api.service[61470]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 19 16:26:34 user devstack@n-api.service[61472]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 19 16:26:34 user devstack@n-api.service[61471]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 19 16:26:34 user devstack@n-api.service[61473]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 19 16:26:37 user devstack@n-api.service[61472]: live_migration_uri is deprecated for removal in favor of two other options that Apr 19 16:26:37 user devstack@n-api.service[61472]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 19 16:26:37 user devstack@n-api.service[61472]: and ``live_migration_inbound_addr`` respectively. Apr 19 16:26:37 user devstack@n-api.service[61472]: ). Its value may be silently ignored in the future. Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 19 16:26:37 user devstack@n-api.service[61473]: live_migration_uri is deprecated for removal in favor of two other options that Apr 19 16:26:37 user devstack@n-api.service[61473]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 19 16:26:37 user devstack@n-api.service[61473]: and ``live_migration_inbound_addr`` respectively. Apr 19 16:26:37 user devstack@n-api.service[61473]: ). Its value may be silently ignored in the future. Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 19 16:26:37 user devstack@n-api.service[61471]: live_migration_uri is deprecated for removal in favor of two other options that Apr 19 16:26:37 user devstack@n-api.service[61471]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 19 16:26:37 user devstack@n-api.service[61471]: and ``live_migration_inbound_addr`` respectively. Apr 19 16:26:37 user devstack@n-api.service[61471]: ). Its value may be silently ignored in the future. Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61472) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61473) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61471) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 19 16:26:37 user devstack@n-api.service[61472]: INFO dbcounter [None req-86512fc3-4cc2-4198-ae26-0428dbd09e0b None None] Registered counter for database nova_api Apr 19 16:26:37 user devstack@n-api.service[61473]: INFO dbcounter [None req-1901cc44-26dd-4449-b43d-06edb3a571cc None None] Registered counter for database nova_api Apr 19 16:26:37 user devstack@n-api.service[61471]: INFO dbcounter [None req-92db6430-a552-40fd-852a-f4755a1708fc None None] Registered counter for database nova_api Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG oslo_db.sqlalchemy.engines [None req-86512fc3-4cc2-4198-ae26-0428dbd09e0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61472) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 16:26:37 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writer thread running {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG oslo_db.sqlalchemy.engines [None req-1901cc44-26dd-4449-b43d-06edb3a571cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61473) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG oslo_db.sqlalchemy.engines [None req-92db6430-a552-40fd-852a-f4755a1708fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61471) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 16:26:37 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writer thread running {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 16:26:37 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writer thread running {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 16:26:38 user devstack@n-api.service[61472]: DEBUG nova.context [None req-86512fc3-4cc2-4198-ae26-0428dbd09e0b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),529680e7-3be5-45cb-be5e-d097b6f534fd(cell1) {{(pid=61472) load_cells /opt/stack/nova/nova/context.py:464}} Apr 19 16:26:38 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-86512fc3-4cc2-4198-ae26-0428dbd09e0b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:26:38 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-86512fc3-4cc2-4198-ae26-0428dbd09e0b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:26:38 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-86512fc3-4cc2-4198-ae26-0428dbd09e0b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:26:38 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-86512fc3-4cc2-4198-ae26-0428dbd09e0b None None] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:26:38 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-86512fc3-4cc2-4198-ae26-0428dbd09e0b None None] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:26:38 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-86512fc3-4cc2-4198-ae26-0428dbd09e0b None None] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:26:38 user devstack@n-api.service[61472]: INFO dbcounter [None req-86512fc3-4cc2-4198-ae26-0428dbd09e0b None None] Registered counter for database nova_cell0 Apr 19 16:26:38 user devstack@n-api.service[61473]: DEBUG nova.context [None req-1901cc44-26dd-4449-b43d-06edb3a571cc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),529680e7-3be5-45cb-be5e-d097b6f534fd(cell1) {{(pid=61473) load_cells /opt/stack/nova/nova/context.py:464}} Apr 19 16:26:38 user devstack@n-api.service[61472]: INFO dbcounter [None req-86512fc3-4cc2-4198-ae26-0428dbd09e0b None None] Registered counter for database nova_cell1 Apr 19 16:26:38 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-1901cc44-26dd-4449-b43d-06edb3a571cc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:26:38 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-1901cc44-26dd-4449-b43d-06edb3a571cc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:26:38 user devstack@n-api.service[61471]: DEBUG nova.context [None req-92db6430-a552-40fd-852a-f4755a1708fc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),529680e7-3be5-45cb-be5e-d097b6f534fd(cell1) {{(pid=61471) load_cells /opt/stack/nova/nova/context.py:464}} Apr 19 16:26:38 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-1901cc44-26dd-4449-b43d-06edb3a571cc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:26:38 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-1901cc44-26dd-4449-b43d-06edb3a571cc None None] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:26:38 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-1901cc44-26dd-4449-b43d-06edb3a571cc None None] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:26:38 user devstack@n-api.service[61472]: DEBUG oslo_db.sqlalchemy.engines [None req-86512fc3-4cc2-4198-ae26-0428dbd09e0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61472) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 16:26:38 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-92db6430-a552-40fd-852a-f4755a1708fc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:26:38 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-1901cc44-26dd-4449-b43d-06edb3a571cc None None] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:26:38 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-92db6430-a552-40fd-852a-f4755a1708fc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:26:38 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-92db6430-a552-40fd-852a-f4755a1708fc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:26:38 user devstack@n-api.service[61473]: INFO dbcounter [None req-1901cc44-26dd-4449-b43d-06edb3a571cc None None] Registered counter for database nova_cell0 Apr 19 16:26:38 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-92db6430-a552-40fd-852a-f4755a1708fc None None] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:26:38 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-92db6430-a552-40fd-852a-f4755a1708fc None None] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:26:38 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writer thread running {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 16:26:38 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-92db6430-a552-40fd-852a-f4755a1708fc None None] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:26:38 user devstack@n-api.service[61473]: INFO dbcounter [None req-1901cc44-26dd-4449-b43d-06edb3a571cc None None] Registered counter for database nova_cell1 Apr 19 16:26:38 user devstack@n-api.service[61471]: INFO dbcounter [None req-92db6430-a552-40fd-852a-f4755a1708fc None None] Registered counter for database nova_cell0 Apr 19 16:26:38 user devstack@n-api.service[61471]: INFO dbcounter [None req-92db6430-a552-40fd-852a-f4755a1708fc None None] Registered counter for database nova_cell1 Apr 19 16:26:38 user devstack@n-api.service[61473]: DEBUG oslo_db.sqlalchemy.engines [None req-1901cc44-26dd-4449-b43d-06edb3a571cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61473) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 16:26:38 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writer thread running {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 16:26:38 user devstack@n-api.service[61473]: DEBUG oslo_db.sqlalchemy.engines [None req-1901cc44-26dd-4449-b43d-06edb3a571cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61473) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 16:26:38 user devstack@n-api.service[61471]: DEBUG oslo_db.sqlalchemy.engines [None req-92db6430-a552-40fd-852a-f4755a1708fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61471) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 16:26:38 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writer thread running {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 16:26:38 user devstack@n-api.service[61471]: DEBUG oslo_db.sqlalchemy.engines [None req-92db6430-a552-40fd-852a-f4755a1708fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61471) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 16:26:38 user devstack@n-api.service[61472]: DEBUG oslo_db.sqlalchemy.engines [None req-86512fc3-4cc2-4198-ae26-0428dbd09e0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61472) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 16:26:38 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writer thread running {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 16:26:38 user devstack@n-api.service[61472]: INFO dbcounter [None req-86512fc3-4cc2-4198-ae26-0428dbd09e0b None None] Registered counter for database nova_cell0 Apr 19 16:26:38 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writer thread running {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 16:26:38 user devstack@n-api.service[61472]: DEBUG oslo_db.sqlalchemy.engines [None req-86512fc3-4cc2-4198-ae26-0428dbd09e0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61472) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 16:26:38 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writer thread running {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 16:26:38 user devstack@n-api.service[61473]: INFO dbcounter [None req-1901cc44-26dd-4449-b43d-06edb3a571cc None None] Registered counter for database nova_cell0 Apr 19 16:26:38 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writer thread running {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 16:26:38 user devstack@n-api.service[61473]: DEBUG oslo_db.sqlalchemy.engines [None req-1901cc44-26dd-4449-b43d-06edb3a571cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61473) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 16:26:38 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writer thread running {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 16:26:38 user devstack@n-api.service[61471]: INFO dbcounter [None req-92db6430-a552-40fd-852a-f4755a1708fc None None] Registered counter for database nova_cell0 Apr 19 16:26:38 user devstack@n-api.service[61471]: DEBUG oslo_db.sqlalchemy.engines [None req-92db6430-a552-40fd-852a-f4755a1708fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61471) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 16:26:38 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writer thread running {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 16:26:38 user devstack@n-api.service[61471]: WARNING keystonemiddleware.auth_token [None req-92db6430-a552-40fd-852a-f4755a1708fc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 19 16:26:38 user devstack@n-api.service[61471]: WARNING keystonemiddleware.auth_token [None req-92db6430-a552-40fd-852a-f4755a1708fc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 19 16:26:38 user devstack@n-api.service[61473]: WARNING keystonemiddleware.auth_token [None req-1901cc44-26dd-4449-b43d-06edb3a571cc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 19 16:26:38 user devstack@n-api.service[61473]: WARNING keystonemiddleware.auth_token [None req-1901cc44-26dd-4449-b43d-06edb3a571cc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 19 16:26:38 user devstack@n-api.service[61472]: WARNING keystonemiddleware.auth_token [None req-86512fc3-4cc2-4198-ae26-0428dbd09e0b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 19 16:26:38 user devstack@n-api.service[61472]: WARNING keystonemiddleware.auth_token [None req-86512fc3-4cc2-4198-ae26-0428dbd09e0b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 19 16:26:38 user devstack@n-api.service[61473]: WARNING keystonemiddleware.auth_token [None req-1901cc44-26dd-4449-b43d-06edb3a571cc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 19 16:26:38 user devstack@n-api.service[61473]: WARNING keystonemiddleware.auth_token [None req-1901cc44-26dd-4449-b43d-06edb3a571cc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 19 16:26:38 user devstack@n-api.service[61473]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5649c4f59990 pid: 61473 (default app) Apr 19 16:26:38 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-1901cc44-26dd-4449-b43d-06edb3a571cc None None] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:26:38 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-1901cc44-26dd-4449-b43d-06edb3a571cc None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001497 Apr 19 16:26:38 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Wed Apr 19 16:26:38 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:26:38 user devstack@n-api.service[61472]: WARNING keystonemiddleware.auth_token [None req-86512fc3-4cc2-4198-ae26-0428dbd09e0b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 19 16:26:38 user devstack@n-api.service[61472]: WARNING keystonemiddleware.auth_token [None req-86512fc3-4cc2-4198-ae26-0428dbd09e0b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 19 16:26:38 user devstack@n-api.service[61472]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5649c4f59990 pid: 61472 (default app) Apr 19 16:26:39 user devstack@n-api.service[61471]: WARNING keystonemiddleware.auth_token [None req-92db6430-a552-40fd-852a-f4755a1708fc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 19 16:26:39 user devstack@n-api.service[61471]: WARNING keystonemiddleware.auth_token [None req-92db6430-a552-40fd-852a-f4755a1708fc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 19 16:26:39 user devstack@n-api.service[61471]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5649c4f59990 pid: 61471 (default app) Apr 19 16:28:47 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-1901cc44-26dd-4449-b43d-06edb3a571cc None None] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:28:47 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-1901cc44-26dd-4449-b43d-06edb3a571cc None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001651 Apr 19 16:28:47 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 16:28:47 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:28:47 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_api:SELECT=3 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:28:47 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell0:SELECT=3 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:28:47 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell1:SELECT=3 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:28:47 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:28:48 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-99d25a10-45de-4c78-86d1-95a1bd90e1f8 admin admin] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:28:48 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-99d25a10-45de-4c78-86d1-95a1bd90e1f8 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.411160 Apr 19 16:28:48 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Wed Apr 19 16:28:47 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:28:50 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-92db6430-a552-40fd-852a-f4755a1708fc None None] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:28:50 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-92db6430-a552-40fd-852a-f4755a1708fc None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002217 Apr 19 16:28:50 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 16:28:50 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:28:50 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_api:SELECT=3 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:28:50 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell0:SELECT=3 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:28:50 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell1:SELECT=3 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:28:50 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:28:50 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-5e78fbcb-e491-4ad7-9029-1ac14eb559d0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "os-flavor-access:is_public": true, "id": "c1", "rxtx_factor": 1.0, "ram": 256, "swap": 0, "disk": 1}} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:28:50 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-5e78fbcb-e491-4ad7-9029-1ac14eb559d0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.343902 Apr 19 16:28:50 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 16:28:50 2023] POST /compute/v2.1/flavors => generated 405 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 16:28:50 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-2b28bf10-5100-485e-a409-527f61e4d03c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:28:50 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-2b28bf10-5100-485e-a409-527f61e4d03c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044142 Apr 19 16:28:50 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 19 16:28:50 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:28:52 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-92db6430-a552-40fd-852a-f4755a1708fc None None] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:28:52 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-92db6430-a552-40fd-852a-f4755a1708fc None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001339 Apr 19 16:28:52 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 16:28:52 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:28:52 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-b08b7f29-759b-4637-876e-b5f3458bb9f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "disk": 5, "ram": 512, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:28:52 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-b08b7f29-759b-4637-876e-b5f3458bb9f1 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.085085 Apr 19 16:28:52 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 16:28:52 2023] POST /compute/v2.1/flavors => generated 402 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 16:28:52 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-0c9a45d5-40a4-4f29-a141-bdcd3476e0c9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:28:52 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-0c9a45d5-40a4-4f29-a141-bdcd3476e0c9 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085409 Apr 19 16:28:52 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 19 16:28:52 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:28:54 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-92db6430-a552-40fd-852a-f4755a1708fc None None] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:28:54 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-92db6430-a552-40fd-852a-f4755a1708fc None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001303 Apr 19 16:28:54 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 16:28:54 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:28:54 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-555486df-015b-40b1-95be-2315e8b61f03 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "id": "d2", "name": "ds1G", "swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 1024}} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:28:54 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-555486df-015b-40b1-95be-2315e8b61f03 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.077579 Apr 19 16:28:54 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 16:28:54 2023] POST /compute/v2.1/flavors => generated 402 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 19 16:28:54 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-f845b5ef-35d4-4bc0-9715-0ab5dc61488d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:28:54 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-f845b5ef-35d4-4bc0-9715-0ab5dc61488d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024362 Apr 19 16:28:54 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 19 16:28:54 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:28:56 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-92db6430-a552-40fd-852a-f4755a1708fc None None] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:28:56 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-92db6430-a552-40fd-852a-f4755a1708fc None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001285 Apr 19 16:28:56 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 16:28:56 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:28:56 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-cd1ab861-69ea-4310-b69f-7fb72618b218 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "ram": 2048, "vcpus": 2, "disk": 10, "id": "d3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:28:56 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-cd1ab861-69ea-4310-b69f-7fb72618b218 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.091449 Apr 19 16:28:56 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 16:28:56 2023] POST /compute/v2.1/flavors => generated 402 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 16:28:56 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-54655f7d-1824-40e8-9b5f-0ee738d4060f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:28:56 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-54655f7d-1824-40e8-9b5f-0ee738d4060f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.022968 Apr 19 16:28:56 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 19 16:28:56 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:28:58 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-92db6430-a552-40fd-852a-f4755a1708fc None None] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:28:58 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-92db6430-a552-40fd-852a-f4755a1708fc None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001954 Apr 19 16:28:58 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 16:28:58 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:28:58 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-c2db8162-abe9-4a3d-b2df-908d5e7cb8ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096, "id": "d4", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 20}} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:28:58 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-c2db8162-abe9-4a3d-b2df-908d5e7cb8ab admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.064146 Apr 19 16:28:58 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 16:28:58 2023] POST /compute/v2.1/flavors => generated 402 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 16:28:58 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-a66d7f45-d613-4da4-aa9e-e4de3996ba52 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:28:58 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-a66d7f45-d613-4da4-aa9e-e4de3996ba52 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.022899 Apr 19 16:28:58 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 19 16:28:58 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:29:01 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-92db6430-a552-40fd-852a-f4755a1708fc None None] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:29:01 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-92db6430-a552-40fd-852a-f4755a1708fc None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002943 Apr 19 16:29:01 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 16:29:01 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:29:01 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-4cb189c7-63d4-4793-a5f0-8149aac29fd6 admin admin] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:29:01 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-4cb189c7-63d4-4793-a5f0-8149aac29fd6 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.085105 Apr 19 16:29:01 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Wed Apr 19 16:29:01 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 16:29:03 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-a66d7f45-d613-4da4-aa9e-e4de3996ba52 admin admin] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:29:03 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-a66d7f45-d613-4da4-aa9e-e4de3996ba52 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001454 Apr 19 16:29:03 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 16:29:03 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:29:03 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_api:SELECT=3 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:29:03 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell0:SELECT=3 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:29:03 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell1:SELECT=3 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:29:03 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell0:SELECT=3 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:29:03 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-1b52cf22-e442-49d2-9137-07ed96dd6bc2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "name": "m1.tiny", "ram": 512, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "rxtx_factor": 1.0, "swap": 0, "vcpus": 1}} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:29:03 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-1b52cf22-e442-49d2-9137-07ed96dd6bc2 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.352899 Apr 19 16:29:03 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 16:29:03 2023] POST /compute/v2.1/flavors => generated 400 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 16:29:03 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-8b501274-3441-4b51-bb30-320ef6fc86b4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:29:03 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-8b501274-3441-4b51-bb30-320ef6fc86b4 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041619 Apr 19 16:29:03 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 19 16:29:03 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:29:05 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-a66d7f45-d613-4da4-aa9e-e4de3996ba52 admin admin] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:29:05 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-a66d7f45-d613-4da4-aa9e-e4de3996ba52 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001269 Apr 19 16:29:05 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 16:29:05 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:29:05 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-17c16433-98d2-4a21-ab38-42b2690bbe22 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "m1.small", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "id": "2", "os-flavor-access:is_public": true, "disk": 20, "swap": 0}} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:29:05 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-17c16433-98d2-4a21-ab38-42b2690bbe22 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.070032 Apr 19 16:29:05 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 16:29:05 2023] POST /compute/v2.1/flavors => generated 403 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 16:29:05 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-5c749626-cbd3-44c9-a93c-de597584a1ba admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:29:05 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-5c749626-cbd3-44c9-a93c-de597584a1ba admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028055 Apr 19 16:29:05 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 19 16:29:05 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:29:08 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-a66d7f45-d613-4da4-aa9e-e4de3996ba52 admin admin] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:29:08 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-a66d7f45-d613-4da4-aa9e-e4de3996ba52 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001299 Apr 19 16:29:08 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 16:29:08 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:29:08 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-c2efee25-244c-4150-a81c-f8ef2247a5a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "rxtx_factor": 1.0, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "swap": 0, "id": "3", "os-flavor-access:is_public": true, "ram": 4096}} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:29:08 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-c2efee25-244c-4150-a81c-f8ef2247a5a6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.218662 Apr 19 16:29:08 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 16:29:08 2023] POST /compute/v2.1/flavors => generated 404 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 16:29:08 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-f117a58b-9830-409f-bff2-6626b2d510c3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:29:08 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-f117a58b-9830-409f-bff2-6626b2d510c3 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026469 Apr 19 16:29:08 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 19 16:29:08 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:29:10 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-a66d7f45-d613-4da4-aa9e-e4de3996ba52 admin admin] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:29:10 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-a66d7f45-d613-4da4-aa9e-e4de3996ba52 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001319 Apr 19 16:29:10 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 16:29:10 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:29:10 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-6998ba05-39b3-412a-84a4-74e4062b311c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "swap": 0, "rxtx_factor": 1.0, "id": "4", "ram": 8192, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "vcpus": 4}} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:29:10 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-6998ba05-39b3-412a-84a4-74e4062b311c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.076380 Apr 19 16:29:10 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 16:29:10 2023] POST /compute/v2.1/flavors => generated 403 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 16:29:10 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-5f109874-3992-405c-ad30-4802bd302a4d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:29:10 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-5f109874-3992-405c-ad30-4802bd302a4d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027458 Apr 19 16:29:10 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 19 16:29:10 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:29:12 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-a66d7f45-d613-4da4-aa9e-e4de3996ba52 admin admin] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:29:12 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-a66d7f45-d613-4da4-aa9e-e4de3996ba52 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001262 Apr 19 16:29:12 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 16:29:12 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:29:12 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-68662bb0-83e0-4412-9bcc-59b726803705 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "ram": 16384, "vcpus": 8, "os-flavor-access:is_public": true, "id": "5", "swap": 0, "rxtx_factor": 1.0, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:29:12 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-68662bb0-83e0-4412-9bcc-59b726803705 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.071052 Apr 19 16:29:12 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 16:29:12 2023] POST /compute/v2.1/flavors => generated 406 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 16:29:12 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-0d646649-fe50-4138-af64-346a8a34cde7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:29:12 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-0d646649-fe50-4138-af64-346a8a34cde7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025080 Apr 19 16:29:12 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 19 16:29:12 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:29:43 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-a66d7f45-d613-4da4-aa9e-e4de3996ba52 admin admin] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:29:43 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-a66d7f45-d613-4da4-aa9e-e4de3996ba52 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001565 Apr 19 16:29:43 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 19 16:29:43 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:29:43 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:29:43 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-fb681730-7e97-48b5-acdc-129a3c094363 admin admin] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:29:43 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-fb681730-7e97-48b5-acdc-129a3c094363 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:29:43 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-fb681730-7e97-48b5-acdc-129a3c094363 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:29:43 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-fb681730-7e97-48b5-acdc-129a3c094363 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:29:43 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-fb681730-7e97-48b5-acdc-129a3c094363 admin admin] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:29:43 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-fb681730-7e97-48b5-acdc-129a3c094363 admin admin] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:29:43 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-fb681730-7e97-48b5-acdc-129a3c094363 admin admin] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:29:43 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-fb681730-7e97-48b5-acdc-129a3c094363 admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.113249 Apr 19 16:29:43 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Wed Apr 19 16:29:43 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 16:30:15 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-0d646649-fe50-4138-af64-346a8a34cde7 admin admin] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:30:15 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-0d646649-fe50-4138-af64-346a8a34cde7 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001700 Apr 19 16:30:15 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 19 16:30:15 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:30:15 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:30:15 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-eaf3aa06-ee67-4b6e-b63a-fb949c19b3f8 admin admin] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:30:15 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-eaf3aa06-ee67-4b6e-b63a-fb949c19b3f8 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.076668 Apr 19 16:30:15 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Wed Apr 19 16:30:15 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 16:30:20 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-fb681730-7e97-48b5-acdc-129a3c094363 admin admin] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:30:20 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-fb681730-7e97-48b5-acdc-129a3c094363 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001950 Apr 19 16:30:20 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 19 16:30:20 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:30:20 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:30:20 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-d36214ff-5358-4321-963f-e64d095cd2e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 128, "name": "m1.nano", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:30:20 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-d36214ff-5358-4321-963f-e64d095cd2e6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.068022 Apr 19 16:30:20 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Wed Apr 19 16:30:20 2023] POST /compute/v2.1/flavors => generated 403 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 16:30:20 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-b0616cb3-002e-4062-9890-067ddc934e7d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:30:20 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-b0616cb3-002e-4062-9890-067ddc934e7d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026886 Apr 19 16:30:20 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Wed Apr 19 16:30:20 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:30:24 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-fb681730-7e97-48b5-acdc-129a3c094363 admin admin] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:30:24 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-fb681730-7e97-48b5-acdc-129a3c094363 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002344 Apr 19 16:30:24 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 19 16:30:24 2023] GET /compute/v2.1 => generated 387 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:30:24 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-3d49f182-eede-40ab-9fa5-094f3e31fc2b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.micro", "disk": 1, "ram": 192, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "84", "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:30:24 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-3d49f182-eede-40ab-9fa5-094f3e31fc2b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.068377 Apr 19 16:30:24 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Wed Apr 19 16:30:24 2023] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 16:30:24 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-4f92de09-547e-4921-b830-f4603d4d7f95 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:30:24 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-4f92de09-547e-4921-b830-f4603d4d7f95 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026701 Apr 19 16:30:24 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Wed Apr 19 16:30:24 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:32:36 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell0:SELECT=2 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:32:36 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell1:SELECT=2 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:32:36 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_api:SELECT=4 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:32:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-45d24ed9-980c-4b7f-8508-4c46d8a9aff1 tempest-VolumesNegativeTest-342758415 tempest-VolumesNegativeTest-342758415-project-member] Action: 'create', calling method: .version_select at 0x7fd497d004c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-936389656", "metadata": {"Type": "work"}}} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:32:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-45d24ed9-980c-4b7f-8508-4c46d8a9aff1 tempest-VolumesNegativeTest-342758415 tempest-VolumesNegativeTest-342758415-project-member] Request method failure captured: Apr 19 16:32:37 user devstack@n-api.service[61471]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 19 16:32:37 user devstack@n-api.service[61471]: Accept: application/json Apr 19 16:32:37 user devstack@n-api.service[61471]: Accept-Encoding: identity Apr 19 16:32:37 user devstack@n-api.service[61471]: Connection: close Apr 19 16:32:37 user devstack@n-api.service[61471]: Content-Length: 121 Apr 19 16:32:37 user devstack@n-api.service[61471]: Content-Type: application/json Apr 19 16:32:37 user devstack@n-api.service[61471]: Host: 10.0.0.210 Apr 19 16:32:37 user devstack@n-api.service[61471]: Openstack-System-Scope: None Apr 19 16:32:37 user devstack@n-api.service[61471]: User-Agent: python-urllib3/1.26.15 Apr 19 16:32:37 user devstack@n-api.service[61471]: X-Auth-Token: gAAAAABkQBekF7Kc2rLZLxvJDErRyr7KxsA9fDavv7t0Wsh4VAbuFmPAbiW0ZEnJJTObZ9s6GcjSA1Xr2hzJQ2UpZUWAG8TqxhcJLq7fmzPfSIEGHoICvY2TQR35SvKEAryQ45eyo7M1HmtfSIKaFtwjZCRmS4Xs4qH25gcyQE6WHaA_oSyo8Sw Apr 19 16:32:37 user devstack@n-api.service[61471]: X-Domain-Id: None Apr 19 16:32:37 user devstack@n-api.service[61471]: X-Domain-Name: None Apr 19 16:32:37 user devstack@n-api.service[61471]: X-Identity-Status: Confirmed Apr 19 16:32:37 user devstack@n-api.service[61471]: X-Is-Admin-Project: True Apr 19 16:32:37 user devstack@n-api.service[61471]: X-Project-Domain-Id: default Apr 19 16:32:37 user devstack@n-api.service[61471]: X-Project-Domain-Name: Default Apr 19 16:32:37 user devstack@n-api.service[61471]: X-Project-Id: 88704a06593644aa96ac6a0b4bdc50ec Apr 19 16:32:37 user devstack@n-api.service[61471]: X-Project-Name: tempest-VolumesNegativeTest-342758415 Apr 19 16:32:37 user devstack@n-api.service[61471]: X-Role: member,reader Apr 19 16:32:37 user devstack@n-api.service[61471]: X-Roles: member,reader Apr 19 16:32:37 user devstack@n-api.service[61471]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88704a06593644aa96ac6a0b4bdc50ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88704a06593644aa96ac6a0b4bdc50ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/88704a06593644aa96ac6a0b4bdc50ec"}]}] Apr 19 16:32:37 user devstack@n-api.service[61471]: X-Tenant: tempest-VolumesNegativeTest-342758415 Apr 19 16:32:37 user devstack@n-api.service[61471]: X-Tenant-Id: 88704a06593644aa96ac6a0b4bdc50ec Apr 19 16:32:37 user devstack@n-api.service[61471]: X-Tenant-Name: tempest-VolumesNegativeTest-342758415 Apr 19 16:32:37 user devstack@n-api.service[61471]: X-User: tempest-VolumesNegativeTest-342758415-project-member Apr 19 16:32:37 user devstack@n-api.service[61471]: X-User-Domain-Id: default Apr 19 16:32:37 user devstack@n-api.service[61471]: X-User-Domain-Name: Default Apr 19 16:32:37 user devstack@n-api.service[61471]: X-User-Id: c329c758584643d89e2f2534b7e0999e Apr 19 16:32:37 user devstack@n-api.service[61471]: X-User-Name: tempest-VolumesNegativeTest-342758415-project-member Apr 19 16:32:37 user devstack@n-api.service[61471]: Apr 19 16:32:37 user devstack@n-api.service[61471]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-936389656", "metadata": {"Type": "work"}}} Apr 19 16:32:37 user devstack@n-api.service[61471]: method: Apr 19 16:32:37 user devstack@n-api.service[61471]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 19 16:32:37 user devstack@n-api.service[61471]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-936389656', 'metadata': {'Type': 'work'}}}} Apr 19 16:32:37 user devstack@n-api.service[61471]: {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise error Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi '#$%' Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:32:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-45d24ed9-980c-4b7f-8508-4c46d8a9aff1 tempest-VolumesNegativeTest-342758415 tempest-VolumesNegativeTest-342758415-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:32:37 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-45d24ed9-980c-4b7f-8508-4c46d8a9aff1 tempest-VolumesNegativeTest-342758415 tempest-VolumesNegativeTest-342758415-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.456768 Apr 19 16:32:37 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 19 16:32:36 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 458 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 19 16:32:37 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:32:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-4e6466fd-08f4-4423-995c-c42023535143 tempest-VolumesNegativeTest-342758415 tempest-VolumesNegativeTest-342758415-project-member] Action: 'create', calling method: .version_select at 0x7fd497e923b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1921920573", "metadata": {"Type": "work"}}} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:32:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-4e6466fd-08f4-4423-995c-c42023535143 tempest-VolumesNegativeTest-342758415 tempest-VolumesNegativeTest-342758415-project-member] Request method failure captured: Apr 19 16:32:37 user devstack@n-api.service[61473]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 19 16:32:37 user devstack@n-api.service[61473]: Accept: application/json Apr 19 16:32:37 user devstack@n-api.service[61473]: Accept-Encoding: identity Apr 19 16:32:37 user devstack@n-api.service[61473]: Connection: close Apr 19 16:32:37 user devstack@n-api.service[61473]: Content-Length: 120 Apr 19 16:32:37 user devstack@n-api.service[61473]: Content-Type: application/json Apr 19 16:32:37 user devstack@n-api.service[61473]: Host: 10.0.0.210 Apr 19 16:32:37 user devstack@n-api.service[61473]: Openstack-System-Scope: None Apr 19 16:32:37 user devstack@n-api.service[61473]: User-Agent: python-urllib3/1.26.15 Apr 19 16:32:37 user devstack@n-api.service[61473]: X-Auth-Token: gAAAAABkQBekF7Kc2rLZLxvJDErRyr7KxsA9fDavv7t0Wsh4VAbuFmPAbiW0ZEnJJTObZ9s6GcjSA1Xr2hzJQ2UpZUWAG8TqxhcJLq7fmzPfSIEGHoICvY2TQR35SvKEAryQ45eyo7M1HmtfSIKaFtwjZCRmS4Xs4qH25gcyQE6WHaA_oSyo8Sw Apr 19 16:32:37 user devstack@n-api.service[61473]: X-Domain-Id: None Apr 19 16:32:37 user devstack@n-api.service[61473]: X-Domain-Name: None Apr 19 16:32:37 user devstack@n-api.service[61473]: X-Identity-Status: Confirmed Apr 19 16:32:37 user devstack@n-api.service[61473]: X-Is-Admin-Project: True Apr 19 16:32:37 user devstack@n-api.service[61473]: X-Project-Domain-Id: default Apr 19 16:32:37 user devstack@n-api.service[61473]: X-Project-Domain-Name: Default Apr 19 16:32:37 user devstack@n-api.service[61473]: X-Project-Id: 88704a06593644aa96ac6a0b4bdc50ec Apr 19 16:32:37 user devstack@n-api.service[61473]: X-Project-Name: tempest-VolumesNegativeTest-342758415 Apr 19 16:32:37 user devstack@n-api.service[61473]: X-Role: member,reader Apr 19 16:32:37 user devstack@n-api.service[61473]: X-Roles: member,reader Apr 19 16:32:37 user devstack@n-api.service[61473]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88704a06593644aa96ac6a0b4bdc50ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88704a06593644aa96ac6a0b4bdc50ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/88704a06593644aa96ac6a0b4bdc50ec"}]}] Apr 19 16:32:37 user devstack@n-api.service[61473]: X-Tenant: tempest-VolumesNegativeTest-342758415 Apr 19 16:32:37 user devstack@n-api.service[61473]: X-Tenant-Id: 88704a06593644aa96ac6a0b4bdc50ec Apr 19 16:32:37 user devstack@n-api.service[61473]: X-Tenant-Name: tempest-VolumesNegativeTest-342758415 Apr 19 16:32:37 user devstack@n-api.service[61473]: X-User: tempest-VolumesNegativeTest-342758415-project-member Apr 19 16:32:37 user devstack@n-api.service[61473]: X-User-Domain-Id: default Apr 19 16:32:37 user devstack@n-api.service[61473]: X-User-Domain-Name: Default Apr 19 16:32:37 user devstack@n-api.service[61473]: X-User-Id: c329c758584643d89e2f2534b7e0999e Apr 19 16:32:37 user devstack@n-api.service[61473]: X-User-Name: tempest-VolumesNegativeTest-342758415-project-member Apr 19 16:32:37 user devstack@n-api.service[61473]: Apr 19 16:32:37 user devstack@n-api.service[61473]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1921920573", "metadata": {"Type": "work"}}} Apr 19 16:32:37 user devstack@n-api.service[61473]: method: Apr 19 16:32:37 user devstack@n-api.service[61473]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 19 16:32:37 user devstack@n-api.service[61473]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1921920573', 'metadata': {'Type': 'work'}}}} Apr 19 16:32:37 user devstack@n-api.service[61473]: {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:32:37 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:32:37 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 19 16:32:37 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 19 16:32:37 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 19 16:32:37 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise error Apr 19 16:32:37 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 19 16:32:37 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:32:37 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 19 16:32:37 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 19 16:32:37 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:32:37 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 19 16:32:37 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi '0' Apr 19 16:32:37 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:32:37 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:32:37 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:32:37 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:32:37 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:32:37 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:32:37 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:32:37 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:32:37 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 19 16:32:37 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 19 16:32:37 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:32:37 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:32:37 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 19 16:32:37 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 19 16:32:37 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 19 16:32:37 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 19 16:32:37 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 19 16:32:37 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 19 16:32:37 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 19 16:32:37 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:32:37 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:32:37 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:32:37 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:32:37 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:32:37 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:32:37 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 19 16:32:37 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 19 16:32:37 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 19 16:32:37 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:32:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-4e6466fd-08f4-4423-995c-c42023535143 tempest-VolumesNegativeTest-342758415 tempest-VolumesNegativeTest-342758415-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:32:37 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-4e6466fd-08f4-4423-995c-c42023535143 tempest-VolumesNegativeTest-342758415 tempest-VolumesNegativeTest-342758415-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.015431 Apr 19 16:32:37 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 17/47] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 19 16:32:37 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 19 16:32:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-dbf3d418-c200-40c5-9f0c-6e3e537fb6e8 tempest-VolumesNegativeTest-342758415 tempest-VolumesNegativeTest-342758415-project-member] Action: 'create', calling method: .version_select at 0x7fd497e6a680>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1608239799", "metadata": {"Type": "work"}}} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:32:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-dbf3d418-c200-40c5-9f0c-6e3e537fb6e8 tempest-VolumesNegativeTest-342758415 tempest-VolumesNegativeTest-342758415-project-member] Request method failure captured: Apr 19 16:32:37 user devstack@n-api.service[61472]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 19 16:32:37 user devstack@n-api.service[61472]: Accept: application/json Apr 19 16:32:37 user devstack@n-api.service[61472]: Accept-Encoding: identity Apr 19 16:32:37 user devstack@n-api.service[61472]: Connection: close Apr 19 16:32:37 user devstack@n-api.service[61472]: Content-Length: 119 Apr 19 16:32:37 user devstack@n-api.service[61472]: Content-Type: application/json Apr 19 16:32:37 user devstack@n-api.service[61472]: Host: 10.0.0.210 Apr 19 16:32:37 user devstack@n-api.service[61472]: Openstack-System-Scope: None Apr 19 16:32:37 user devstack@n-api.service[61472]: User-Agent: python-urllib3/1.26.15 Apr 19 16:32:37 user devstack@n-api.service[61472]: X-Auth-Token: gAAAAABkQBekF7Kc2rLZLxvJDErRyr7KxsA9fDavv7t0Wsh4VAbuFmPAbiW0ZEnJJTObZ9s6GcjSA1Xr2hzJQ2UpZUWAG8TqxhcJLq7fmzPfSIEGHoICvY2TQR35SvKEAryQ45eyo7M1HmtfSIKaFtwjZCRmS4Xs4qH25gcyQE6WHaA_oSyo8Sw Apr 19 16:32:37 user devstack@n-api.service[61472]: X-Domain-Id: None Apr 19 16:32:37 user devstack@n-api.service[61472]: X-Domain-Name: None Apr 19 16:32:37 user devstack@n-api.service[61472]: X-Identity-Status: Confirmed Apr 19 16:32:37 user devstack@n-api.service[61472]: X-Is-Admin-Project: True Apr 19 16:32:37 user devstack@n-api.service[61472]: X-Project-Domain-Id: default Apr 19 16:32:37 user devstack@n-api.service[61472]: X-Project-Domain-Name: Default Apr 19 16:32:37 user devstack@n-api.service[61472]: X-Project-Id: 88704a06593644aa96ac6a0b4bdc50ec Apr 19 16:32:37 user devstack@n-api.service[61472]: X-Project-Name: tempest-VolumesNegativeTest-342758415 Apr 19 16:32:37 user devstack@n-api.service[61472]: X-Role: member,reader Apr 19 16:32:37 user devstack@n-api.service[61472]: X-Roles: member,reader Apr 19 16:32:37 user devstack@n-api.service[61472]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88704a06593644aa96ac6a0b4bdc50ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88704a06593644aa96ac6a0b4bdc50ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/88704a06593644aa96ac6a0b4bdc50ec"}]}] Apr 19 16:32:37 user devstack@n-api.service[61472]: X-Tenant: tempest-VolumesNegativeTest-342758415 Apr 19 16:32:37 user devstack@n-api.service[61472]: X-Tenant-Id: 88704a06593644aa96ac6a0b4bdc50ec Apr 19 16:32:37 user devstack@n-api.service[61472]: X-Tenant-Name: tempest-VolumesNegativeTest-342758415 Apr 19 16:32:37 user devstack@n-api.service[61472]: X-User: tempest-VolumesNegativeTest-342758415-project-member Apr 19 16:32:37 user devstack@n-api.service[61472]: X-User-Domain-Id: default Apr 19 16:32:37 user devstack@n-api.service[61472]: X-User-Domain-Name: Default Apr 19 16:32:37 user devstack@n-api.service[61472]: X-User-Id: c329c758584643d89e2f2534b7e0999e Apr 19 16:32:37 user devstack@n-api.service[61472]: X-User-Name: tempest-VolumesNegativeTest-342758415-project-member Apr 19 16:32:37 user devstack@n-api.service[61472]: Apr 19 16:32:37 user devstack@n-api.service[61472]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1608239799", "metadata": {"Type": "work"}}} Apr 19 16:32:37 user devstack@n-api.service[61472]: method: Apr 19 16:32:37 user devstack@n-api.service[61472]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 19 16:32:37 user devstack@n-api.service[61472]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1608239799', 'metadata': {'Type': 'work'}}}} Apr 19 16:32:37 user devstack@n-api.service[61472]: {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:32:37 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:32:37 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 19 16:32:37 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 19 16:32:37 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 19 16:32:37 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi raise error Apr 19 16:32:37 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 19 16:32:37 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:32:37 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 19 16:32:37 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 19 16:32:37 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:32:37 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 19 16:32:37 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi '' Apr 19 16:32:37 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:32:37 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:32:37 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:32:37 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:32:37 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:32:37 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:32:37 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:32:37 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:32:37 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 19 16:32:37 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 19 16:32:37 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:32:37 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:32:37 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 19 16:32:37 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 19 16:32:37 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 19 16:32:37 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 19 16:32:37 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 19 16:32:37 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 19 16:32:37 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 19 16:32:37 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:32:37 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:32:37 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:32:37 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:32:37 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:32:37 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:32:37 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 19 16:32:37 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 19 16:32:37 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 19 16:32:37 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:32:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-dbf3d418-c200-40c5-9f0c-6e3e537fb6e8 tempest-VolumesNegativeTest-342758415 tempest-VolumesNegativeTest-342758415-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:32:37 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-dbf3d418-c200-40c5-9f0c-6e3e537fb6e8 tempest-VolumesNegativeTest-342758415 tempest-VolumesNegativeTest-342758415-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.034261 Apr 19 16:32:37 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 16/48] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 19 16:32:37 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 19 16:32:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-15bc8a2d-4dfd-4523-9fe3-ae437327c47a tempest-VolumesNegativeTest-342758415 tempest-VolumesNegativeTest-342758415-project-member] Calling method '.version_select at 0x7fd498728940>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:32:37 user devstack@n-api.service[61471]: INFO nova.api.openstack.wsgi [None req-15bc8a2d-4dfd-4523-9fe3-ae437327c47a tempest-VolumesNegativeTest-342758415 tempest-VolumesNegativeTest-342758415-project-member] HTTP exception thrown: Volume tempest-invalid-1955000184 could not be found. Apr 19 16:32:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-15bc8a2d-4dfd-4523-9fe3-ae437327c47a tempest-VolumesNegativeTest-342758415 tempest-VolumesNegativeTest-342758415-project-member] Request method failure captured: Apr 19 16:32:37 user devstack@n-api.service[61471]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1955000184 HTTP/1.1 Apr 19 16:32:37 user devstack@n-api.service[61471]: Accept: application/json Apr 19 16:32:37 user devstack@n-api.service[61471]: Accept-Encoding: identity Apr 19 16:32:37 user devstack@n-api.service[61471]: Connection: close Apr 19 16:32:37 user devstack@n-api.service[61471]: Content-Length: 0 Apr 19 16:32:37 user devstack@n-api.service[61471]: Content-Type: application/json Apr 19 16:32:37 user devstack@n-api.service[61471]: Host: 10.0.0.210 Apr 19 16:32:37 user devstack@n-api.service[61471]: Openstack-System-Scope: None Apr 19 16:32:37 user devstack@n-api.service[61471]: User-Agent: python-urllib3/1.26.15 Apr 19 16:32:37 user devstack@n-api.service[61471]: X-Auth-Token: gAAAAABkQBekF7Kc2rLZLxvJDErRyr7KxsA9fDavv7t0Wsh4VAbuFmPAbiW0ZEnJJTObZ9s6GcjSA1Xr2hzJQ2UpZUWAG8TqxhcJLq7fmzPfSIEGHoICvY2TQR35SvKEAryQ45eyo7M1HmtfSIKaFtwjZCRmS4Xs4qH25gcyQE6WHaA_oSyo8Sw Apr 19 16:32:37 user devstack@n-api.service[61471]: X-Domain-Id: None Apr 19 16:32:37 user devstack@n-api.service[61471]: X-Domain-Name: None Apr 19 16:32:37 user devstack@n-api.service[61471]: X-Identity-Status: Confirmed Apr 19 16:32:37 user devstack@n-api.service[61471]: X-Is-Admin-Project: True Apr 19 16:32:37 user devstack@n-api.service[61471]: X-Project-Domain-Id: default Apr 19 16:32:37 user devstack@n-api.service[61471]: X-Project-Domain-Name: Default Apr 19 16:32:37 user devstack@n-api.service[61471]: X-Project-Id: 88704a06593644aa96ac6a0b4bdc50ec Apr 19 16:32:37 user devstack@n-api.service[61471]: X-Project-Name: tempest-VolumesNegativeTest-342758415 Apr 19 16:32:37 user devstack@n-api.service[61471]: X-Role: member,reader Apr 19 16:32:37 user devstack@n-api.service[61471]: X-Roles: member,reader Apr 19 16:32:37 user devstack@n-api.service[61471]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88704a06593644aa96ac6a0b4bdc50ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88704a06593644aa96ac6a0b4bdc50ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/88704a06593644aa96ac6a0b4bdc50ec"}]}] Apr 19 16:32:37 user devstack@n-api.service[61471]: X-Tenant: tempest-VolumesNegativeTest-342758415 Apr 19 16:32:37 user devstack@n-api.service[61471]: X-Tenant-Id: 88704a06593644aa96ac6a0b4bdc50ec Apr 19 16:32:37 user devstack@n-api.service[61471]: X-Tenant-Name: tempest-VolumesNegativeTest-342758415 Apr 19 16:32:37 user devstack@n-api.service[61471]: X-User: tempest-VolumesNegativeTest-342758415-project-member Apr 19 16:32:37 user devstack@n-api.service[61471]: X-User-Domain-Id: default Apr 19 16:32:37 user devstack@n-api.service[61471]: X-User-Domain-Name: Default Apr 19 16:32:37 user devstack@n-api.service[61471]: X-User-Id: c329c758584643d89e2f2534b7e0999e Apr 19 16:32:37 user devstack@n-api.service[61471]: X-User-Name: tempest-VolumesNegativeTest-342758415-project-member Apr 19 16:32:37 user devstack@n-api.service[61471]: method: Apr 19 16:32:37 user devstack@n-api.service[61471]: exception: Volume tempest-invalid-1955000184 could not be found. Apr 19 16:32:37 user devstack@n-api.service[61471]: action_args: {'id': 'tempest-invalid-1955000184'} Apr 19 16:32:37 user devstack@n-api.service[61471]: {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1955000184 could not be found. (HTTP 404) (Request-ID: req-885c0938-2d5c-4276-b507-281d20e67ed0) Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1955000184 could not be found. Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1955000184 could not be found. Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1955000184 could not be found. Apr 19 16:32:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:32:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-15bc8a2d-4dfd-4523-9fe3-ae437327c47a tempest-VolumesNegativeTest-342758415 tempest-VolumesNegativeTest-342758415-project-member] Returning 404 to user: Volume tempest-invalid-1955000184 could not be found. {{(pid=61471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:32:37 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-15bc8a2d-4dfd-4523-9fe3-ae437327c47a tempest-VolumesNegativeTest-342758415 tempest-VolumesNegativeTest-342758415-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1955000184" status: 404 len: 99 microversion: 2.1 time: 0.636875 Apr 19 16:32:37 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 16/49] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 19 16:32:37 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-1955000184 => generated 99 bytes in 638 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 19 16:32:37 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-7fbf2830-a865-432c-ab51-e1d192f6475a tempest-VolumesNegativeTest-342758415 tempest-VolumesNegativeTest-342758415-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005032 Apr 19 16:32:37 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 18/50] 10.0.0.210 () {62 vars in 1217 bytes} [Wed Apr 19 16:32:37 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 19 16:32:37 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:32:37 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-d9e3b147-bda1-400a-8e0e-07d2089c2fc2 tempest-VolumesNegativeTest-342758415 tempest-VolumesNegativeTest-342758415-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011517 Apr 19 16:32:37 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 17/51] 10.0.0.210 () {62 vars in 1214 bytes} [Wed Apr 19 16:32:37 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 19 16:32:38 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-f6958037-020c-48c5-880e-e23b77b68cc1 tempest-VolumesNegativeTest-342758415 tempest-VolumesNegativeTest-342758415-project-member] Calling method '.version_select at 0x7fd497ddd1b0>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:32:38 user devstack@n-api.service[61471]: INFO nova.api.openstack.wsgi [None req-f6958037-020c-48c5-880e-e23b77b68cc1 tempest-VolumesNegativeTest-342758415 tempest-VolumesNegativeTest-342758415-project-member] HTTP exception thrown: Volume fd573c7d-ac52-4fdc-8358-37e70e03fc5c could not be found. Apr 19 16:32:38 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-f6958037-020c-48c5-880e-e23b77b68cc1 tempest-VolumesNegativeTest-342758415 tempest-VolumesNegativeTest-342758415-project-member] Request method failure captured: Apr 19 16:32:38 user devstack@n-api.service[61471]: request: DELETE /compute/v2.1/os-volumes/fd573c7d-ac52-4fdc-8358-37e70e03fc5c HTTP/1.1 Apr 19 16:32:38 user devstack@n-api.service[61471]: Accept: application/json Apr 19 16:32:38 user devstack@n-api.service[61471]: Accept-Encoding: identity Apr 19 16:32:38 user devstack@n-api.service[61471]: Connection: close Apr 19 16:32:38 user devstack@n-api.service[61471]: Content-Length: 0 Apr 19 16:32:38 user devstack@n-api.service[61471]: Content-Type: application/json Apr 19 16:32:38 user devstack@n-api.service[61471]: Host: 10.0.0.210 Apr 19 16:32:38 user devstack@n-api.service[61471]: Openstack-System-Scope: None Apr 19 16:32:38 user devstack@n-api.service[61471]: User-Agent: python-urllib3/1.26.15 Apr 19 16:32:38 user devstack@n-api.service[61471]: X-Auth-Token: gAAAAABkQBekF7Kc2rLZLxvJDErRyr7KxsA9fDavv7t0Wsh4VAbuFmPAbiW0ZEnJJTObZ9s6GcjSA1Xr2hzJQ2UpZUWAG8TqxhcJLq7fmzPfSIEGHoICvY2TQR35SvKEAryQ45eyo7M1HmtfSIKaFtwjZCRmS4Xs4qH25gcyQE6WHaA_oSyo8Sw Apr 19 16:32:38 user devstack@n-api.service[61471]: X-Domain-Id: None Apr 19 16:32:38 user devstack@n-api.service[61471]: X-Domain-Name: None Apr 19 16:32:38 user devstack@n-api.service[61471]: X-Identity-Status: Confirmed Apr 19 16:32:38 user devstack@n-api.service[61471]: X-Is-Admin-Project: True Apr 19 16:32:38 user devstack@n-api.service[61471]: X-Project-Domain-Id: default Apr 19 16:32:38 user devstack@n-api.service[61471]: X-Project-Domain-Name: Default Apr 19 16:32:38 user devstack@n-api.service[61471]: X-Project-Id: 88704a06593644aa96ac6a0b4bdc50ec Apr 19 16:32:38 user devstack@n-api.service[61471]: X-Project-Name: tempest-VolumesNegativeTest-342758415 Apr 19 16:32:38 user devstack@n-api.service[61471]: X-Role: member,reader Apr 19 16:32:38 user devstack@n-api.service[61471]: X-Roles: member,reader Apr 19 16:32:38 user devstack@n-api.service[61471]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88704a06593644aa96ac6a0b4bdc50ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88704a06593644aa96ac6a0b4bdc50ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/88704a06593644aa96ac6a0b4bdc50ec"}]}] Apr 19 16:32:38 user devstack@n-api.service[61471]: X-Tenant: tempest-VolumesNegativeTest-342758415 Apr 19 16:32:38 user devstack@n-api.service[61471]: X-Tenant-Id: 88704a06593644aa96ac6a0b4bdc50ec Apr 19 16:32:38 user devstack@n-api.service[61471]: X-Tenant-Name: tempest-VolumesNegativeTest-342758415 Apr 19 16:32:38 user devstack@n-api.service[61471]: X-User: tempest-VolumesNegativeTest-342758415-project-member Apr 19 16:32:38 user devstack@n-api.service[61471]: X-User-Domain-Id: default Apr 19 16:32:38 user devstack@n-api.service[61471]: X-User-Domain-Name: Default Apr 19 16:32:38 user devstack@n-api.service[61471]: X-User-Id: c329c758584643d89e2f2534b7e0999e Apr 19 16:32:38 user devstack@n-api.service[61471]: X-User-Name: tempest-VolumesNegativeTest-342758415-project-member Apr 19 16:32:38 user devstack@n-api.service[61471]: method: Apr 19 16:32:38 user devstack@n-api.service[61471]: exception: Volume fd573c7d-ac52-4fdc-8358-37e70e03fc5c could not be found. Apr 19 16:32:38 user devstack@n-api.service[61471]: action_args: {'id': 'fd573c7d-ac52-4fdc-8358-37e70e03fc5c'} Apr 19 16:32:38 user devstack@n-api.service[61471]: {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fd573c7d-ac52-4fdc-8358-37e70e03fc5c could not be found. (HTTP 404) (Request-ID: req-fdca8f29-69dc-4005-9f85-4d9f27614a7a) Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fd573c7d-ac52-4fdc-8358-37e70e03fc5c could not be found. Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fd573c7d-ac52-4fdc-8358-37e70e03fc5c could not be found. Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fd573c7d-ac52-4fdc-8358-37e70e03fc5c could not be found. Apr 19 16:32:38 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:32:38 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-f6958037-020c-48c5-880e-e23b77b68cc1 tempest-VolumesNegativeTest-342758415 tempest-VolumesNegativeTest-342758415-project-member] Returning 404 to user: Volume fd573c7d-ac52-4fdc-8358-37e70e03fc5c could not be found. {{(pid=61471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:32:38 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-f6958037-020c-48c5-880e-e23b77b68cc1 tempest-VolumesNegativeTest-342758415 tempest-VolumesNegativeTest-342758415-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/fd573c7d-ac52-4fdc-8358-37e70e03fc5c" status: 404 len: 109 microversion: 2.1 time: 0.113648 Apr 19 16:32:38 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 17/52] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 19 16:32:38 2023] DELETE /compute/v2.1/os-volumes/fd573c7d-ac52-4fdc-8358-37e70e03fc5c => generated 109 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 16:32:38 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-ec972297-c033-49eb-ab4f-0d106d527b55 tempest-VolumesNegativeTest-342758415 tempest-VolumesNegativeTest-342758415-project-member] Calling method '.version_select at 0x7fd497e924d0>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:32:38 user devstack@n-api.service[61473]: INFO nova.api.openstack.wsgi [None req-ec972297-c033-49eb-ab4f-0d106d527b55 tempest-VolumesNegativeTest-342758415 tempest-VolumesNegativeTest-342758415-project-member] HTTP exception thrown: Volume 67ec2fae-4818-4f5c-bf63-09bb7710a9d8 could not be found. Apr 19 16:32:38 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-ec972297-c033-49eb-ab4f-0d106d527b55 tempest-VolumesNegativeTest-342758415 tempest-VolumesNegativeTest-342758415-project-member] Request method failure captured: Apr 19 16:32:38 user devstack@n-api.service[61473]: request: GET /compute/v2.1/os-volumes/67ec2fae-4818-4f5c-bf63-09bb7710a9d8 HTTP/1.1 Apr 19 16:32:38 user devstack@n-api.service[61473]: Accept: application/json Apr 19 16:32:38 user devstack@n-api.service[61473]: Accept-Encoding: identity Apr 19 16:32:38 user devstack@n-api.service[61473]: Connection: close Apr 19 16:32:38 user devstack@n-api.service[61473]: Content-Length: 0 Apr 19 16:32:38 user devstack@n-api.service[61473]: Content-Type: application/json Apr 19 16:32:38 user devstack@n-api.service[61473]: Host: 10.0.0.210 Apr 19 16:32:38 user devstack@n-api.service[61473]: Openstack-System-Scope: None Apr 19 16:32:38 user devstack@n-api.service[61473]: User-Agent: python-urllib3/1.26.15 Apr 19 16:32:38 user devstack@n-api.service[61473]: X-Auth-Token: gAAAAABkQBekF7Kc2rLZLxvJDErRyr7KxsA9fDavv7t0Wsh4VAbuFmPAbiW0ZEnJJTObZ9s6GcjSA1Xr2hzJQ2UpZUWAG8TqxhcJLq7fmzPfSIEGHoICvY2TQR35SvKEAryQ45eyo7M1HmtfSIKaFtwjZCRmS4Xs4qH25gcyQE6WHaA_oSyo8Sw Apr 19 16:32:38 user devstack@n-api.service[61473]: X-Domain-Id: None Apr 19 16:32:38 user devstack@n-api.service[61473]: X-Domain-Name: None Apr 19 16:32:38 user devstack@n-api.service[61473]: X-Identity-Status: Confirmed Apr 19 16:32:38 user devstack@n-api.service[61473]: X-Is-Admin-Project: True Apr 19 16:32:38 user devstack@n-api.service[61473]: X-Project-Domain-Id: default Apr 19 16:32:38 user devstack@n-api.service[61473]: X-Project-Domain-Name: Default Apr 19 16:32:38 user devstack@n-api.service[61473]: X-Project-Id: 88704a06593644aa96ac6a0b4bdc50ec Apr 19 16:32:38 user devstack@n-api.service[61473]: X-Project-Name: tempest-VolumesNegativeTest-342758415 Apr 19 16:32:38 user devstack@n-api.service[61473]: X-Role: member,reader Apr 19 16:32:38 user devstack@n-api.service[61473]: X-Roles: member,reader Apr 19 16:32:38 user devstack@n-api.service[61473]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88704a06593644aa96ac6a0b4bdc50ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88704a06593644aa96ac6a0b4bdc50ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/88704a06593644aa96ac6a0b4bdc50ec"}]}] Apr 19 16:32:38 user devstack@n-api.service[61473]: X-Tenant: tempest-VolumesNegativeTest-342758415 Apr 19 16:32:38 user devstack@n-api.service[61473]: X-Tenant-Id: 88704a06593644aa96ac6a0b4bdc50ec Apr 19 16:32:38 user devstack@n-api.service[61473]: X-Tenant-Name: tempest-VolumesNegativeTest-342758415 Apr 19 16:32:38 user devstack@n-api.service[61473]: X-User: tempest-VolumesNegativeTest-342758415-project-member Apr 19 16:32:38 user devstack@n-api.service[61473]: X-User-Domain-Id: default Apr 19 16:32:38 user devstack@n-api.service[61473]: X-User-Domain-Name: Default Apr 19 16:32:38 user devstack@n-api.service[61473]: X-User-Id: c329c758584643d89e2f2534b7e0999e Apr 19 16:32:38 user devstack@n-api.service[61473]: X-User-Name: tempest-VolumesNegativeTest-342758415-project-member Apr 19 16:32:38 user devstack@n-api.service[61473]: method: Apr 19 16:32:38 user devstack@n-api.service[61473]: exception: Volume 67ec2fae-4818-4f5c-bf63-09bb7710a9d8 could not be found. Apr 19 16:32:38 user devstack@n-api.service[61473]: action_args: {'id': '67ec2fae-4818-4f5c-bf63-09bb7710a9d8'} Apr 19 16:32:38 user devstack@n-api.service[61473]: {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 67ec2fae-4818-4f5c-bf63-09bb7710a9d8 could not be found. (HTTP 404) (Request-ID: req-de4e5707-3fa5-4aa6-8a1e-044ce200385b) Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 67ec2fae-4818-4f5c-bf63-09bb7710a9d8 could not be found. Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 67ec2fae-4818-4f5c-bf63-09bb7710a9d8 could not be found. Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 67ec2fae-4818-4f5c-bf63-09bb7710a9d8 could not be found. Apr 19 16:32:38 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:32:38 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-ec972297-c033-49eb-ab4f-0d106d527b55 tempest-VolumesNegativeTest-342758415 tempest-VolumesNegativeTest-342758415-project-member] Returning 404 to user: Volume 67ec2fae-4818-4f5c-bf63-09bb7710a9d8 could not be found. {{(pid=61473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:32:38 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-ec972297-c033-49eb-ab4f-0d106d527b55 tempest-VolumesNegativeTest-342758415 tempest-VolumesNegativeTest-342758415-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/67ec2fae-4818-4f5c-bf63-09bb7710a9d8" status: 404 len: 109 microversion: 2.1 time: 0.180300 Apr 19 16:32:38 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 19/53] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 19 16:32:38 2023] GET /compute/v2.1/os-volumes/67ec2fae-4818-4f5c-bf63-09bb7710a9d8 => generated 109 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 16:32:52 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-2b764a5f-b58c-47d9-a8f6-c3c734ace827 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-537284108", "imageRef": "ab56c4b1-0117-43b0-84b6-28d06a23f182", "flavorRef": "42", "networks": [{"uuid": "c28475db-7534-45ac-ac9a-11676d53b459"}]}} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:32:53 user devstack@n-api.service[61472]: DEBUG nova.network.neutron [None req-2b764a5f-b58c-47d9-a8f6-c3c734ace827 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] validate_networks() for [('c28475db-7534-45ac-ac9a-11676d53b459', None, None, None, None, None)] {{(pid=61472) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 16:32:53 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-e9dca59f-44f3-422a-97c3-492134a7de3c tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Action: 'create', calling method: .version_select at 0x7fd497ddd510>, body: {"keypair": {"name": "tempest-keypair-526361184", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAA34KhmRzrJe5iUZWV4WECQYKCNCRQuzusZbQ4TRQYOYWk0MhKQlIEaXmnrOg6L2Zqwn0zv1pHFc+JSYulkKy+348KBLimhWQHmtsOIHpva70hxI3acvJEKHvjqTp2VsA=="}} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:32:53 user devstack@n-api.service[61471]: DEBUG nova.quota [None req-e9dca59f-44f3-422a-97c3-492134a7de3c tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Getting quotas for project 821ceccc36de46f780e55a02f25782f4. Resources: {'key_pairs'} {{(pid=61471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 16:32:53 user devstack@n-api.service[61471]: DEBUG nova.quota [None req-e9dca59f-44f3-422a-97c3-492134a7de3c tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Getting quotas for user c2563be52f624ceab060942e8bfcedef and project 821ceccc36de46f780e55a02f25782f4. Resources: {'key_pairs'} {{(pid=61471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 16:32:53 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-e9dca59f-44f3-422a-97c3-492134a7de3c tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.276398 Apr 19 16:32:53 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 18/54] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 16:32:53 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:32:54 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-2b764a5f-b58c-47d9-a8f6-c3c734ace827 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Flavor limits 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 16:32:54 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-2b764a5f-b58c-47d9-a8f6-c3c734ace827 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Image limits 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 16:32:54 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-2b764a5f-b58c-47d9-a8f6-c3c734ace827 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Flavor pref 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 16:32:54 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-2b764a5f-b58c-47d9-a8f6-c3c734ace827 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Image pref 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 16:32:54 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-2b764a5f-b58c-47d9-a8f6-c3c734ace827 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 16:32:54 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-2b764a5f-b58c-47d9-a8f6-c3c734ace827 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:32:54 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-2b764a5f-b58c-47d9-a8f6-c3c734ace827 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:32:54 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-2b764a5f-b58c-47d9-a8f6-c3c734ace827 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:32:54 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-2b764a5f-b58c-47d9-a8f6-c3c734ace827 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:32:54 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-2b764a5f-b58c-47d9-a8f6-c3c734ace827 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:32:54 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-2b764a5f-b58c-47d9-a8f6-c3c734ace827 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:32:54 user devstack@n-api.service[61472]: DEBUG nova.quota [None req-2b764a5f-b58c-47d9-a8f6-c3c734ace827 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Getting quotas for project 6d8fdc184adf4be795f5e3b1bfb170fc. Resources: {'instances', 'ram', 'cores'} {{(pid=61472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 16:32:54 user devstack@n-api.service[61472]: DEBUG nova.quota [None req-2b764a5f-b58c-47d9-a8f6-c3c734ace827 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Getting quotas for user 9a4fa81c86f045dba9b620bc6ac35684 and project 6d8fdc184adf4be795f5e3b1bfb170fc. Resources: {'instances', 'ram', 'cores'} {{(pid=61472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 16:32:54 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-2b764a5f-b58c-47d9-a8f6-c3c734ace827 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Going to run 1 instances... {{(pid=61472) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 16:32:54 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-2b764a5f-b58c-47d9-a8f6-c3c734ace827 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] [instance: 90c8afd3-6bbe-4c19-a54e-d15e668764aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ab56c4b1-0117-43b0-84b6-28d06a23f182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 16:32:55 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-2b764a5f-b58c-47d9-a8f6-c3c734ace827 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.562154 Apr 19 16:32:55 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 18/55] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 16:32:52 2023] POST /compute/v2.1/servers => generated 378 bytes in 2565 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 16:32:55 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-be9ed142-5ff8-429d-8c5d-fb0192987858 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:32:55 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-be9ed142-5ff8-429d-8c5d-fb0192987858 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] [instance: 90c8afd3-6bbe-4c19-a54e-d15e668764aa] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:32:55 user devstack@n-api.service[61473]: DEBUG nova.policy [None req-be9ed142-5ff8-429d-8c5d-fb0192987858 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4fa81c86f045dba9b620bc6ac35684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fdc184adf4be795f5e3b1bfb170fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61473) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:32:55 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-be9ed142-5ff8-429d-8c5d-fb0192987858 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] 10.0.0.210 "GET /compute/v2.1/servers/90c8afd3-6bbe-4c19-a54e-d15e668764aa" status: 200 len: 1208 microversion: 2.1 time: 0.212540 Apr 19 16:32:55 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 20/56] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:32:55 2023] GET /compute/v2.1/servers/90c8afd3-6bbe-4c19-a54e-d15e668764aa => generated 1208 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:33:00 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-03665e27-9e99-41d1-8f33-92094d2a5615 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-870807668", "imageRef": "ab56c4b1-0117-43b0-84b6-28d06a23f182", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "543e5868-bf5f-41ca-a4b2-61c1cd6946cf"}], "security_groups": [{"name": "tempest-securitygroup--1282244400"}], "key_name": "tempest-keypair-526361184", "user_data": "}} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:33:00 user devstack@n-api.service[61471]: DEBUG nova.network.neutron [None req-03665e27-9e99-41d1-8f33-92094d2a5615 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] validate_networks() for [('543e5868-bf5f-41ca-a4b2-61c1cd6946cf', None, None, None, None, None)] {{(pid=61471) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 16:33:01 user devstack@n-api.service[61471]: DEBUG nova.virt.hardware [None req-03665e27-9e99-41d1-8f33-92094d2a5615 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Flavor limits 0:0:0 {{(pid=61471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 16:33:01 user devstack@n-api.service[61471]: DEBUG nova.virt.hardware [None req-03665e27-9e99-41d1-8f33-92094d2a5615 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Image limits 0:0:0 {{(pid=61471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 16:33:01 user devstack@n-api.service[61471]: DEBUG nova.virt.hardware [None req-03665e27-9e99-41d1-8f33-92094d2a5615 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Flavor pref 0:0:0 {{(pid=61471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 16:33:01 user devstack@n-api.service[61471]: DEBUG nova.virt.hardware [None req-03665e27-9e99-41d1-8f33-92094d2a5615 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Image pref 0:0:0 {{(pid=61471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 16:33:01 user devstack@n-api.service[61471]: DEBUG nova.virt.hardware [None req-03665e27-9e99-41d1-8f33-92094d2a5615 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 16:33:01 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-03665e27-9e99-41d1-8f33-92094d2a5615 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:33:01 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-03665e27-9e99-41d1-8f33-92094d2a5615 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:33:01 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-03665e27-9e99-41d1-8f33-92094d2a5615 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:33:01 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-03665e27-9e99-41d1-8f33-92094d2a5615 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:33:01 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-03665e27-9e99-41d1-8f33-92094d2a5615 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:33:01 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-03665e27-9e99-41d1-8f33-92094d2a5615 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:33:01 user devstack@n-api.service[61471]: DEBUG nova.quota [None req-03665e27-9e99-41d1-8f33-92094d2a5615 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Getting quotas for project 821ceccc36de46f780e55a02f25782f4. Resources: {'instances', 'ram', 'cores'} {{(pid=61471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 16:33:01 user devstack@n-api.service[61471]: DEBUG nova.quota [None req-03665e27-9e99-41d1-8f33-92094d2a5615 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Getting quotas for user c2563be52f624ceab060942e8bfcedef and project 821ceccc36de46f780e55a02f25782f4. Resources: {'instances', 'ram', 'cores'} {{(pid=61471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 16:33:01 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-03665e27-9e99-41d1-8f33-92094d2a5615 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Going to run 1 instances... {{(pid=61471) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 16:33:01 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-03665e27-9e99-41d1-8f33-92094d2a5615 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] [instance: fbf430be-25fa-4e08-8d5b-08c95b10172a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ab56c4b1-0117-43b0-84b6-28d06a23f182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61471) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 16:33:01 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-03665e27-9e99-41d1-8f33-92094d2a5615 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.432369 Apr 19 16:33:01 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 19/57] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 16:33:00 2023] POST /compute/v2.1/servers => generated 400 bytes in 1434 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 16:33:01 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-e1d690a8-572c-4fb5-8083-536146edaf7a tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:33:01 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-e1d690a8-572c-4fb5-8083-536146edaf7a tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] [instance: fbf430be-25fa-4e08-8d5b-08c95b10172a] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:33:01 user devstack@n-api.service[61472]: DEBUG nova.policy [None req-e1d690a8-572c-4fb5-8083-536146edaf7a tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2563be52f624ceab060942e8bfcedef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ceccc36de46f780e55a02f25782f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61472) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:33:01 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-e1d690a8-572c-4fb5-8083-536146edaf7a tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fbf430be-25fa-4e08-8d5b-08c95b10172a" status: 200 len: 1234 microversion: 2.1 time: 0.142478 Apr 19 16:33:01 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 19/58] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:33:01 2023] GET /compute/v2.1/servers/fbf430be-25fa-4e08-8d5b-08c95b10172a => generated 1234 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:33:05 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_api:SELECT=4 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:33:05 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell0:SELECT=2 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:33:05 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-d7116992-5aae-48ec-b326-f86f49bb67fb req-3ff60a73-6bb8-4e2c-bedc-d40c999d314e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90c8afd3-6bbe-4c19-a54e-d15e668764aa", "tag": "a094da8b-d536-43be-b68f-a2d964296caa"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:33:05 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-d7116992-5aae-48ec-b326-f86f49bb67fb req-3ff60a73-6bb8-4e2c-bedc-d40c999d314e service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:33:05 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-d7116992-5aae-48ec-b326-f86f49bb67fb req-3ff60a73-6bb8-4e2c-bedc-d40c999d314e service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:33:05 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-d7116992-5aae-48ec-b326-f86f49bb67fb req-3ff60a73-6bb8-4e2c-bedc-d40c999d314e service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:33:05 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-d7116992-5aae-48ec-b326-f86f49bb67fb req-3ff60a73-6bb8-4e2c-bedc-d40c999d314e service nova] Creating event network-changed:a094da8b-d536-43be-b68f-a2d964296caa for instance 90c8afd3-6bbe-4c19-a54e-d15e668764aa on user Apr 19 16:33:05 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-d7116992-5aae-48ec-b326-f86f49bb67fb req-3ff60a73-6bb8-4e2c-bedc-d40c999d314e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61473) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 19 16:33:05 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-d7116992-5aae-48ec-b326-f86f49bb67fb req-3ff60a73-6bb8-4e2c-bedc-d40c999d314e service nova] Acquired lock "compute-rpcapi-router" {{(pid=61473) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 19 16:33:05 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-c84a0c87-cbf2-465a-9720-ec420a2881d8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:33:05 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-c84a0c87-cbf2-465a-9720-ec420a2881d8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:33:05 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-c84a0c87-cbf2-465a-9720-ec420a2881d8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:33:05 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-c84a0c87-cbf2-465a-9720-ec420a2881d8 None None] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:33:05 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-c84a0c87-cbf2-465a-9720-ec420a2881d8 None None] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:33:05 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-c84a0c87-cbf2-465a-9720-ec420a2881d8 None None] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:33:05 user devstack@n-api.service[61473]: INFO nova.compute.rpcapi [None req-c84a0c87-cbf2-465a-9720-ec420a2881d8 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 19 16:33:05 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-c84a0c87-cbf2-465a-9720-ec420a2881d8 None None] Releasing lock "compute-rpcapi-router" {{(pid=61473) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 19 16:33:05 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-c84a0c87-cbf2-465a-9720-ec420a2881d8 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.224617 Apr 19 16:33:05 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 21/59] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:33:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 16:33:09 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [req-37b433f4-4026-4629-b880-9290daae22d2 req-58f93af1-7430-4a4e-83fd-787fe17999a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbf430be-25fa-4e08-8d5b-08c95b10172a", "tag": "ba5a5bcd-58df-4bf9-b39e-3a575b314fec"}]} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:33:09 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-37b433f4-4026-4629-b880-9290daae22d2 req-58f93af1-7430-4a4e-83fd-787fe17999a4 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:33:09 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-37b433f4-4026-4629-b880-9290daae22d2 req-58f93af1-7430-4a4e-83fd-787fe17999a4 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:33:09 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-37b433f4-4026-4629-b880-9290daae22d2 req-58f93af1-7430-4a4e-83fd-787fe17999a4 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:33:09 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-37b433f4-4026-4629-b880-9290daae22d2 req-58f93af1-7430-4a4e-83fd-787fe17999a4 service nova] Creating event network-changed:ba5a5bcd-58df-4bf9-b39e-3a575b314fec for instance fbf430be-25fa-4e08-8d5b-08c95b10172a on user Apr 19 16:33:09 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-37b433f4-4026-4629-b880-9290daae22d2 req-58f93af1-7430-4a4e-83fd-787fe17999a4 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61471) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 19 16:33:09 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-37b433f4-4026-4629-b880-9290daae22d2 req-58f93af1-7430-4a4e-83fd-787fe17999a4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61471) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 19 16:33:09 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-ac77bc38-14cc-4df5-955f-8e8aa8136a35 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:33:09 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-ac77bc38-14cc-4df5-955f-8e8aa8136a35 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:33:09 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-ac77bc38-14cc-4df5-955f-8e8aa8136a35 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:33:09 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-ac77bc38-14cc-4df5-955f-8e8aa8136a35 None None] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:33:09 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-ac77bc38-14cc-4df5-955f-8e8aa8136a35 None None] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:33:09 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-ac77bc38-14cc-4df5-955f-8e8aa8136a35 None None] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:33:09 user devstack@n-api.service[61471]: INFO nova.compute.rpcapi [None req-ac77bc38-14cc-4df5-955f-8e8aa8136a35 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 19 16:33:09 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-ac77bc38-14cc-4df5-955f-8e8aa8136a35 None None] Releasing lock "compute-rpcapi-router" {{(pid=61471) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 19 16:33:09 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-ac77bc38-14cc-4df5-955f-8e8aa8136a35 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.311213 Apr 19 16:33:09 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 20/60] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:33:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:33:11 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [req-b482053b-2896-4458-b23b-1a549ae7778e req-96dfed78-b970-4a6c-b5ce-507a8601111f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90c8afd3-6bbe-4c19-a54e-d15e668764aa", "name": "network-vif-plugged", "status": "completed", "tag": "a094da8b-d536-43be-b68f-a2d964296caa"}, {"server_uuid": "90c8afd3-6bbe-4c19-a54e-d15e668764aa", "name": "network-vif-plugged", "status": "completed", "tag": "a094da8b-d536-43be-b68f-a2d964296caa"}]} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:33:11 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell0:SELECT=2 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:33:11 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell1:SELECT=2 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:33:11 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-b482053b-2896-4458-b23b-1a549ae7778e req-96dfed78-b970-4a6c-b5ce-507a8601111f service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:33:11 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-b482053b-2896-4458-b23b-1a549ae7778e req-96dfed78-b970-4a6c-b5ce-507a8601111f service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:33:11 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-b482053b-2896-4458-b23b-1a549ae7778e req-96dfed78-b970-4a6c-b5ce-507a8601111f service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:33:11 user devstack@n-api.service[61472]: INFO nova.api.openstack.compute.server_external_events [req-b482053b-2896-4458-b23b-1a549ae7778e req-96dfed78-b970-4a6c-b5ce-507a8601111f service nova] Creating event network-vif-plugged:a094da8b-d536-43be-b68f-a2d964296caa for instance 90c8afd3-6bbe-4c19-a54e-d15e668764aa on user Apr 19 16:33:11 user devstack@n-api.service[61472]: INFO nova.api.openstack.compute.server_external_events [req-b482053b-2896-4458-b23b-1a549ae7778e req-96dfed78-b970-4a6c-b5ce-507a8601111f service nova] Creating event network-vif-plugged:a094da8b-d536-43be-b68f-a2d964296caa for instance 90c8afd3-6bbe-4c19-a54e-d15e668764aa on user Apr 19 16:33:11 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-b482053b-2896-4458-b23b-1a549ae7778e req-96dfed78-b970-4a6c-b5ce-507a8601111f service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61472) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 19 16:33:11 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-b482053b-2896-4458-b23b-1a549ae7778e req-96dfed78-b970-4a6c-b5ce-507a8601111f service nova] Acquired lock "compute-rpcapi-router" {{(pid=61472) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 19 16:33:11 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-34bdb680-d89c-4aa8-927b-e0e05311185f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:33:11 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-34bdb680-d89c-4aa8-927b-e0e05311185f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:33:11 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-34bdb680-d89c-4aa8-927b-e0e05311185f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:33:11 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-34bdb680-d89c-4aa8-927b-e0e05311185f None None] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:33:11 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-34bdb680-d89c-4aa8-927b-e0e05311185f None None] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:33:11 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-34bdb680-d89c-4aa8-927b-e0e05311185f None None] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:33:11 user devstack@n-api.service[61472]: INFO nova.compute.rpcapi [None req-34bdb680-d89c-4aa8-927b-e0e05311185f None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 19 16:33:11 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-34bdb680-d89c-4aa8-927b-e0e05311185f None None] Releasing lock "compute-rpcapi-router" {{(pid=61472) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 19 16:33:11 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-34bdb680-d89c-4aa8-927b-e0e05311185f None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.154939 Apr 19 16:33:11 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 20/61] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:33:11 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 16:33:13 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-136815ab-fd45-43f3-b11c-69b386449808 req-96adee04-9ced-4534-b2cd-5326245137c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbf430be-25fa-4e08-8d5b-08c95b10172a", "name": "network-vif-plugged", "status": "completed", "tag": "ba5a5bcd-58df-4bf9-b39e-3a575b314fec"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:33:13 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-136815ab-fd45-43f3-b11c-69b386449808 req-96adee04-9ced-4534-b2cd-5326245137c8 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:33:13 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-136815ab-fd45-43f3-b11c-69b386449808 req-96adee04-9ced-4534-b2cd-5326245137c8 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:33:13 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-136815ab-fd45-43f3-b11c-69b386449808 req-96adee04-9ced-4534-b2cd-5326245137c8 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:33:13 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-136815ab-fd45-43f3-b11c-69b386449808 req-96adee04-9ced-4534-b2cd-5326245137c8 service nova] Creating event network-vif-plugged:ba5a5bcd-58df-4bf9-b39e-3a575b314fec for instance fbf430be-25fa-4e08-8d5b-08c95b10172a on user Apr 19 16:33:13 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-136815ab-fd45-43f3-b11c-69b386449808 req-96adee04-9ced-4534-b2cd-5326245137c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046863 Apr 19 16:33:13 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 22/62] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:33:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:33:15 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell0:SELECT=10 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:33:15 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [req-fe58265b-80a0-4158-a946-7f383775bdb2 req-a815463a-7305-4421-b345-ab591c857094 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbf430be-25fa-4e08-8d5b-08c95b10172a", "name": "network-vif-plugged", "status": "completed", "tag": "ba5a5bcd-58df-4bf9-b39e-3a575b314fec"}]} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:33:15 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-fe58265b-80a0-4158-a946-7f383775bdb2 req-a815463a-7305-4421-b345-ab591c857094 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:33:15 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-fe58265b-80a0-4158-a946-7f383775bdb2 req-a815463a-7305-4421-b345-ab591c857094 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:33:15 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-fe58265b-80a0-4158-a946-7f383775bdb2 req-a815463a-7305-4421-b345-ab591c857094 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:33:15 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-fe58265b-80a0-4158-a946-7f383775bdb2 req-a815463a-7305-4421-b345-ab591c857094 service nova] Creating event network-vif-plugged:ba5a5bcd-58df-4bf9-b39e-3a575b314fec for instance fbf430be-25fa-4e08-8d5b-08c95b10172a on user Apr 19 16:33:15 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [req-fe58265b-80a0-4158-a946-7f383775bdb2 req-a815463a-7305-4421-b345-ab591c857094 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062056 Apr 19 16:33:15 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 21/63] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:33:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:33:19 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell0:SELECT=8 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:33:19 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-8da12cff-bb94-45c3-8bde-775fd7189238 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Action: 'create', calling method: .version_select at 0x7fd49743cee0>, body: {"keypair": {"name": "tempest-keypair-1825122389", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3rxLhEwcG5SVK5BDV4hBPwoDpErKg4uAd2Jgbvtt4TQV9xEJU1J3yR+rlkeqE8Uicvr7ERqXduiuCWg5ead/qs/L21JRJBTTLFfww0cPP6NzlA2UuCwiLxnj7HViztCg=="}} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:33:19 user devstack@n-api.service[61472]: DEBUG nova.quota [None req-8da12cff-bb94-45c3-8bde-775fd7189238 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Getting quotas for project ee32e72a51414422bfad5875f32b1515. Resources: {'key_pairs'} {{(pid=61472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 16:33:19 user devstack@n-api.service[61472]: DEBUG nova.quota [None req-8da12cff-bb94-45c3-8bde-775fd7189238 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Getting quotas for user 6be99c3ba0554acda7b418f66a31c943 and project ee32e72a51414422bfad5875f32b1515. Resources: {'key_pairs'} {{(pid=61472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 16:33:20 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-8da12cff-bb94-45c3-8bde-775fd7189238 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.680602 Apr 19 16:33:20 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 21/64] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 16:33:19 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:33:21 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell0:SELECT=2 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:33:22 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-28f6202b-63fd-404a-9da4-54de723e4a22 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Action: 'create', calling method: .version_select at 0x7fd497c67a30>, body: {"keypair": {"name": "tempest-keypair-419392040", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXC0KfWpYsWXjcoJO1olslLdC6QHbIwMFWbsR82K3WBjauQTp2M/zxhTtsgqI/GJ91rs5QGqJgO+dodIg4k+r2oimW2HHEzBKy3Xj+nJFrN8YiSAplnQwauiorWz41oJA=="}} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:33:22 user devstack@n-api.service[61473]: DEBUG nova.quota [None req-28f6202b-63fd-404a-9da4-54de723e4a22 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Getting quotas for project fcbe4ed80f09473e98aad29199588a6c. Resources: {'key_pairs'} {{(pid=61473) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 16:33:22 user devstack@n-api.service[61473]: DEBUG nova.quota [None req-28f6202b-63fd-404a-9da4-54de723e4a22 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Getting quotas for user 467f608512c4451fb461a5c495bbc9f1 and project fcbe4ed80f09473e98aad29199588a6c. Resources: {'key_pairs'} {{(pid=61473) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 16:33:22 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-28f6202b-63fd-404a-9da4-54de723e4a22 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.607885 Apr 19 16:33:22 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 23/65] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 16:33:21 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:33:23 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell0:SELECT=4 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:33:23 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-51003eb4-2127-41e3-9a79-e1c37fe8b187 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-769445449", "imageRef": "ab56c4b1-0117-43b0-84b6-28d06a23f182", "flavorRef": "42", "networks": [{"uuid": "6f91dcb6-4159-42d3-89a1-759cadf832a9"}], "security_groups": [{"name": "tempest-securitygroup--1917146760"}], "key_name": "tempest-keypair-1825122389", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:33:23 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=4 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:33:24 user devstack@n-api.service[61471]: DEBUG nova.network.neutron [None req-51003eb4-2127-41e3-9a79-e1c37fe8b187 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] validate_networks() for [('6f91dcb6-4159-42d3-89a1-759cadf832a9', None, None, None, None, None)] {{(pid=61471) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 16:33:25 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell1:SELECT=8 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:33:25 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-93e0adf4-e1af-47e9-aa35-09d9cc174286 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1316985777", "imageRef": "23798d8e-9e67-4ef0-9b46-ff7c74fbab35", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "483d833e-0475-4e8f-83a2-e7f915b0ba23"}], "security_groups": [{"name": "tempest-securitygroup--16209177"}], "key_name": "tempest-keypair-419392040", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:33:25 user devstack@n-api.service[61471]: DEBUG nova.virt.hardware [None req-51003eb4-2127-41e3-9a79-e1c37fe8b187 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Flavor limits 0:0:0 {{(pid=61471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 16:33:25 user devstack@n-api.service[61471]: DEBUG nova.virt.hardware [None req-51003eb4-2127-41e3-9a79-e1c37fe8b187 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Image limits 0:0:0 {{(pid=61471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 16:33:25 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell0:SELECT=2 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:33:25 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell1:SELECT=4 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:33:25 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=4 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:33:25 user devstack@n-api.service[61471]: DEBUG nova.virt.hardware [None req-51003eb4-2127-41e3-9a79-e1c37fe8b187 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Flavor pref 0:0:0 {{(pid=61471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 16:33:25 user devstack@n-api.service[61471]: DEBUG nova.virt.hardware [None req-51003eb4-2127-41e3-9a79-e1c37fe8b187 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Image pref 0:0:0 {{(pid=61471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 16:33:25 user devstack@n-api.service[61471]: DEBUG nova.virt.hardware [None req-51003eb4-2127-41e3-9a79-e1c37fe8b187 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 16:33:25 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-51003eb4-2127-41e3-9a79-e1c37fe8b187 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:33:25 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-51003eb4-2127-41e3-9a79-e1c37fe8b187 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:33:25 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-51003eb4-2127-41e3-9a79-e1c37fe8b187 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:33:25 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-51003eb4-2127-41e3-9a79-e1c37fe8b187 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:33:25 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-51003eb4-2127-41e3-9a79-e1c37fe8b187 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:33:25 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-51003eb4-2127-41e3-9a79-e1c37fe8b187 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:33:25 user devstack@n-api.service[61471]: DEBUG nova.quota [None req-51003eb4-2127-41e3-9a79-e1c37fe8b187 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Getting quotas for project ee32e72a51414422bfad5875f32b1515. Resources: {'instances', 'ram', 'cores'} {{(pid=61471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 16:33:25 user devstack@n-api.service[61471]: DEBUG nova.quota [None req-51003eb4-2127-41e3-9a79-e1c37fe8b187 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Getting quotas for user 6be99c3ba0554acda7b418f66a31c943 and project ee32e72a51414422bfad5875f32b1515. Resources: {'instances', 'ram', 'cores'} {{(pid=61471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 16:33:25 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-51003eb4-2127-41e3-9a79-e1c37fe8b187 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Going to run 1 instances... {{(pid=61471) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 16:33:25 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-51003eb4-2127-41e3-9a79-e1c37fe8b187 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] [instance: ded3b7ea-2e6a-4aa9-b658-424a8bea42bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ab56c4b1-0117-43b0-84b6-28d06a23f182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61471) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 16:33:25 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-51003eb4-2127-41e3-9a79-e1c37fe8b187 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.208345 Apr 19 16:33:25 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 22/66] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 16:33:23 2023] POST /compute/v2.1/servers => generated 404 bytes in 2211 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 16:33:25 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell1:SELECT=6 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:33:25 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-d71096dc-19d7-43f4-9df5-4a255cff30b8 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:33:25 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-d71096dc-19d7-43f4-9df5-4a255cff30b8 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] [instance: ded3b7ea-2e6a-4aa9-b658-424a8bea42bc] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:33:26 user devstack@n-api.service[61472]: DEBUG nova.network.neutron [None req-93e0adf4-e1af-47e9-aa35-09d9cc174286 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] validate_networks() for [('483d833e-0475-4e8f-83a2-e7f915b0ba23', None, None, None, None, None)] {{(pid=61472) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 16:33:26 user devstack@n-api.service[61473]: DEBUG nova.policy [None req-d71096dc-19d7-43f4-9df5-4a255cff30b8 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be99c3ba0554acda7b418f66a31c943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee32e72a51414422bfad5875f32b1515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61473) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:33:26 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-d71096dc-19d7-43f4-9df5-4a255cff30b8 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ded3b7ea-2e6a-4aa9-b658-424a8bea42bc" status: 200 len: 1235 microversion: 2.1 time: 0.207094 Apr 19 16:33:26 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 24/67] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:33:25 2023] GET /compute/v2.1/servers/ded3b7ea-2e6a-4aa9-b658-424a8bea42bc => generated 1235 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:33:28 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-93e0adf4-e1af-47e9-aa35-09d9cc174286 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Flavor limits 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 16:33:28 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-93e0adf4-e1af-47e9-aa35-09d9cc174286 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Image limits 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 16:33:28 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-93e0adf4-e1af-47e9-aa35-09d9cc174286 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Flavor pref 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 16:33:28 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-93e0adf4-e1af-47e9-aa35-09d9cc174286 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Image pref 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 16:33:28 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-93e0adf4-e1af-47e9-aa35-09d9cc174286 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 16:33:28 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-93e0adf4-e1af-47e9-aa35-09d9cc174286 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:33:28 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-93e0adf4-e1af-47e9-aa35-09d9cc174286 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:33:28 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-93e0adf4-e1af-47e9-aa35-09d9cc174286 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:33:28 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-93e0adf4-e1af-47e9-aa35-09d9cc174286 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:33:28 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-93e0adf4-e1af-47e9-aa35-09d9cc174286 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:33:28 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-93e0adf4-e1af-47e9-aa35-09d9cc174286 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:33:28 user devstack@n-api.service[61472]: DEBUG nova.quota [None req-93e0adf4-e1af-47e9-aa35-09d9cc174286 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Getting quotas for project fcbe4ed80f09473e98aad29199588a6c. Resources: {'instances', 'ram', 'cores'} {{(pid=61472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 16:33:28 user devstack@n-api.service[61472]: DEBUG nova.quota [None req-93e0adf4-e1af-47e9-aa35-09d9cc174286 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Getting quotas for user 467f608512c4451fb461a5c495bbc9f1 and project fcbe4ed80f09473e98aad29199588a6c. Resources: {'instances', 'ram', 'cores'} {{(pid=61472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 16:33:28 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-93e0adf4-e1af-47e9-aa35-09d9cc174286 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Going to run 1 instances... {{(pid=61472) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 16:33:28 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-93e0adf4-e1af-47e9-aa35-09d9cc174286 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] [instance: f9885d3d-e74d-4250-b096-0df5dde6f3cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='23798d8e-9e67-4ef0-9b46-ff7c74fbab35',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 16:33:28 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-93e0adf4-e1af-47e9-aa35-09d9cc174286 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.957570 Apr 19 16:33:28 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 22/68] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 16:33:25 2023] POST /compute/v2.1/servers => generated 402 bytes in 2959 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 16:33:28 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-0bb4eb91-c4b3-4252-a655-55ee2b4ab938 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:33:28 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-0bb4eb91-c4b3-4252-a655-55ee2b4ab938 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] [instance: f9885d3d-e74d-4250-b096-0df5dde6f3cd] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:33:28 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-0bb4eb91-c4b3-4252-a655-55ee2b4ab938 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467f608512c4451fb461a5c495bbc9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbe4ed80f09473e98aad29199588a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:33:28 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-0bb4eb91-c4b3-4252-a655-55ee2b4ab938 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f9885d3d-e74d-4250-b096-0df5dde6f3cd" status: 200 len: 1239 microversion: 2.1 time: 0.130024 Apr 19 16:33:28 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 23/69] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:33:28 2023] GET /compute/v2.1/servers/f9885d3d-e74d-4250-b096-0df5dde6f3cd => generated 1239 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:33:31 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-020e6450-d458-401b-af60-a6481b81f523 req-5400df09-9dd4-4a68-b594-aea177de4da5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ded3b7ea-2e6a-4aa9-b658-424a8bea42bc", "tag": "58b610d1-d4a8-4a99-a790-15b652fc7345"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:33:31 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-020e6450-d458-401b-af60-a6481b81f523 req-5400df09-9dd4-4a68-b594-aea177de4da5 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:33:31 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-020e6450-d458-401b-af60-a6481b81f523 req-5400df09-9dd4-4a68-b594-aea177de4da5 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:33:31 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-020e6450-d458-401b-af60-a6481b81f523 req-5400df09-9dd4-4a68-b594-aea177de4da5 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:33:31 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-020e6450-d458-401b-af60-a6481b81f523 req-5400df09-9dd4-4a68-b594-aea177de4da5 service nova] Creating event network-changed:58b610d1-d4a8-4a99-a790-15b652fc7345 for instance ded3b7ea-2e6a-4aa9-b658-424a8bea42bc on user Apr 19 16:33:31 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-020e6450-d458-401b-af60-a6481b81f523 req-5400df09-9dd4-4a68-b594-aea177de4da5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043035 Apr 19 16:33:31 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 25/70] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:33:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:33:34 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [req-7309e13f-cc73-4e42-985a-39710e10daad req-caba32e5-6f60-4242-aeb7-418235364ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ded3b7ea-2e6a-4aa9-b658-424a8bea42bc", "name": "network-vif-plugged", "status": "completed", "tag": "58b610d1-d4a8-4a99-a790-15b652fc7345"}]} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:33:34 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-7309e13f-cc73-4e42-985a-39710e10daad req-caba32e5-6f60-4242-aeb7-418235364ed8 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:33:34 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-7309e13f-cc73-4e42-985a-39710e10daad req-caba32e5-6f60-4242-aeb7-418235364ed8 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:33:34 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-7309e13f-cc73-4e42-985a-39710e10daad req-caba32e5-6f60-4242-aeb7-418235364ed8 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:33:34 user devstack@n-api.service[61472]: INFO nova.api.openstack.compute.server_external_events [req-7309e13f-cc73-4e42-985a-39710e10daad req-caba32e5-6f60-4242-aeb7-418235364ed8 service nova] Creating event network-vif-plugged:58b610d1-d4a8-4a99-a790-15b652fc7345 for instance ded3b7ea-2e6a-4aa9-b658-424a8bea42bc on user Apr 19 16:33:34 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [req-7309e13f-cc73-4e42-985a-39710e10daad req-caba32e5-6f60-4242-aeb7-418235364ed8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036824 Apr 19 16:33:34 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 23/71] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:33:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:33:36 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [req-52d3964d-718a-469c-b370-2953288895e4 req-d00c0eec-88a7-4436-a06f-c5867f1fc86a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ded3b7ea-2e6a-4aa9-b658-424a8bea42bc", "name": "network-vif-plugged", "status": "completed", "tag": "58b610d1-d4a8-4a99-a790-15b652fc7345"}, {"name": "network-changed", "server_uuid": "f9885d3d-e74d-4250-b096-0df5dde6f3cd", "tag": "07559239-c0f3-4b70-8f8a-d30256480e8e"}]} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:33:36 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell0:SELECT=2 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:33:36 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell1:SELECT=2 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:33:36 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-52d3964d-718a-469c-b370-2953288895e4 req-d00c0eec-88a7-4436-a06f-c5867f1fc86a service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:33:36 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-52d3964d-718a-469c-b370-2953288895e4 req-d00c0eec-88a7-4436-a06f-c5867f1fc86a service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:33:36 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-52d3964d-718a-469c-b370-2953288895e4 req-d00c0eec-88a7-4436-a06f-c5867f1fc86a service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:33:36 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-52d3964d-718a-469c-b370-2953288895e4 req-d00c0eec-88a7-4436-a06f-c5867f1fc86a service nova] Creating event network-vif-plugged:58b610d1-d4a8-4a99-a790-15b652fc7345 for instance ded3b7ea-2e6a-4aa9-b658-424a8bea42bc on user Apr 19 16:33:36 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-52d3964d-718a-469c-b370-2953288895e4 req-d00c0eec-88a7-4436-a06f-c5867f1fc86a service nova] Creating event network-changed:07559239-c0f3-4b70-8f8a-d30256480e8e for instance f9885d3d-e74d-4250-b096-0df5dde6f3cd on user Apr 19 16:33:36 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [req-52d3964d-718a-469c-b370-2953288895e4 req-d00c0eec-88a7-4436-a06f-c5867f1fc86a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.043434 Apr 19 16:33:36 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 24/72] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:33:36 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:33:39 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-859fb16b-fa2b-4d63-8912-47a02a5bb501 req-53a899af-023e-4ca3-8e8b-9641dee47593 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9885d3d-e74d-4250-b096-0df5dde6f3cd", "name": "network-vif-plugged", "status": "completed", "tag": "07559239-c0f3-4b70-8f8a-d30256480e8e"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:33:39 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell0:SELECT=6 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:33:39 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:33:39 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-859fb16b-fa2b-4d63-8912-47a02a5bb501 req-53a899af-023e-4ca3-8e8b-9641dee47593 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:33:39 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-859fb16b-fa2b-4d63-8912-47a02a5bb501 req-53a899af-023e-4ca3-8e8b-9641dee47593 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:33:39 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-859fb16b-fa2b-4d63-8912-47a02a5bb501 req-53a899af-023e-4ca3-8e8b-9641dee47593 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:33:39 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-859fb16b-fa2b-4d63-8912-47a02a5bb501 req-53a899af-023e-4ca3-8e8b-9641dee47593 service nova] Creating event network-vif-plugged:07559239-c0f3-4b70-8f8a-d30256480e8e for instance f9885d3d-e74d-4250-b096-0df5dde6f3cd on user Apr 19 16:33:39 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-859fb16b-fa2b-4d63-8912-47a02a5bb501 req-53a899af-023e-4ca3-8e8b-9641dee47593 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050242 Apr 19 16:33:39 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 26/73] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:33:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:33:42 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell0:SELECT=2 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:33:42 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell0:SELECT=10 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:33:42 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [req-99cf00fb-d098-45ae-beab-f87c6f8c216b req-b2301e76-e8d4-4e7a-b189-6c18654502f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9885d3d-e74d-4250-b096-0df5dde6f3cd", "name": "network-vif-plugged", "status": "completed", "tag": "07559239-c0f3-4b70-8f8a-d30256480e8e"}]} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:33:42 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-99cf00fb-d098-45ae-beab-f87c6f8c216b req-b2301e76-e8d4-4e7a-b189-6c18654502f7 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:33:42 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-99cf00fb-d098-45ae-beab-f87c6f8c216b req-b2301e76-e8d4-4e7a-b189-6c18654502f7 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:33:42 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-99cf00fb-d098-45ae-beab-f87c6f8c216b req-b2301e76-e8d4-4e7a-b189-6c18654502f7 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:33:42 user devstack@n-api.service[61472]: INFO nova.api.openstack.compute.server_external_events [req-99cf00fb-d098-45ae-beab-f87c6f8c216b req-b2301e76-e8d4-4e7a-b189-6c18654502f7 service nova] Creating event network-vif-plugged:07559239-c0f3-4b70-8f8a-d30256480e8e for instance f9885d3d-e74d-4250-b096-0df5dde6f3cd on user Apr 19 16:33:42 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [req-99cf00fb-d098-45ae-beab-f87c6f8c216b req-b2301e76-e8d4-4e7a-b189-6c18654502f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038958 Apr 19 16:33:42 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 24/74] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:33:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:33:42 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell0:SELECT=8 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:33:42 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-042043ed-69cc-474b-922e-ee5d9b8be03d tempest-TestShelveInstance-1068522170 tempest-TestShelveInstance-1068522170-project-member] Action: 'create', calling method: .version_select at 0x7fd497b61240>, body: {"keypair": {"name": "tempest-TestShelveInstance-785225351", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2IZE3Lw20cD8nzgUHbqe48UwrDs/NAw5bl1+dd/1kSpXGvrAFjCC/QOdhJ4PG63wdGe66MLSEo62PRaHi6+FKZJBIfDIh9Wt0g8hzTETHUTaHvtMUpPQlTeFHSZavZ9A=="}} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:33:42 user devstack@n-api.service[61471]: DEBUG nova.quota [None req-042043ed-69cc-474b-922e-ee5d9b8be03d tempest-TestShelveInstance-1068522170 tempest-TestShelveInstance-1068522170-project-member] Getting quotas for project 722c191018c44ed1b7e88e24acc2b719. Resources: {'key_pairs'} {{(pid=61471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 16:33:42 user devstack@n-api.service[61471]: DEBUG nova.quota [None req-042043ed-69cc-474b-922e-ee5d9b8be03d tempest-TestShelveInstance-1068522170 tempest-TestShelveInstance-1068522170-project-member] Getting quotas for user b494176c7f93440b81a0fc3293d76966 and project 722c191018c44ed1b7e88e24acc2b719. Resources: {'key_pairs'} {{(pid=61471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 16:33:42 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-042043ed-69cc-474b-922e-ee5d9b8be03d tempest-TestShelveInstance-1068522170 tempest-TestShelveInstance-1068522170-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.400576 Apr 19 16:33:42 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 25/75] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 16:33:42 2023] POST /compute/v2.1/os-keypairs => generated 396 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:33:45 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-2f043af5-2257-4072-844d-03b052aa4822 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:33:45 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-2f043af5-2257-4072-844d-03b052aa4822 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] [instance: 90c8afd3-6bbe-4c19-a54e-d15e668764aa] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:33:45 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-2f043af5-2257-4072-844d-03b052aa4822 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:33:45 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-2f043af5-2257-4072-844d-03b052aa4822 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:33:45 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-2f043af5-2257-4072-844d-03b052aa4822 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:33:45 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-2f043af5-2257-4072-844d-03b052aa4822 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:33:45 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-2f043af5-2257-4072-844d-03b052aa4822 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:33:45 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-2f043af5-2257-4072-844d-03b052aa4822 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:33:45 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-95c24805-6bf8-4e07-8f63-dc8df0abdf29 tempest-VolumesSnapshotsTestJSON-1618770674 tempest-VolumesSnapshotsTestJSON-1618770674-project-member] Action: 'create', calling method: .version_select at 0x7fd497c87a30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1877120466"}} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:33:45 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-9b7f747a-4942-4c68-9d22-09fef889483b tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Action: 'create', calling method: .version_select at 0x7fd497b63d90>, body: {"keypair": {"name": "tempest-keypair-168235150", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFnOXiSpWQ2LQm4dyYh20vv+CmO1bk262AQGSfChPQHsseluO+gmb/W0UTFYYPxMa1etk8lVTnus9AL0S6ZdREEhoVnWag6Yxi+fyuiO5xDfiBIMu6o/sG6DutwfB+iXew=="}} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:33:45 user devstack@n-api.service[61471]: DEBUG nova.quota [None req-9b7f747a-4942-4c68-9d22-09fef889483b tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Getting quotas for project d29a717b7f334af5a35d9e86c3d4b085. Resources: {'key_pairs'} {{(pid=61471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 16:33:45 user devstack@n-api.service[61471]: DEBUG nova.quota [None req-9b7f747a-4942-4c68-9d22-09fef889483b tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Getting quotas for user 34afcb1cb8d2433b9564e5b62b45fe86 and project d29a717b7f334af5a35d9e86c3d4b085. Resources: {'key_pairs'} {{(pid=61471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 16:33:45 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-9b7f747a-4942-4c68-9d22-09fef889483b tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.104809 Apr 19 16:33:45 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 26/76] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 19 16:33:45 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 107 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 19 16:33:45 user devstack@n-api.service[61472]: DEBUG nova.policy [None req-2f043af5-2257-4072-844d-03b052aa4822 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4fa81c86f045dba9b620bc6ac35684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fdc184adf4be795f5e3b1bfb170fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61472) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:33:45 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-2f043af5-2257-4072-844d-03b052aa4822 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] 10.0.0.210 "GET /compute/v2.1/servers/90c8afd3-6bbe-4c19-a54e-d15e668764aa" status: 200 len: 1489 microversion: 2.1 time: 0.388534 Apr 19 16:33:45 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 25/77] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:33:45 2023] GET /compute/v2.1/servers/90c8afd3-6bbe-4c19-a54e-d15e668764aa => generated 1489 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:33:45 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-95c24805-6bf8-4e07-8f63-dc8df0abdf29 tempest-VolumesSnapshotsTestJSON-1618770674 tempest-VolumesSnapshotsTestJSON-1618770674-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.609838 Apr 19 16:33:45 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 27/78] 10.0.0.210 () {64 vars in 1232 bytes} [Wed Apr 19 16:33:45 2023] POST /compute/v2.1/os-volumes => generated 345 bytes in 612 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 19 16:33:45 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-7f71a33d-caaa-4790-a892-7a5b3d2e6710 tempest-VolumesSnapshotsTestJSON-1618770674 tempest-VolumesSnapshotsTestJSON-1618770674-project-member] Calling method '.version_select at 0x7fd497b98700>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:33:45 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-7f71a33d-caaa-4790-a892-7a5b3d2e6710 tempest-VolumesSnapshotsTestJSON-1618770674 tempest-VolumesSnapshotsTestJSON-1618770674-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/9ed0dcf3-864e-420a-a15c-39f6b4bce4f9" status: 200 len: 342 microversion: 2.1 time: 0.071216 Apr 19 16:33:45 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 27/79] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 19 16:33:45 2023] GET /compute/v2.1/os-volumes/9ed0dcf3-864e-420a-a15c-39f6b4bce4f9 => generated 342 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:33:46 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-e05e60be-a73c-41d6-a98d-d3d9f3922033 tempest-VolumesSnapshotsTestJSON-1618770674 tempest-VolumesSnapshotsTestJSON-1618770674-project-member] Calling method '.version_select at 0x7fd49746d2d0>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:33:47 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-e05e60be-a73c-41d6-a98d-d3d9f3922033 tempest-VolumesSnapshotsTestJSON-1618770674 tempest-VolumesSnapshotsTestJSON-1618770674-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/9ed0dcf3-864e-420a-a15c-39f6b4bce4f9" status: 200 len: 342 microversion: 2.1 time: 0.081072 Apr 19 16:33:47 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 26/80] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 19 16:33:46 2023] GET /compute/v2.1/os-volumes/9ed0dcf3-864e-420a-a15c-39f6b4bce4f9 => generated 342 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:33:47 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-398dbb04-7838-4c92-b073-6102650b4098 tempest-VolumesSnapshotsTestJSON-1618770674 tempest-VolumesSnapshotsTestJSON-1618770674-project-member] Calling method '.version_select at 0x7fd497ccce50>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:33:47 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-398dbb04-7838-4c92-b073-6102650b4098 tempest-VolumesSnapshotsTestJSON-1618770674 tempest-VolumesSnapshotsTestJSON-1618770674-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/9ed0dcf3-864e-420a-a15c-39f6b4bce4f9" status: 202 len: 0 microversion: 2.1 time: 0.128408 Apr 19 16:33:47 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 28/81] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 19 16:33:47 2023] DELETE /compute/v2.1/os-volumes/9ed0dcf3-864e-420a-a15c-39f6b4bce4f9 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 16:33:47 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell1:SELECT=2 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:33:47 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-7520f611-fa9d-4317-9841-abc641b64141 tempest-VolumesSnapshotsTestJSON-1618770674 tempest-VolumesSnapshotsTestJSON-1618770674-project-member] Calling method '.version_select at 0x7fd497b98ee0>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:33:47 user devstack@n-api.service[61471]: INFO nova.api.openstack.wsgi [None req-7520f611-fa9d-4317-9841-abc641b64141 tempest-VolumesSnapshotsTestJSON-1618770674 tempest-VolumesSnapshotsTestJSON-1618770674-project-member] HTTP exception thrown: Volume 9ed0dcf3-864e-420a-a15c-39f6b4bce4f9 could not be found. Apr 19 16:33:47 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-7520f611-fa9d-4317-9841-abc641b64141 tempest-VolumesSnapshotsTestJSON-1618770674 tempest-VolumesSnapshotsTestJSON-1618770674-project-member] Request method failure captured: Apr 19 16:33:47 user devstack@n-api.service[61471]: request: GET /compute/v2.1/os-volumes/9ed0dcf3-864e-420a-a15c-39f6b4bce4f9 HTTP/1.1 Apr 19 16:33:47 user devstack@n-api.service[61471]: Accept: application/json Apr 19 16:33:47 user devstack@n-api.service[61471]: Accept-Encoding: identity Apr 19 16:33:47 user devstack@n-api.service[61471]: Connection: close Apr 19 16:33:47 user devstack@n-api.service[61471]: Content-Length: 0 Apr 19 16:33:47 user devstack@n-api.service[61471]: Content-Type: application/json Apr 19 16:33:47 user devstack@n-api.service[61471]: Host: 10.0.0.210 Apr 19 16:33:47 user devstack@n-api.service[61471]: Openstack-System-Scope: None Apr 19 16:33:47 user devstack@n-api.service[61471]: User-Agent: python-urllib3/1.26.15 Apr 19 16:33:47 user devstack@n-api.service[61471]: X-Auth-Token: gAAAAABkQBfpxBYsXIQmJJUjHs8PfP5_kzaVSqYzsPsWDcXjb8aEQwtSrtphufDyjr0lmVWmeNEH41LNLMjQ6ut1v7BMaoxXfWGt9ixY_0JqIeTzLUiCBWbhst-UXT1zfrlgdVu3rpFrdcMwnuQ5KT6WC1uuiheSz3ZKnZAAghmoljQt2rOVIds Apr 19 16:33:47 user devstack@n-api.service[61471]: X-Domain-Id: None Apr 19 16:33:47 user devstack@n-api.service[61471]: X-Domain-Name: None Apr 19 16:33:47 user devstack@n-api.service[61471]: X-Identity-Status: Confirmed Apr 19 16:33:47 user devstack@n-api.service[61471]: X-Is-Admin-Project: True Apr 19 16:33:47 user devstack@n-api.service[61471]: X-Project-Domain-Id: default Apr 19 16:33:47 user devstack@n-api.service[61471]: X-Project-Domain-Name: Default Apr 19 16:33:47 user devstack@n-api.service[61471]: X-Project-Id: 5f3699f37983432e8c366bc275fc483f Apr 19 16:33:47 user devstack@n-api.service[61471]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1618770674 Apr 19 16:33:47 user devstack@n-api.service[61471]: X-Role: member,reader Apr 19 16:33:47 user devstack@n-api.service[61471]: X-Roles: member,reader Apr 19 16:33:47 user devstack@n-api.service[61471]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5f3699f37983432e8c366bc275fc483f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5f3699f37983432e8c366bc275fc483f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5f3699f37983432e8c366bc275fc483f"}]}] Apr 19 16:33:47 user devstack@n-api.service[61471]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1618770674 Apr 19 16:33:47 user devstack@n-api.service[61471]: X-Tenant-Id: 5f3699f37983432e8c366bc275fc483f Apr 19 16:33:47 user devstack@n-api.service[61471]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1618770674 Apr 19 16:33:47 user devstack@n-api.service[61471]: X-User: tempest-VolumesSnapshotsTestJSON-1618770674-project-member Apr 19 16:33:47 user devstack@n-api.service[61471]: X-User-Domain-Id: default Apr 19 16:33:47 user devstack@n-api.service[61471]: X-User-Domain-Name: Default Apr 19 16:33:47 user devstack@n-api.service[61471]: X-User-Id: efc05bbfe36e4852874831014ad79c82 Apr 19 16:33:47 user devstack@n-api.service[61471]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1618770674-project-member Apr 19 16:33:47 user devstack@n-api.service[61471]: method: Apr 19 16:33:47 user devstack@n-api.service[61471]: exception: Volume 9ed0dcf3-864e-420a-a15c-39f6b4bce4f9 could not be found. Apr 19 16:33:47 user devstack@n-api.service[61471]: action_args: {'id': '9ed0dcf3-864e-420a-a15c-39f6b4bce4f9'} Apr 19 16:33:47 user devstack@n-api.service[61471]: {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9ed0dcf3-864e-420a-a15c-39f6b4bce4f9 could not be found. (HTTP 404) (Request-ID: req-49c8ac01-cce8-4fee-88b4-f41515b38b42) Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9ed0dcf3-864e-420a-a15c-39f6b4bce4f9 could not be found. Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9ed0dcf3-864e-420a-a15c-39f6b4bce4f9 could not be found. Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9ed0dcf3-864e-420a-a15c-39f6b4bce4f9 could not be found. Apr 19 16:33:47 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:33:47 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-7520f611-fa9d-4317-9841-abc641b64141 tempest-VolumesSnapshotsTestJSON-1618770674 tempest-VolumesSnapshotsTestJSON-1618770674-project-member] Returning 404 to user: Volume 9ed0dcf3-864e-420a-a15c-39f6b4bce4f9 could not be found. {{(pid=61471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:33:47 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-7520f611-fa9d-4317-9841-abc641b64141 tempest-VolumesSnapshotsTestJSON-1618770674 tempest-VolumesSnapshotsTestJSON-1618770674-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/9ed0dcf3-864e-420a-a15c-39f6b4bce4f9" status: 404 len: 109 microversion: 2.1 time: 0.040408 Apr 19 16:33:47 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 28/82] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 19 16:33:47 2023] GET /compute/v2.1/os-volumes/9ed0dcf3-864e-420a-a15c-39f6b4bce4f9 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 16:33:47 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-42e56d82-442c-42db-8413-d0536525706f tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-901124921", "imageRef": "ab56c4b1-0117-43b0-84b6-28d06a23f182", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "df1f9af5-f53b-47e4-b42a-55402d78b5c2"}], "security_groups": [{"name": "tempest-securitygroup--1933849727"}], "key_name": "tempest-keypair-168235150", "user_data": "}} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:33:47 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-0a41ec2c-8ac2-4763-993e-1a9eabb1c33a tempest-TestShelveInstance-1068522170 tempest-TestShelveInstance-1068522170-project-member] Calling method '.version_select at 0x7fd497c87490>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:33:47 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-0a41ec2c-8ac2-4763-993e-1a9eabb1c33a tempest-TestShelveInstance-1068522170 tempest-TestShelveInstance-1068522170-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-785225351" status: 202 len: 0 microversion: 2.1 time: 0.111105 Apr 19 16:33:47 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 29/83] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 19 16:33:47 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-785225351 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 16:33:48 user devstack@n-api.service[61472]: DEBUG nova.network.neutron [None req-42e56d82-442c-42db-8413-d0536525706f tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] validate_networks() for [('df1f9af5-f53b-47e4-b42a-55402d78b5c2', None, None, None, None, None)] {{(pid=61472) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 16:33:48 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-42e56d82-442c-42db-8413-d0536525706f tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Flavor limits 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 16:33:48 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-42e56d82-442c-42db-8413-d0536525706f tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Image limits 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 16:33:48 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-42e56d82-442c-42db-8413-d0536525706f tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Flavor pref 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 16:33:48 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-42e56d82-442c-42db-8413-d0536525706f tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Image pref 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 16:33:48 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-42e56d82-442c-42db-8413-d0536525706f tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 16:33:48 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-42e56d82-442c-42db-8413-d0536525706f tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:33:48 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-42e56d82-442c-42db-8413-d0536525706f tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:33:48 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-42e56d82-442c-42db-8413-d0536525706f tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:33:48 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-42e56d82-442c-42db-8413-d0536525706f tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:33:48 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-42e56d82-442c-42db-8413-d0536525706f tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:33:48 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-42e56d82-442c-42db-8413-d0536525706f tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:33:48 user devstack@n-api.service[61472]: DEBUG nova.quota [None req-42e56d82-442c-42db-8413-d0536525706f tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Getting quotas for project d29a717b7f334af5a35d9e86c3d4b085. Resources: {'instances', 'ram', 'cores'} {{(pid=61472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 16:33:48 user devstack@n-api.service[61472]: DEBUG nova.quota [None req-42e56d82-442c-42db-8413-d0536525706f tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Getting quotas for user 34afcb1cb8d2433b9564e5b62b45fe86 and project d29a717b7f334af5a35d9e86c3d4b085. Resources: {'instances', 'ram', 'cores'} {{(pid=61472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 16:33:48 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-42e56d82-442c-42db-8413-d0536525706f tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Going to run 1 instances... {{(pid=61472) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 16:33:48 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-42e56d82-442c-42db-8413-d0536525706f tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] [instance: 01b50b56-31d2-4143-8585-63713d1bc7e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ab56c4b1-0117-43b0-84b6-28d06a23f182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 16:33:48 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-42e56d82-442c-42db-8413-d0536525706f tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 1.092377 Apr 19 16:33:48 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 27/84] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 19 16:33:47 2023] POST /compute/v2.1/servers => generated 400 bytes in 1095 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 19 16:33:48 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-d53e4667-f67c-415a-880d-7956974590c2 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:33:48 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-d53e4667-f67c-415a-880d-7956974590c2 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] [instance: 01b50b56-31d2-4143-8585-63713d1bc7e9] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:33:49 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-d53e4667-f67c-415a-880d-7956974590c2 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34afcb1cb8d2433b9564e5b62b45fe86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29a717b7f334af5a35d9e86c3d4b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:33:49 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-d53e4667-f67c-415a-880d-7956974590c2 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34afcb1cb8d2433b9564e5b62b45fe86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29a717b7f334af5a35d9e86c3d4b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:33:49 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-d53e4667-f67c-415a-880d-7956974590c2 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34afcb1cb8d2433b9564e5b62b45fe86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29a717b7f334af5a35d9e86c3d4b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:33:49 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-d53e4667-f67c-415a-880d-7956974590c2 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/01b50b56-31d2-4143-8585-63713d1bc7e9" status: 200 len: 1274 microversion: 2.20 time: 0.257430 Apr 19 16:33:49 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 29/85] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 16:33:48 2023] GET /compute/v2.1/servers/01b50b56-31d2-4143-8585-63713d1bc7e9 => generated 1274 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 16:33:49 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-ef700068-fd38-4229-9f8a-64a65a7da8f5 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2032187272", "imageRef": "ab56c4b1-0117-43b0-84b6-28d06a23f182", "flavorRef": "42", "networks": [{"uuid": "db8bad9b-2d27-4871-8f72-c9b4728ff305"}]}} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:33:49 user devstack@n-api.service[61473]: DEBUG nova.network.neutron [None req-ef700068-fd38-4229-9f8a-64a65a7da8f5 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] validate_networks() for [('db8bad9b-2d27-4871-8f72-c9b4728ff305', None, None, None, None, None)] {{(pid=61473) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 16:33:49 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell1:SELECT=4 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:33:50 user devstack@n-api.service[61473]: DEBUG nova.virt.hardware [None req-ef700068-fd38-4229-9f8a-64a65a7da8f5 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Flavor limits 0:0:0 {{(pid=61473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 16:33:50 user devstack@n-api.service[61473]: DEBUG nova.virt.hardware [None req-ef700068-fd38-4229-9f8a-64a65a7da8f5 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Image limits 0:0:0 {{(pid=61473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 16:33:50 user devstack@n-api.service[61473]: DEBUG nova.virt.hardware [None req-ef700068-fd38-4229-9f8a-64a65a7da8f5 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Flavor pref 0:0:0 {{(pid=61473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 16:33:50 user devstack@n-api.service[61473]: DEBUG nova.virt.hardware [None req-ef700068-fd38-4229-9f8a-64a65a7da8f5 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Image pref 0:0:0 {{(pid=61473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 16:33:50 user devstack@n-api.service[61473]: DEBUG nova.virt.hardware [None req-ef700068-fd38-4229-9f8a-64a65a7da8f5 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 16:33:50 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-ef700068-fd38-4229-9f8a-64a65a7da8f5 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:33:50 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-ef700068-fd38-4229-9f8a-64a65a7da8f5 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:33:50 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-ef700068-fd38-4229-9f8a-64a65a7da8f5 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:33:50 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-ef700068-fd38-4229-9f8a-64a65a7da8f5 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:33:50 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-ef700068-fd38-4229-9f8a-64a65a7da8f5 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:33:50 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-ef700068-fd38-4229-9f8a-64a65a7da8f5 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:33:50 user devstack@n-api.service[61473]: DEBUG nova.quota [None req-ef700068-fd38-4229-9f8a-64a65a7da8f5 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Getting quotas for project 3a63d3a9c6774bba8f276846597e24ca. Resources: {'instances', 'ram', 'cores'} {{(pid=61473) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 16:33:50 user devstack@n-api.service[61473]: DEBUG nova.quota [None req-ef700068-fd38-4229-9f8a-64a65a7da8f5 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Getting quotas for user 25d089267c6a4a1391bb89ae66b49da7 and project 3a63d3a9c6774bba8f276846597e24ca. Resources: {'instances', 'ram', 'cores'} {{(pid=61473) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 16:33:50 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-ef700068-fd38-4229-9f8a-64a65a7da8f5 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Going to run 1 instances... {{(pid=61473) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 16:33:50 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-ef700068-fd38-4229-9f8a-64a65a7da8f5 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] [instance: 11eee783-802b-438a-bc43-a59b6c33ce63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ab56c4b1-0117-43b0-84b6-28d06a23f182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61473) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 16:33:50 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-ef700068-fd38-4229-9f8a-64a65a7da8f5 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.201458 Apr 19 16:33:50 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 30/86] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 16:33:49 2023] POST /compute/v2.1/servers => generated 378 bytes in 1205 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 16:33:50 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-d3565852-18fa-4a63-b433-30ea7d2c0521 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:33:50 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-d3565852-18fa-4a63-b433-30ea7d2c0521 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] [instance: 11eee783-802b-438a-bc43-a59b6c33ce63] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:33:50 user devstack@n-api.service[61472]: DEBUG nova.policy [None req-d3565852-18fa-4a63-b433-30ea7d2c0521 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d089267c6a4a1391bb89ae66b49da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a63d3a9c6774bba8f276846597e24ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61472) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:33:50 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-d3565852-18fa-4a63-b433-30ea7d2c0521 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11eee783-802b-438a-bc43-a59b6c33ce63" status: 200 len: 1211 microversion: 2.1 time: 0.089837 Apr 19 16:33:50 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 28/87] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:33:50 2023] GET /compute/v2.1/servers/11eee783-802b-438a-bc43-a59b6c33ce63 => generated 1211 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:33:51 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-9b79d1ee-e38a-43ea-83c1-d09f33f3345b tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:33:51 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-9b79d1ee-e38a-43ea-83c1-d09f33f3345b tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] [instance: fbf430be-25fa-4e08-8d5b-08c95b10172a] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:33:51 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-9b79d1ee-e38a-43ea-83c1-d09f33f3345b tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:33:51 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-9b79d1ee-e38a-43ea-83c1-d09f33f3345b tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:33:51 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-9b79d1ee-e38a-43ea-83c1-d09f33f3345b tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:33:51 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-9b79d1ee-e38a-43ea-83c1-d09f33f3345b tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:33:51 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-9b79d1ee-e38a-43ea-83c1-d09f33f3345b tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:33:51 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-9b79d1ee-e38a-43ea-83c1-d09f33f3345b tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:33:52 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-9b79d1ee-e38a-43ea-83c1-d09f33f3345b tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2563be52f624ceab060942e8bfcedef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ceccc36de46f780e55a02f25782f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:33:52 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-9b79d1ee-e38a-43ea-83c1-d09f33f3345b tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fbf430be-25fa-4e08-8d5b-08c95b10172a" status: 200 len: 1545 microversion: 2.1 time: 0.305334 Apr 19 16:33:52 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 30/88] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:33:51 2023] GET /compute/v2.1/servers/fbf430be-25fa-4e08-8d5b-08c95b10172a => generated 1545 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:33:53 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-0303eb35-d8a4-4b13-8d5c-f0b133597ba0 req-1b813940-11f0-43b9-8a5e-c3bd4a970807 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01b50b56-31d2-4143-8585-63713d1bc7e9", "tag": "cde3d9e4-9e22-4584-8b11-2a1a9d225fcb"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:33:53 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-0303eb35-d8a4-4b13-8d5c-f0b133597ba0 req-1b813940-11f0-43b9-8a5e-c3bd4a970807 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:33:53 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-0303eb35-d8a4-4b13-8d5c-f0b133597ba0 req-1b813940-11f0-43b9-8a5e-c3bd4a970807 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:33:53 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-0303eb35-d8a4-4b13-8d5c-f0b133597ba0 req-1b813940-11f0-43b9-8a5e-c3bd4a970807 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:33:53 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-0303eb35-d8a4-4b13-8d5c-f0b133597ba0 req-1b813940-11f0-43b9-8a5e-c3bd4a970807 service nova] Creating event network-changed:cde3d9e4-9e22-4584-8b11-2a1a9d225fcb for instance 01b50b56-31d2-4143-8585-63713d1bc7e9 on user Apr 19 16:33:53 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-0303eb35-d8a4-4b13-8d5c-f0b133597ba0 req-1b813940-11f0-43b9-8a5e-c3bd4a970807 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036543 Apr 19 16:33:53 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 31/89] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:33:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:33:54 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [req-6ee5e960-0b45-4bcd-956c-da6d990bbbaf req-aa32e916-9fd9-4827-b908-92882a9b84e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11eee783-802b-438a-bc43-a59b6c33ce63", "tag": "3ad47771-69d8-4038-985b-3466ee7216bb"}]} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:33:54 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-6ee5e960-0b45-4bcd-956c-da6d990bbbaf req-aa32e916-9fd9-4827-b908-92882a9b84e1 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:33:54 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-6ee5e960-0b45-4bcd-956c-da6d990bbbaf req-aa32e916-9fd9-4827-b908-92882a9b84e1 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:33:54 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-6ee5e960-0b45-4bcd-956c-da6d990bbbaf req-aa32e916-9fd9-4827-b908-92882a9b84e1 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:33:54 user devstack@n-api.service[61472]: INFO nova.api.openstack.compute.server_external_events [req-6ee5e960-0b45-4bcd-956c-da6d990bbbaf req-aa32e916-9fd9-4827-b908-92882a9b84e1 service nova] Creating event network-changed:3ad47771-69d8-4038-985b-3466ee7216bb for instance 11eee783-802b-438a-bc43-a59b6c33ce63 on user Apr 19 16:33:54 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [req-6ee5e960-0b45-4bcd-956c-da6d990bbbaf req-aa32e916-9fd9-4827-b908-92882a9b84e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028050 Apr 19 16:33:54 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 29/90] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:33:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:33:56 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [req-079763db-7cd8-4e91-8de3-8295adc88ad6 req-48041be3-dab5-4c52-87ea-432b66c8cf0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01b50b56-31d2-4143-8585-63713d1bc7e9", "name": "network-vif-plugged", "status": "completed", "tag": "cde3d9e4-9e22-4584-8b11-2a1a9d225fcb"}]} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:33:56 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=5 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:33:56 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-079763db-7cd8-4e91-8de3-8295adc88ad6 req-48041be3-dab5-4c52-87ea-432b66c8cf0d service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:33:56 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-079763db-7cd8-4e91-8de3-8295adc88ad6 req-48041be3-dab5-4c52-87ea-432b66c8cf0d service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:33:56 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-079763db-7cd8-4e91-8de3-8295adc88ad6 req-48041be3-dab5-4c52-87ea-432b66c8cf0d service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:33:56 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-079763db-7cd8-4e91-8de3-8295adc88ad6 req-48041be3-dab5-4c52-87ea-432b66c8cf0d service nova] Creating event network-vif-plugged:cde3d9e4-9e22-4584-8b11-2a1a9d225fcb for instance 01b50b56-31d2-4143-8585-63713d1bc7e9 on user Apr 19 16:33:56 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [req-079763db-7cd8-4e91-8de3-8295adc88ad6 req-48041be3-dab5-4c52-87ea-432b66c8cf0d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157314 Apr 19 16:33:56 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 31/91] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:33:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:33:58 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-1138ad42-2837-4a5a-b6c1-84ef9203c96b req-77c5dc4b-9632-4a8b-98d8-fd6ec93fe02a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01b50b56-31d2-4143-8585-63713d1bc7e9", "name": "network-vif-plugged", "status": "completed", "tag": "cde3d9e4-9e22-4584-8b11-2a1a9d225fcb"}, {"server_uuid": "11eee783-802b-438a-bc43-a59b6c33ce63", "name": "network-vif-plugged", "status": "completed", "tag": "3ad47771-69d8-4038-985b-3466ee7216bb"}, {"server_uuid": "11eee783-802b-438a-bc43-a59b6c33ce63", "name": "network-vif-plugged", "status": "completed", "tag": "3ad47771-69d8-4038-985b-3466ee7216bb"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:33:58 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-1138ad42-2837-4a5a-b6c1-84ef9203c96b req-77c5dc4b-9632-4a8b-98d8-fd6ec93fe02a service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:33:58 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-1138ad42-2837-4a5a-b6c1-84ef9203c96b req-77c5dc4b-9632-4a8b-98d8-fd6ec93fe02a service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:33:58 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-1138ad42-2837-4a5a-b6c1-84ef9203c96b req-77c5dc4b-9632-4a8b-98d8-fd6ec93fe02a service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:33:58 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-1138ad42-2837-4a5a-b6c1-84ef9203c96b req-77c5dc4b-9632-4a8b-98d8-fd6ec93fe02a service nova] Creating event network-vif-plugged:cde3d9e4-9e22-4584-8b11-2a1a9d225fcb for instance 01b50b56-31d2-4143-8585-63713d1bc7e9 on user Apr 19 16:33:58 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-1138ad42-2837-4a5a-b6c1-84ef9203c96b req-77c5dc4b-9632-4a8b-98d8-fd6ec93fe02a service nova] Creating event network-vif-plugged:3ad47771-69d8-4038-985b-3466ee7216bb for instance 11eee783-802b-438a-bc43-a59b6c33ce63 on user Apr 19 16:33:58 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-1138ad42-2837-4a5a-b6c1-84ef9203c96b req-77c5dc4b-9632-4a8b-98d8-fd6ec93fe02a service nova] Creating event network-vif-plugged:3ad47771-69d8-4038-985b-3466ee7216bb for instance 11eee783-802b-438a-bc43-a59b6c33ce63 on user Apr 19 16:33:58 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-1138ad42-2837-4a5a-b6c1-84ef9203c96b req-77c5dc4b-9632-4a8b-98d8-fd6ec93fe02a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.037142 Apr 19 16:33:58 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 32/92] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:33:58 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:34:16 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell0:SELECT=2 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:34:16 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell0:SELECT=8 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:34:16 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=6 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:34:16 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell1:SELECT=16 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:34:16 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-6dfe8280-9989-40da-8a15-afacd445ddac tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:34:16 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-6dfe8280-9989-40da-8a15-afacd445ddac tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] [instance: ded3b7ea-2e6a-4aa9-b658-424a8bea42bc] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:34:16 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-6dfe8280-9989-40da-8a15-afacd445ddac tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:34:16 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-6dfe8280-9989-40da-8a15-afacd445ddac tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:34:16 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-6dfe8280-9989-40da-8a15-afacd445ddac tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:34:16 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-6dfe8280-9989-40da-8a15-afacd445ddac tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:34:16 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-6dfe8280-9989-40da-8a15-afacd445ddac tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:34:16 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-6dfe8280-9989-40da-8a15-afacd445ddac tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:34:16 user devstack@n-api.service[61472]: DEBUG nova.policy [None req-6dfe8280-9989-40da-8a15-afacd445ddac tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be99c3ba0554acda7b418f66a31c943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee32e72a51414422bfad5875f32b1515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61472) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:34:16 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-6dfe8280-9989-40da-8a15-afacd445ddac tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ded3b7ea-2e6a-4aa9-b658-424a8bea42bc" status: 200 len: 1545 microversion: 2.1 time: 0.227983 Apr 19 16:34:16 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 30/93] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:34:16 2023] GET /compute/v2.1/servers/ded3b7ea-2e6a-4aa9-b658-424a8bea42bc => generated 1545 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:34:18 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell0:SELECT=10 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:34:18 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell1:SELECT=8 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:34:18 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_api:SELECT=1 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:34:18 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-5558afbe-783a-43dd-bb12-2379543a8787 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:34:18 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-5558afbe-783a-43dd-bb12-2379543a8787 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] [instance: f9885d3d-e74d-4250-b096-0df5dde6f3cd] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:34:18 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-5558afbe-783a-43dd-bb12-2379543a8787 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:34:18 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-5558afbe-783a-43dd-bb12-2379543a8787 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:34:18 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-5558afbe-783a-43dd-bb12-2379543a8787 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:34:18 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-5558afbe-783a-43dd-bb12-2379543a8787 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:34:18 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-5558afbe-783a-43dd-bb12-2379543a8787 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:34:18 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-5558afbe-783a-43dd-bb12-2379543a8787 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:34:19 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-5558afbe-783a-43dd-bb12-2379543a8787 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467f608512c4451fb461a5c495bbc9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbe4ed80f09473e98aad29199588a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:34:19 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-5558afbe-783a-43dd-bb12-2379543a8787 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f9885d3d-e74d-4250-b096-0df5dde6f3cd" status: 200 len: 1545 microversion: 2.1 time: 0.219492 Apr 19 16:34:19 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 32/94] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:34:18 2023] GET /compute/v2.1/servers/f9885d3d-e74d-4250-b096-0df5dde6f3cd => generated 1545 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:34:39 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-6404f712-f776-4f79-a535-fd868398b702 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:34:39 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-6404f712-f776-4f79-a535-fd868398b702 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] [instance: 01b50b56-31d2-4143-8585-63713d1bc7e9] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:34:39 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell0:SELECT=2 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:34:39 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell0:SELECT=6 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:34:39 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:34:39 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell1:SELECT=6 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:34:39 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-6404f712-f776-4f79-a535-fd868398b702 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:34:39 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-6404f712-f776-4f79-a535-fd868398b702 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:34:39 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-6404f712-f776-4f79-a535-fd868398b702 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:34:39 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-6404f712-f776-4f79-a535-fd868398b702 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:34:39 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-6404f712-f776-4f79-a535-fd868398b702 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:34:39 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-6404f712-f776-4f79-a535-fd868398b702 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:34:39 user devstack@n-api.service[61473]: DEBUG nova.policy [None req-6404f712-f776-4f79-a535-fd868398b702 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34afcb1cb8d2433b9564e5b62b45fe86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29a717b7f334af5a35d9e86c3d4b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61473) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:34:39 user devstack@n-api.service[61473]: DEBUG nova.policy [None req-6404f712-f776-4f79-a535-fd868398b702 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34afcb1cb8d2433b9564e5b62b45fe86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29a717b7f334af5a35d9e86c3d4b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61473) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:34:39 user devstack@n-api.service[61473]: DEBUG nova.policy [None req-6404f712-f776-4f79-a535-fd868398b702 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34afcb1cb8d2433b9564e5b62b45fe86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29a717b7f334af5a35d9e86c3d4b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61473) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:34:39 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-6404f712-f776-4f79-a535-fd868398b702 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/01b50b56-31d2-4143-8585-63713d1bc7e9" status: 200 len: 1585 microversion: 2.20 time: 0.585845 Apr 19 16:34:39 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 33/95] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 16:34:39 2023] GET /compute/v2.1/servers/01b50b56-31d2-4143-8585-63713d1bc7e9 => generated 1585 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 16:34:40 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-0a0725dc-7be1-4a49-be6b-f85970e6b712 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:34:40 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-0a0725dc-7be1-4a49-be6b-f85970e6b712 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] [instance: 11eee783-802b-438a-bc43-a59b6c33ce63] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:34:40 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_api:SELECT=2 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:34:40 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell1:SELECT=6 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:34:40 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-0a0725dc-7be1-4a49-be6b-f85970e6b712 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:34:40 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-0a0725dc-7be1-4a49-be6b-f85970e6b712 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:34:40 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-0a0725dc-7be1-4a49-be6b-f85970e6b712 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:34:40 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-0a0725dc-7be1-4a49-be6b-f85970e6b712 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:34:40 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-0a0725dc-7be1-4a49-be6b-f85970e6b712 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:34:40 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-0a0725dc-7be1-4a49-be6b-f85970e6b712 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:34:41 user devstack@n-api.service[61472]: DEBUG nova.policy [None req-0a0725dc-7be1-4a49-be6b-f85970e6b712 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d089267c6a4a1391bb89ae66b49da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a63d3a9c6774bba8f276846597e24ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61472) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:34:41 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-0a0725dc-7be1-4a49-be6b-f85970e6b712 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11eee783-802b-438a-bc43-a59b6c33ce63" status: 200 len: 1494 microversion: 2.1 time: 0.222511 Apr 19 16:34:41 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 31/96] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:34:40 2023] GET /compute/v2.1/servers/11eee783-802b-438a-bc43-a59b6c33ce63 => generated 1494 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:34:47 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-5b5253e9-47f0-4647-9a9c-a634fe1f52b6 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:34:47 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-5b5253e9-47f0-4647-9a9c-a634fe1f52b6 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] [instance: 90c8afd3-6bbe-4c19-a54e-d15e668764aa] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:34:47 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_api:SELECT=2 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:34:47 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell1:SELECT=6 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:34:47 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-5b5253e9-47f0-4647-9a9c-a634fe1f52b6 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:34:47 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-5b5253e9-47f0-4647-9a9c-a634fe1f52b6 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:34:47 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-5b5253e9-47f0-4647-9a9c-a634fe1f52b6 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:34:47 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-5b5253e9-47f0-4647-9a9c-a634fe1f52b6 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:34:47 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-5b5253e9-47f0-4647-9a9c-a634fe1f52b6 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:34:47 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-5b5253e9-47f0-4647-9a9c-a634fe1f52b6 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:34:47 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-5b5253e9-47f0-4647-9a9c-a634fe1f52b6 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] [instance: 90c8afd3-6bbe-4c19-a54e-d15e668764aa] Going to try to terminate instance {{(pid=61471) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 16:34:47 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-5b5253e9-47f0-4647-9a9c-a634fe1f52b6 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/90c8afd3-6bbe-4c19-a54e-d15e668764aa" status: 204 len: 0 microversion: 2.1 time: 0.235032 Apr 19 16:34:47 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 33/97] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 16:34:47 2023] DELETE /compute/v2.1/servers/90c8afd3-6bbe-4c19-a54e-d15e668764aa => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 16:34:47 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-959afb07-1785-4d47-97b5-189e3b116f56 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:34:47 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-959afb07-1785-4d47-97b5-189e3b116f56 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] [instance: 90c8afd3-6bbe-4c19-a54e-d15e668764aa] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:34:47 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-959afb07-1785-4d47-97b5-189e3b116f56 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:34:47 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-959afb07-1785-4d47-97b5-189e3b116f56 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:34:47 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-959afb07-1785-4d47-97b5-189e3b116f56 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:34:47 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-959afb07-1785-4d47-97b5-189e3b116f56 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:34:47 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-959afb07-1785-4d47-97b5-189e3b116f56 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:34:47 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-959afb07-1785-4d47-97b5-189e3b116f56 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:34:47 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [req-832252c7-cd23-4b03-8795-52b46cbe23ef req-1fa88fb6-0aff-4370-a924-fde872cf7fd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90c8afd3-6bbe-4c19-a54e-d15e668764aa", "name": "network-vif-unplugged", "status": "completed", "tag": "a094da8b-d536-43be-b68f-a2d964296caa"}]} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:34:47 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-832252c7-cd23-4b03-8795-52b46cbe23ef req-1fa88fb6-0aff-4370-a924-fde872cf7fd6 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:34:47 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-832252c7-cd23-4b03-8795-52b46cbe23ef req-1fa88fb6-0aff-4370-a924-fde872cf7fd6 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:34:47 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-832252c7-cd23-4b03-8795-52b46cbe23ef req-1fa88fb6-0aff-4370-a924-fde872cf7fd6 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:34:47 user devstack@n-api.service[61472]: INFO nova.api.openstack.compute.server_external_events [req-832252c7-cd23-4b03-8795-52b46cbe23ef req-1fa88fb6-0aff-4370-a924-fde872cf7fd6 service nova] Creating event network-vif-unplugged:a094da8b-d536-43be-b68f-a2d964296caa for instance 90c8afd3-6bbe-4c19-a54e-d15e668764aa on user Apr 19 16:34:47 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [req-832252c7-cd23-4b03-8795-52b46cbe23ef req-1fa88fb6-0aff-4370-a924-fde872cf7fd6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031620 Apr 19 16:34:47 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 32/98] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:34:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:34:47 user devstack@n-api.service[61473]: DEBUG nova.policy [None req-959afb07-1785-4d47-97b5-189e3b116f56 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4fa81c86f045dba9b620bc6ac35684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fdc184adf4be795f5e3b1bfb170fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61473) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:34:47 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-959afb07-1785-4d47-97b5-189e3b116f56 tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] 10.0.0.210 "GET /compute/v2.1/servers/90c8afd3-6bbe-4c19-a54e-d15e668764aa" status: 200 len: 1495 microversion: 2.1 time: 0.257040 Apr 19 16:34:47 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 34/99] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:34:47 2023] GET /compute/v2.1/servers/90c8afd3-6bbe-4c19-a54e-d15e668764aa => generated 1495 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:34:49 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [req-6efdb80e-ea0c-46c8-b756-96b01c1559d3 req-24befc52-805a-4cda-9637-c6778cc7f0c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90c8afd3-6bbe-4c19-a54e-d15e668764aa", "name": "network-vif-plugged", "status": "completed", "tag": "a094da8b-d536-43be-b68f-a2d964296caa"}, {"server_uuid": "90c8afd3-6bbe-4c19-a54e-d15e668764aa", "name": "network-vif-plugged", "status": "completed", "tag": "a094da8b-d536-43be-b68f-a2d964296caa"}, {"server_uuid": "90c8afd3-6bbe-4c19-a54e-d15e668764aa", "name": "network-vif-plugged", "status": "completed", "tag": "a094da8b-d536-43be-b68f-a2d964296caa"}, {"server_uuid": "90c8afd3-6bbe-4c19-a54e-d15e668764aa", "name": "network-vif-deleted", "tag": "a094da8b-d536-43be-b68f-a2d964296caa"}]} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:34:49 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-6efdb80e-ea0c-46c8-b756-96b01c1559d3 req-24befc52-805a-4cda-9637-c6778cc7f0c8 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:34:49 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-6efdb80e-ea0c-46c8-b756-96b01c1559d3 req-24befc52-805a-4cda-9637-c6778cc7f0c8 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:34:49 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-6efdb80e-ea0c-46c8-b756-96b01c1559d3 req-24befc52-805a-4cda-9637-c6778cc7f0c8 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:34:49 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-6efdb80e-ea0c-46c8-b756-96b01c1559d3 req-24befc52-805a-4cda-9637-c6778cc7f0c8 service nova] Creating event network-vif-plugged:a094da8b-d536-43be-b68f-a2d964296caa for instance 90c8afd3-6bbe-4c19-a54e-d15e668764aa on user Apr 19 16:34:49 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-6efdb80e-ea0c-46c8-b756-96b01c1559d3 req-24befc52-805a-4cda-9637-c6778cc7f0c8 service nova] Creating event network-vif-plugged:a094da8b-d536-43be-b68f-a2d964296caa for instance 90c8afd3-6bbe-4c19-a54e-d15e668764aa on user Apr 19 16:34:49 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-6efdb80e-ea0c-46c8-b756-96b01c1559d3 req-24befc52-805a-4cda-9637-c6778cc7f0c8 service nova] Creating event network-vif-plugged:a094da8b-d536-43be-b68f-a2d964296caa for instance 90c8afd3-6bbe-4c19-a54e-d15e668764aa on user Apr 19 16:34:49 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-6efdb80e-ea0c-46c8-b756-96b01c1559d3 req-24befc52-805a-4cda-9637-c6778cc7f0c8 service nova] Creating event network-vif-deleted:a094da8b-d536-43be-b68f-a2d964296caa for instance 90c8afd3-6bbe-4c19-a54e-d15e668764aa on user Apr 19 16:34:49 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [req-6efdb80e-ea0c-46c8-b756-96b01c1559d3 req-24befc52-805a-4cda-9637-c6778cc7f0c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.043222 Apr 19 16:34:49 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 34/100] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:34:49 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:34:52 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-e008379e-8539-496a-a08a-427c685e9511 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:34:52 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-e008379e-8539-496a-a08a-427c685e9511 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] [instance: fbf430be-25fa-4e08-8d5b-08c95b10172a] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:34:52 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-e008379e-8539-496a-a08a-427c685e9511 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:34:52 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-e008379e-8539-496a-a08a-427c685e9511 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:34:52 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-e008379e-8539-496a-a08a-427c685e9511 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:34:52 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-e008379e-8539-496a-a08a-427c685e9511 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:34:52 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-e008379e-8539-496a-a08a-427c685e9511 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:34:52 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-e008379e-8539-496a-a08a-427c685e9511 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:34:52 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-e008379e-8539-496a-a08a-427c685e9511 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fbf430be-25fa-4e08-8d5b-08c95b10172a/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.194631 Apr 19 16:34:52 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 33/101] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 16:34:52 2023] GET /compute/v2.1/servers/fbf430be-25fa-4e08-8d5b-08c95b10172a/os-interface => generated 283 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:34:53 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-c72581c0-0bc5-4d15-bcab-e3d56c2eef5d req-ab3c9280-2a92-4126-a5e7-036150eb0e03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbf430be-25fa-4e08-8d5b-08c95b10172a", "tag": "ba5a5bcd-58df-4bf9-b39e-3a575b314fec"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:34:53 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-c72581c0-0bc5-4d15-bcab-e3d56c2eef5d req-ab3c9280-2a92-4126-a5e7-036150eb0e03 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:34:53 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-c72581c0-0bc5-4d15-bcab-e3d56c2eef5d req-ab3c9280-2a92-4126-a5e7-036150eb0e03 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:34:53 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-c72581c0-0bc5-4d15-bcab-e3d56c2eef5d req-ab3c9280-2a92-4126-a5e7-036150eb0e03 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:34:53 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-c72581c0-0bc5-4d15-bcab-e3d56c2eef5d req-ab3c9280-2a92-4126-a5e7-036150eb0e03 service nova] Creating event network-changed:ba5a5bcd-58df-4bf9-b39e-3a575b314fec for instance fbf430be-25fa-4e08-8d5b-08c95b10172a on user Apr 19 16:34:53 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-c72581c0-0bc5-4d15-bcab-e3d56c2eef5d req-ab3c9280-2a92-4126-a5e7-036150eb0e03 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031285 Apr 19 16:34:53 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 35/102] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:34:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:34:53 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-26b5e772-229f-4854-b2b8-86033d6abc9d tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:34:53 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-26b5e772-229f-4854-b2b8-86033d6abc9d tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] [instance: fbf430be-25fa-4e08-8d5b-08c95b10172a] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:34:53 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-26b5e772-229f-4854-b2b8-86033d6abc9d tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:34:53 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-26b5e772-229f-4854-b2b8-86033d6abc9d tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:34:53 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-26b5e772-229f-4854-b2b8-86033d6abc9d tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:34:53 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-26b5e772-229f-4854-b2b8-86033d6abc9d tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:34:53 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-26b5e772-229f-4854-b2b8-86033d6abc9d tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:34:53 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-26b5e772-229f-4854-b2b8-86033d6abc9d tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:34:53 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-26b5e772-229f-4854-b2b8-86033d6abc9d tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fbf430be-25fa-4e08-8d5b-08c95b10172a/ips" status: 200 len: 109 microversion: 2.1 time: 0.036861 Apr 19 16:34:53 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 35/103] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 19 16:34:53 2023] GET /compute/v2.1/servers/fbf430be-25fa-4e08-8d5b-08c95b10172a/ips => generated 109 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:34:55 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-5cd36341-7d78-4098-8362-65f6a4696508 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:34:55 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-5cd36341-7d78-4098-8362-65f6a4696508 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] [instance: fbf430be-25fa-4e08-8d5b-08c95b10172a] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:34:55 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-5cd36341-7d78-4098-8362-65f6a4696508 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:34:55 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-5cd36341-7d78-4098-8362-65f6a4696508 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:34:55 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-5cd36341-7d78-4098-8362-65f6a4696508 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:34:55 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-5cd36341-7d78-4098-8362-65f6a4696508 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:34:55 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-5cd36341-7d78-4098-8362-65f6a4696508 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:34:55 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-5cd36341-7d78-4098-8362-65f6a4696508 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:34:55 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-5cd36341-7d78-4098-8362-65f6a4696508 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] [instance: fbf430be-25fa-4e08-8d5b-08c95b10172a] Going to try to terminate instance {{(pid=61472) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 16:34:55 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-5cd36341-7d78-4098-8362-65f6a4696508 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fbf430be-25fa-4e08-8d5b-08c95b10172a" status: 204 len: 0 microversion: 2.1 time: 0.226881 Apr 19 16:34:55 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 34/104] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 16:34:55 2023] DELETE /compute/v2.1/servers/fbf430be-25fa-4e08-8d5b-08c95b10172a => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 16:34:55 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-1fc10a31-1dee-40ce-b339-8205bfd1912e tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:34:55 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-1fc10a31-1dee-40ce-b339-8205bfd1912e tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] [instance: fbf430be-25fa-4e08-8d5b-08c95b10172a] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:34:55 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-1fc10a31-1dee-40ce-b339-8205bfd1912e tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:34:55 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-1fc10a31-1dee-40ce-b339-8205bfd1912e tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:34:55 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-1fc10a31-1dee-40ce-b339-8205bfd1912e tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:34:55 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-1fc10a31-1dee-40ce-b339-8205bfd1912e tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:34:55 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-1fc10a31-1dee-40ce-b339-8205bfd1912e tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:34:55 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-1fc10a31-1dee-40ce-b339-8205bfd1912e tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:34:55 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [req-2fe3e178-ca0c-496d-8540-6383857fd664 req-e0bc4d6f-7cd2-4738-aff5-a93fb713de43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbf430be-25fa-4e08-8d5b-08c95b10172a", "name": "network-vif-unplugged", "status": "completed", "tag": "ba5a5bcd-58df-4bf9-b39e-3a575b314fec"}]} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:34:55 user devstack@n-api.service[61473]: DEBUG nova.policy [None req-1fc10a31-1dee-40ce-b339-8205bfd1912e tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2563be52f624ceab060942e8bfcedef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ceccc36de46f780e55a02f25782f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61473) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:34:55 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-2fe3e178-ca0c-496d-8540-6383857fd664 req-e0bc4d6f-7cd2-4738-aff5-a93fb713de43 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:34:55 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-2fe3e178-ca0c-496d-8540-6383857fd664 req-e0bc4d6f-7cd2-4738-aff5-a93fb713de43 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:34:55 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-2fe3e178-ca0c-496d-8540-6383857fd664 req-e0bc4d6f-7cd2-4738-aff5-a93fb713de43 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:34:55 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-1fc10a31-1dee-40ce-b339-8205bfd1912e tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fbf430be-25fa-4e08-8d5b-08c95b10172a" status: 200 len: 1669 microversion: 2.1 time: 0.242698 Apr 19 16:34:55 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 36/105] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:34:55 2023] GET /compute/v2.1/servers/fbf430be-25fa-4e08-8d5b-08c95b10172a => generated 1669 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:34:55 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-2fe3e178-ca0c-496d-8540-6383857fd664 req-e0bc4d6f-7cd2-4738-aff5-a93fb713de43 service nova] Creating event network-vif-unplugged:ba5a5bcd-58df-4bf9-b39e-3a575b314fec for instance fbf430be-25fa-4e08-8d5b-08c95b10172a on user Apr 19 16:34:55 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [req-2fe3e178-ca0c-496d-8540-6383857fd664 req-e0bc4d6f-7cd2-4738-aff5-a93fb713de43 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028424 Apr 19 16:34:55 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 36/106] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:34:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 16:34:57 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [req-a90222e8-9a11-42cc-9df8-2242fdbf5205 req-6e40a732-2b42-4041-8b2d-00d3d7ebb885 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbf430be-25fa-4e08-8d5b-08c95b10172a", "name": "network-vif-deleted", "tag": "ba5a5bcd-58df-4bf9-b39e-3a575b314fec"}]} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:34:57 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-a90222e8-9a11-42cc-9df8-2242fdbf5205 req-6e40a732-2b42-4041-8b2d-00d3d7ebb885 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:34:57 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-a90222e8-9a11-42cc-9df8-2242fdbf5205 req-6e40a732-2b42-4041-8b2d-00d3d7ebb885 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:34:57 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-a90222e8-9a11-42cc-9df8-2242fdbf5205 req-6e40a732-2b42-4041-8b2d-00d3d7ebb885 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:34:57 user devstack@n-api.service[61472]: INFO nova.api.openstack.compute.server_external_events [req-a90222e8-9a11-42cc-9df8-2242fdbf5205 req-6e40a732-2b42-4041-8b2d-00d3d7ebb885 service nova] Creating event network-vif-deleted:ba5a5bcd-58df-4bf9-b39e-3a575b314fec for instance fbf430be-25fa-4e08-8d5b-08c95b10172a on user Apr 19 16:34:57 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [req-a90222e8-9a11-42cc-9df8-2242fdbf5205 req-6e40a732-2b42-4041-8b2d-00d3d7ebb885 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029236 Apr 19 16:34:57 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 35/107] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:34:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:34:57 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-fe564fbc-a431-4ee4-ae9b-161d37674e32 req-5ea63d55-8d6e-406c-ac66-713130699efc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbf430be-25fa-4e08-8d5b-08c95b10172a", "name": "network-vif-plugged", "status": "completed", "tag": "ba5a5bcd-58df-4bf9-b39e-3a575b314fec"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:34:57 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-fe564fbc-a431-4ee4-ae9b-161d37674e32 req-5ea63d55-8d6e-406c-ac66-713130699efc service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:34:57 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-fe564fbc-a431-4ee4-ae9b-161d37674e32 req-5ea63d55-8d6e-406c-ac66-713130699efc service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:34:57 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-fe564fbc-a431-4ee4-ae9b-161d37674e32 req-5ea63d55-8d6e-406c-ac66-713130699efc service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:34:57 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-fe564fbc-a431-4ee4-ae9b-161d37674e32 req-5ea63d55-8d6e-406c-ac66-713130699efc service nova] Creating event network-vif-plugged:ba5a5bcd-58df-4bf9-b39e-3a575b314fec for instance fbf430be-25fa-4e08-8d5b-08c95b10172a on user Apr 19 16:34:57 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-fe564fbc-a431-4ee4-ae9b-161d37674e32 req-5ea63d55-8d6e-406c-ac66-713130699efc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028207 Apr 19 16:34:57 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 37/108] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:34:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:35:16 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:35:16 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:35:16 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-381b76d8-5589-477e-8974-800e5fdf327a tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:35:16 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-381b76d8-5589-477e-8974-800e5fdf327a tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] [instance: ded3b7ea-2e6a-4aa9-b658-424a8bea42bc] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:35:16 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-381b76d8-5589-477e-8974-800e5fdf327a tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:35:16 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-381b76d8-5589-477e-8974-800e5fdf327a tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:35:16 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-381b76d8-5589-477e-8974-800e5fdf327a tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:35:16 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-381b76d8-5589-477e-8974-800e5fdf327a tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:35:16 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-381b76d8-5589-477e-8974-800e5fdf327a tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:35:16 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-381b76d8-5589-477e-8974-800e5fdf327a tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:35:16 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-381b76d8-5589-477e-8974-800e5fdf327a tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ded3b7ea-2e6a-4aa9-b658-424a8bea42bc/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.162655 Apr 19 16:35:16 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 37/109] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 16:35:16 2023] GET /compute/v2.1/servers/ded3b7ea-2e6a-4aa9-b658-424a8bea42bc/os-interface => generated 283 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:35:17 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:35:17 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:35:17 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [req-9275986f-4379-4f06-a5c7-c0ee51a93223 req-ba1602b1-0736-430d-bdfc-be7ebf91c56e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ded3b7ea-2e6a-4aa9-b658-424a8bea42bc", "tag": "58b610d1-d4a8-4a99-a790-15b652fc7345"}]} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:35:17 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-9275986f-4379-4f06-a5c7-c0ee51a93223 req-ba1602b1-0736-430d-bdfc-be7ebf91c56e service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:35:17 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-9275986f-4379-4f06-a5c7-c0ee51a93223 req-ba1602b1-0736-430d-bdfc-be7ebf91c56e service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:35:17 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-9275986f-4379-4f06-a5c7-c0ee51a93223 req-ba1602b1-0736-430d-bdfc-be7ebf91c56e service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:35:17 user devstack@n-api.service[61472]: INFO nova.api.openstack.compute.server_external_events [req-9275986f-4379-4f06-a5c7-c0ee51a93223 req-ba1602b1-0736-430d-bdfc-be7ebf91c56e service nova] Creating event network-changed:58b610d1-d4a8-4a99-a790-15b652fc7345 for instance ded3b7ea-2e6a-4aa9-b658-424a8bea42bc on user Apr 19 16:35:17 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [req-9275986f-4379-4f06-a5c7-c0ee51a93223 req-ba1602b1-0736-430d-bdfc-be7ebf91c56e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039903 Apr 19 16:35:17 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 36/110] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:35:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:35:19 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_api:SELECT=10 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:35:19 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell1:SELECT=22 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:35:19 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-0349f7a6-7138-482e-8e5c-974bb3ba0769 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-224574038", "imageRef": "ab56c4b1-0117-43b0-84b6-28d06a23f182", "flavorRef": "42", "networks": [{"uuid": "6f91dcb6-4159-42d3-89a1-759cadf832a9"}]}} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:35:19 user devstack@n-api.service[61473]: DEBUG nova.network.neutron [None req-0349f7a6-7138-482e-8e5c-974bb3ba0769 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] validate_networks() for [('6f91dcb6-4159-42d3-89a1-759cadf832a9', None, None, None, None, None)] {{(pid=61473) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 16:35:19 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-8a8334ea-9eca-4b2e-bea5-1e0ab03725f7 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:35:19 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-8a8334ea-9eca-4b2e-bea5-1e0ab03725f7 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] [instance: f9885d3d-e74d-4250-b096-0df5dde6f3cd] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:35:19 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-8a8334ea-9eca-4b2e-bea5-1e0ab03725f7 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:35:19 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-8a8334ea-9eca-4b2e-bea5-1e0ab03725f7 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:35:19 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-8a8334ea-9eca-4b2e-bea5-1e0ab03725f7 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:35:19 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-8a8334ea-9eca-4b2e-bea5-1e0ab03725f7 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:35:19 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-8a8334ea-9eca-4b2e-bea5-1e0ab03725f7 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:35:19 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-8a8334ea-9eca-4b2e-bea5-1e0ab03725f7 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:35:19 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-8a8334ea-9eca-4b2e-bea5-1e0ab03725f7 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f9885d3d-e74d-4250-b096-0df5dde6f3cd/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.245287 Apr 19 16:35:19 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 38/111] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 16:35:19 2023] GET /compute/v2.1/servers/f9885d3d-e74d-4250-b096-0df5dde6f3cd/os-interface => generated 282 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:35:19 user devstack@n-api.service[61473]: DEBUG nova.virt.hardware [None req-0349f7a6-7138-482e-8e5c-974bb3ba0769 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Flavor limits 0:0:0 {{(pid=61473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 16:35:19 user devstack@n-api.service[61473]: DEBUG nova.virt.hardware [None req-0349f7a6-7138-482e-8e5c-974bb3ba0769 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Image limits 0:0:0 {{(pid=61473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 16:35:19 user devstack@n-api.service[61473]: DEBUG nova.virt.hardware [None req-0349f7a6-7138-482e-8e5c-974bb3ba0769 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Flavor pref 0:0:0 {{(pid=61473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 16:35:19 user devstack@n-api.service[61473]: DEBUG nova.virt.hardware [None req-0349f7a6-7138-482e-8e5c-974bb3ba0769 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Image pref 0:0:0 {{(pid=61473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 16:35:19 user devstack@n-api.service[61473]: DEBUG nova.virt.hardware [None req-0349f7a6-7138-482e-8e5c-974bb3ba0769 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 16:35:19 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-0349f7a6-7138-482e-8e5c-974bb3ba0769 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:35:19 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-0349f7a6-7138-482e-8e5c-974bb3ba0769 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:35:19 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-0349f7a6-7138-482e-8e5c-974bb3ba0769 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:35:19 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-0349f7a6-7138-482e-8e5c-974bb3ba0769 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:35:19 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-0349f7a6-7138-482e-8e5c-974bb3ba0769 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:35:19 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-0349f7a6-7138-482e-8e5c-974bb3ba0769 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:35:19 user devstack@n-api.service[61473]: DEBUG nova.quota [None req-0349f7a6-7138-482e-8e5c-974bb3ba0769 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Getting quotas for project ee32e72a51414422bfad5875f32b1515. Resources: {'instances', 'ram', 'cores'} {{(pid=61473) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 16:35:19 user devstack@n-api.service[61473]: DEBUG nova.quota [None req-0349f7a6-7138-482e-8e5c-974bb3ba0769 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Getting quotas for user 6be99c3ba0554acda7b418f66a31c943 and project ee32e72a51414422bfad5875f32b1515. Resources: {'instances', 'ram', 'cores'} {{(pid=61473) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 16:35:19 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-0349f7a6-7138-482e-8e5c-974bb3ba0769 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Going to run 1 instances... {{(pid=61473) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 16:35:19 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-0349f7a6-7138-482e-8e5c-974bb3ba0769 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] [instance: 131e75dc-8c64-40b1-b21b-40210f4d5425] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ab56c4b1-0117-43b0-84b6-28d06a23f182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61473) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 16:35:19 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-0349f7a6-7138-482e-8e5c-974bb3ba0769 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.664566 Apr 19 16:35:19 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 38/112] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 16:35:18 2023] POST /compute/v2.1/servers => generated 378 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 16:35:19 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-8c72b428-165d-4a34-ab19-53c925485ad5 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:35:19 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-8c72b428-165d-4a34-ab19-53c925485ad5 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] [instance: 131e75dc-8c64-40b1-b21b-40210f4d5425] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:35:19 user devstack@n-api.service[61472]: DEBUG nova.policy [None req-8c72b428-165d-4a34-ab19-53c925485ad5 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be99c3ba0554acda7b418f66a31c943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee32e72a51414422bfad5875f32b1515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61472) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:35:19 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-8c72b428-165d-4a34-ab19-53c925485ad5 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] 10.0.0.210 "GET /compute/v2.1/servers/131e75dc-8c64-40b1-b21b-40210f4d5425" status: 200 len: 1211 microversion: 2.1 time: 0.059040 Apr 19 16:35:19 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 37/113] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:35:19 2023] GET /compute/v2.1/servers/131e75dc-8c64-40b1-b21b-40210f4d5425 => generated 1211 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:35:20 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [req-c04b2def-32e5-4c57-9c32-48532ec13482 req-6e19b1a5-159c-4a48-b75e-495ad8320a90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9885d3d-e74d-4250-b096-0df5dde6f3cd", "tag": "07559239-c0f3-4b70-8f8a-d30256480e8e"}]} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:35:20 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-c04b2def-32e5-4c57-9c32-48532ec13482 req-6e19b1a5-159c-4a48-b75e-495ad8320a90 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:35:20 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-c04b2def-32e5-4c57-9c32-48532ec13482 req-6e19b1a5-159c-4a48-b75e-495ad8320a90 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:35:20 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-c04b2def-32e5-4c57-9c32-48532ec13482 req-6e19b1a5-159c-4a48-b75e-495ad8320a90 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:35:20 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-c04b2def-32e5-4c57-9c32-48532ec13482 req-6e19b1a5-159c-4a48-b75e-495ad8320a90 service nova] Creating event network-changed:07559239-c0f3-4b70-8f8a-d30256480e8e for instance f9885d3d-e74d-4250-b096-0df5dde6f3cd on user Apr 19 16:35:20 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [req-c04b2def-32e5-4c57-9c32-48532ec13482 req-6e19b1a5-159c-4a48-b75e-495ad8320a90 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.271034 Apr 19 16:35:20 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 39/114] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:35:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:35:21 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-39a4dbb5-ac0d-47c4-8538-a9b9215d6278 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:35:21 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-39a4dbb5-ac0d-47c4-8538-a9b9215d6278 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] [instance: f9885d3d-e74d-4250-b096-0df5dde6f3cd] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:35:21 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-39a4dbb5-ac0d-47c4-8538-a9b9215d6278 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:35:21 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-39a4dbb5-ac0d-47c4-8538-a9b9215d6278 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:35:21 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-39a4dbb5-ac0d-47c4-8538-a9b9215d6278 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:35:21 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-39a4dbb5-ac0d-47c4-8538-a9b9215d6278 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:35:21 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-39a4dbb5-ac0d-47c4-8538-a9b9215d6278 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:35:21 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-39a4dbb5-ac0d-47c4-8538-a9b9215d6278 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:35:21 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-39a4dbb5-ac0d-47c4-8538-a9b9215d6278 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] [instance: f9885d3d-e74d-4250-b096-0df5dde6f3cd] Going to try to terminate instance {{(pid=61473) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 16:35:21 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-39a4dbb5-ac0d-47c4-8538-a9b9215d6278 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f9885d3d-e74d-4250-b096-0df5dde6f3cd" status: 204 len: 0 microversion: 2.1 time: 0.197172 Apr 19 16:35:21 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 39/115] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 16:35:21 2023] DELETE /compute/v2.1/servers/f9885d3d-e74d-4250-b096-0df5dde6f3cd => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 16:35:21 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-dd3f3ae9-ee8b-44c4-8068-39ca85f3dbdb tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:35:21 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-dd3f3ae9-ee8b-44c4-8068-39ca85f3dbdb tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] [instance: f9885d3d-e74d-4250-b096-0df5dde6f3cd] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:35:21 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-dd3f3ae9-ee8b-44c4-8068-39ca85f3dbdb tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:35:21 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-dd3f3ae9-ee8b-44c4-8068-39ca85f3dbdb tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:35:21 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-dd3f3ae9-ee8b-44c4-8068-39ca85f3dbdb tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:35:21 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-dd3f3ae9-ee8b-44c4-8068-39ca85f3dbdb tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:35:21 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-dd3f3ae9-ee8b-44c4-8068-39ca85f3dbdb tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:35:21 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-dd3f3ae9-ee8b-44c4-8068-39ca85f3dbdb tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:35:22 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [req-577ddad5-72aa-4587-b96d-b6c3335275ab req-e126745f-ab2a-4fb7-9d62-9b63d3996059 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "131e75dc-8c64-40b1-b21b-40210f4d5425", "tag": "631b17c6-36e9-4d11-ad59-6e544f474a4c"}]} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:35:22 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-577ddad5-72aa-4587-b96d-b6c3335275ab req-e126745f-ab2a-4fb7-9d62-9b63d3996059 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:35:22 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-577ddad5-72aa-4587-b96d-b6c3335275ab req-e126745f-ab2a-4fb7-9d62-9b63d3996059 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:35:22 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-577ddad5-72aa-4587-b96d-b6c3335275ab req-e126745f-ab2a-4fb7-9d62-9b63d3996059 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:35:22 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-577ddad5-72aa-4587-b96d-b6c3335275ab req-e126745f-ab2a-4fb7-9d62-9b63d3996059 service nova] Creating event network-changed:631b17c6-36e9-4d11-ad59-6e544f474a4c for instance 131e75dc-8c64-40b1-b21b-40210f4d5425 on user Apr 19 16:35:22 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [req-577ddad5-72aa-4587-b96d-b6c3335275ab req-e126745f-ab2a-4fb7-9d62-9b63d3996059 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032294 Apr 19 16:35:22 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 40/116] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:35:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:35:22 user devstack@n-api.service[61472]: DEBUG nova.policy [None req-dd3f3ae9-ee8b-44c4-8068-39ca85f3dbdb tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467f608512c4451fb461a5c495bbc9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbe4ed80f09473e98aad29199588a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61472) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:35:22 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-dd3f3ae9-ee8b-44c4-8068-39ca85f3dbdb tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f9885d3d-e74d-4250-b096-0df5dde6f3cd" status: 200 len: 1670 microversion: 2.1 time: 0.716220 Apr 19 16:35:22 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 38/117] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:35:21 2023] GET /compute/v2.1/servers/f9885d3d-e74d-4250-b096-0df5dde6f3cd => generated 1670 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:35:23 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-09ca575d-0f47-40d5-be4c-12b3684b5f01 req-a187ae6c-1406-4278-b4ba-45bc23bde18e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9885d3d-e74d-4250-b096-0df5dde6f3cd", "name": "network-vif-deleted", "tag": "07559239-c0f3-4b70-8f8a-d30256480e8e"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:35:23 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-09ca575d-0f47-40d5-be4c-12b3684b5f01 req-a187ae6c-1406-4278-b4ba-45bc23bde18e service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:35:23 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-09ca575d-0f47-40d5-be4c-12b3684b5f01 req-a187ae6c-1406-4278-b4ba-45bc23bde18e service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:35:23 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-09ca575d-0f47-40d5-be4c-12b3684b5f01 req-a187ae6c-1406-4278-b4ba-45bc23bde18e service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:35:23 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-09ca575d-0f47-40d5-be4c-12b3684b5f01 req-a187ae6c-1406-4278-b4ba-45bc23bde18e service nova] Creating event network-vif-deleted:07559239-c0f3-4b70-8f8a-d30256480e8e for instance f9885d3d-e74d-4250-b096-0df5dde6f3cd on user Apr 19 16:35:23 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-09ca575d-0f47-40d5-be4c-12b3684b5f01 req-a187ae6c-1406-4278-b4ba-45bc23bde18e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033785 Apr 19 16:35:23 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 40/118] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:35:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:35:24 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [req-07385bdd-25a1-4c33-85ae-3cb08a40b5cf req-77d23d86-c9e1-4c34-96de-6d53afc67fd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9885d3d-e74d-4250-b096-0df5dde6f3cd", "name": "network-vif-unplugged", "status": "completed", "tag": "07559239-c0f3-4b70-8f8a-d30256480e8e"}, {"server_uuid": "f9885d3d-e74d-4250-b096-0df5dde6f3cd", "name": "network-vif-plugged", "status": "completed", "tag": "07559239-c0f3-4b70-8f8a-d30256480e8e"}]} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:35:24 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-07385bdd-25a1-4c33-85ae-3cb08a40b5cf req-77d23d86-c9e1-4c34-96de-6d53afc67fd3 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:35:24 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-07385bdd-25a1-4c33-85ae-3cb08a40b5cf req-77d23d86-c9e1-4c34-96de-6d53afc67fd3 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:35:24 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-07385bdd-25a1-4c33-85ae-3cb08a40b5cf req-77d23d86-c9e1-4c34-96de-6d53afc67fd3 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:35:24 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-07385bdd-25a1-4c33-85ae-3cb08a40b5cf req-77d23d86-c9e1-4c34-96de-6d53afc67fd3 service nova] Creating event network-vif-unplugged:07559239-c0f3-4b70-8f8a-d30256480e8e for instance f9885d3d-e74d-4250-b096-0df5dde6f3cd on user Apr 19 16:35:24 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-07385bdd-25a1-4c33-85ae-3cb08a40b5cf req-77d23d86-c9e1-4c34-96de-6d53afc67fd3 service nova] Creating event network-vif-plugged:07559239-c0f3-4b70-8f8a-d30256480e8e for instance f9885d3d-e74d-4250-b096-0df5dde6f3cd on user Apr 19 16:35:24 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [req-07385bdd-25a1-4c33-85ae-3cb08a40b5cf req-77d23d86-c9e1-4c34-96de-6d53afc67fd3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.042725 Apr 19 16:35:24 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 41/119] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:35:24 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:35:24 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [req-a6cf01a1-c80c-49f8-a4c5-a6c156b8a638 req-1709e3b4-2630-4cb2-a6f8-098978065efb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "131e75dc-8c64-40b1-b21b-40210f4d5425", "name": "network-vif-plugged", "status": "completed", "tag": "631b17c6-36e9-4d11-ad59-6e544f474a4c"}]} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:35:24 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-a6cf01a1-c80c-49f8-a4c5-a6c156b8a638 req-1709e3b4-2630-4cb2-a6f8-098978065efb service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:35:24 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-a6cf01a1-c80c-49f8-a4c5-a6c156b8a638 req-1709e3b4-2630-4cb2-a6f8-098978065efb service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:35:24 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-a6cf01a1-c80c-49f8-a4c5-a6c156b8a638 req-1709e3b4-2630-4cb2-a6f8-098978065efb service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:35:24 user devstack@n-api.service[61472]: INFO nova.api.openstack.compute.server_external_events [req-a6cf01a1-c80c-49f8-a4c5-a6c156b8a638 req-1709e3b4-2630-4cb2-a6f8-098978065efb service nova] Creating event network-vif-plugged:631b17c6-36e9-4d11-ad59-6e544f474a4c for instance 131e75dc-8c64-40b1-b21b-40210f4d5425 on user Apr 19 16:35:24 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [req-a6cf01a1-c80c-49f8-a4c5-a6c156b8a638 req-1709e3b4-2630-4cb2-a6f8-098978065efb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172305 Apr 19 16:35:24 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 39/120] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:35:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:35:26 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-058ef535-505c-408f-857d-d8669467cd97 req-a1324e5b-de95-41b5-abd2-95cb0468f230 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "131e75dc-8c64-40b1-b21b-40210f4d5425", "name": "network-vif-plugged", "status": "completed", "tag": "631b17c6-36e9-4d11-ad59-6e544f474a4c"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:35:26 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-058ef535-505c-408f-857d-d8669467cd97 req-a1324e5b-de95-41b5-abd2-95cb0468f230 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:35:26 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-058ef535-505c-408f-857d-d8669467cd97 req-a1324e5b-de95-41b5-abd2-95cb0468f230 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:35:26 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-058ef535-505c-408f-857d-d8669467cd97 req-a1324e5b-de95-41b5-abd2-95cb0468f230 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:35:26 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-058ef535-505c-408f-857d-d8669467cd97 req-a1324e5b-de95-41b5-abd2-95cb0468f230 service nova] Creating event network-vif-plugged:631b17c6-36e9-4d11-ad59-6e544f474a4c for instance 131e75dc-8c64-40b1-b21b-40210f4d5425 on user Apr 19 16:35:26 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-058ef535-505c-408f-857d-d8669467cd97 req-a1324e5b-de95-41b5-abd2-95cb0468f230 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037535 Apr 19 16:35:26 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 41/121] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:35:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:35:37 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_api:SELECT=10 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:35:37 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell1:SELECT=14 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:35:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-d5f082e8-f74f-4118-acc1-f4d43f29fefb tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:35:37 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-d5f082e8-f74f-4118-acc1-f4d43f29fefb tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] [instance: 90c8afd3-6bbe-4c19-a54e-d15e668764aa] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:35:37 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-d5f082e8-f74f-4118-acc1-f4d43f29fefb tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:35:37 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-d5f082e8-f74f-4118-acc1-f4d43f29fefb tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:35:37 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-d5f082e8-f74f-4118-acc1-f4d43f29fefb tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:35:37 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-d5f082e8-f74f-4118-acc1-f4d43f29fefb tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:35:37 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-d5f082e8-f74f-4118-acc1-f4d43f29fefb tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:35:37 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-d5f082e8-f74f-4118-acc1-f4d43f29fefb tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:35:37 user devstack@n-api.service[61471]: INFO nova.api.openstack.wsgi [None req-d5f082e8-f74f-4118-acc1-f4d43f29fefb tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] HTTP exception thrown: Instance 90c8afd3-6bbe-4c19-a54e-d15e668764aa could not be found. Apr 19 16:35:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-d5f082e8-f74f-4118-acc1-f4d43f29fefb tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Request method failure captured: Apr 19 16:35:37 user devstack@n-api.service[61471]: request: GET /compute/v2.1/servers/90c8afd3-6bbe-4c19-a54e-d15e668764aa HTTP/1.1 Apr 19 16:35:37 user devstack@n-api.service[61471]: Accept: application/json Apr 19 16:35:37 user devstack@n-api.service[61471]: Accept-Encoding: identity Apr 19 16:35:37 user devstack@n-api.service[61471]: Connection: close Apr 19 16:35:37 user devstack@n-api.service[61471]: Content-Length: 0 Apr 19 16:35:37 user devstack@n-api.service[61471]: Content-Type: application/json Apr 19 16:35:37 user devstack@n-api.service[61471]: Host: 10.0.0.210 Apr 19 16:35:37 user devstack@n-api.service[61471]: Openstack-System-Scope: None Apr 19 16:35:37 user devstack@n-api.service[61471]: User-Agent: python-urllib3/1.26.15 Apr 19 16:35:37 user devstack@n-api.service[61471]: X-Auth-Token: gAAAAABkQBe0t68Bd32XBcqQF2MBx-nerURiEodUEoVMbiNwKbSG7Sh2EXFOCVtSWm8f__x_9ZUR5gVxqkaztbfxqqN3CMYApIE4hxYuF6Ds1fo_rcvTFkOeY7s7z_8rYks1lNS48o3nRQ9Q8nMIg1YaXjejsLIAfvPOvbvkdcmcdXUfrFerxxs Apr 19 16:35:37 user devstack@n-api.service[61471]: X-Domain-Id: None Apr 19 16:35:37 user devstack@n-api.service[61471]: X-Domain-Name: None Apr 19 16:35:37 user devstack@n-api.service[61471]: X-Identity-Status: Confirmed Apr 19 16:35:37 user devstack@n-api.service[61471]: X-Is-Admin-Project: True Apr 19 16:35:37 user devstack@n-api.service[61471]: X-Project-Domain-Id: default Apr 19 16:35:37 user devstack@n-api.service[61471]: X-Project-Domain-Name: Default Apr 19 16:35:37 user devstack@n-api.service[61471]: X-Project-Id: 6d8fdc184adf4be795f5e3b1bfb170fc Apr 19 16:35:37 user devstack@n-api.service[61471]: X-Project-Name: tempest-DeleteServersTestJSON-1536645508 Apr 19 16:35:37 user devstack@n-api.service[61471]: X-Role: member,reader Apr 19 16:35:37 user devstack@n-api.service[61471]: X-Roles: member,reader Apr 19 16:35:37 user devstack@n-api.service[61471]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6d8fdc184adf4be795f5e3b1bfb170fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6d8fdc184adf4be795f5e3b1bfb170fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6d8fdc184adf4be795f5e3b1bfb170fc"}]}] Apr 19 16:35:37 user devstack@n-api.service[61471]: X-Tenant: tempest-DeleteServersTestJSON-1536645508 Apr 19 16:35:37 user devstack@n-api.service[61471]: X-Tenant-Id: 6d8fdc184adf4be795f5e3b1bfb170fc Apr 19 16:35:37 user devstack@n-api.service[61471]: X-Tenant-Name: tempest-DeleteServersTestJSON-1536645508 Apr 19 16:35:37 user devstack@n-api.service[61471]: X-User: tempest-DeleteServersTestJSON-1536645508-project-member Apr 19 16:35:37 user devstack@n-api.service[61471]: X-User-Domain-Id: default Apr 19 16:35:37 user devstack@n-api.service[61471]: X-User-Domain-Name: Default Apr 19 16:35:37 user devstack@n-api.service[61471]: X-User-Id: 9a4fa81c86f045dba9b620bc6ac35684 Apr 19 16:35:37 user devstack@n-api.service[61471]: X-User-Name: tempest-DeleteServersTestJSON-1536645508-project-member Apr 19 16:35:37 user devstack@n-api.service[61471]: method: > Apr 19 16:35:37 user devstack@n-api.service[61471]: exception: Instance 90c8afd3-6bbe-4c19-a54e-d15e668764aa could not be found. Apr 19 16:35:37 user devstack@n-api.service[61471]: action_args: {'id': '90c8afd3-6bbe-4c19-a54e-d15e668764aa'} Apr 19 16:35:37 user devstack@n-api.service[61471]: {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:35:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:35:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:35:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:35:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:35:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:35:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:35:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:35:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:35:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:35:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90c8afd3-6bbe-4c19-a54e-d15e668764aa could not be found. Apr 19 16:35:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:35:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:35:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:35:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:35:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:35:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:35:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:35:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:35:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:35:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:35:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 16:35:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 16:35:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:35:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:35:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:35:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:35:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90c8afd3-6bbe-4c19-a54e-d15e668764aa could not be found. Apr 19 16:35:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:35:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:35:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:35:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:35:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:35:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:35:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:35:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:35:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90c8afd3-6bbe-4c19-a54e-d15e668764aa could not be found. Apr 19 16:35:37 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:35:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-d5f082e8-f74f-4118-acc1-f4d43f29fefb tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] Returning 404 to user: Instance 90c8afd3-6bbe-4c19-a54e-d15e668764aa could not be found. {{(pid=61471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:35:37 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-d5f082e8-f74f-4118-acc1-f4d43f29fefb tempest-DeleteServersTestJSON-1536645508 tempest-DeleteServersTestJSON-1536645508-project-member] 10.0.0.210 "GET /compute/v2.1/servers/90c8afd3-6bbe-4c19-a54e-d15e668764aa" status: 404 len: 111 microversion: 2.1 time: 0.040430 Apr 19 16:35:37 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 42/122] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:35:37 2023] GET /compute/v2.1/servers/90c8afd3-6bbe-4c19-a54e-d15e668764aa => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 16:35:39 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell0:SELECT=2 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:35:39 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_api:SELECT=10 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:35:39 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell1:SELECT=10 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:35:39 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-0b76b4e9-9ff4-4400-b891-625b5fb161ce tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:35:39 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-0b76b4e9-9ff4-4400-b891-625b5fb161ce tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] [instance: 01b50b56-31d2-4143-8585-63713d1bc7e9] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:35:39 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-0b76b4e9-9ff4-4400-b891-625b5fb161ce tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:35:39 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-0b76b4e9-9ff4-4400-b891-625b5fb161ce tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:35:39 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-0b76b4e9-9ff4-4400-b891-625b5fb161ce tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:35:39 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-0b76b4e9-9ff4-4400-b891-625b5fb161ce tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:35:39 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-0b76b4e9-9ff4-4400-b891-625b5fb161ce tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:35:39 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-0b76b4e9-9ff4-4400-b891-625b5fb161ce tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:35:40 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-0b76b4e9-9ff4-4400-b891-625b5fb161ce tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/01b50b56-31d2-4143-8585-63713d1bc7e9/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.292622 Apr 19 16:35:40 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 40/123] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 19 16:35:39 2023] GET /compute/v2.1/servers/01b50b56-31d2-4143-8585-63713d1bc7e9/os-interface => generated 282 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 16:35:41 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-89289963-5ed0-40df-adc4-f2632249ffcc req-8d606d51-03f1-441e-a0f2-4a3e15f5b075 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01b50b56-31d2-4143-8585-63713d1bc7e9", "tag": "cde3d9e4-9e22-4584-8b11-2a1a9d225fcb"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:35:41 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell0:SELECT=2 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:35:41 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell0:SELECT=6 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:35:41 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:35:41 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:35:41 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-89289963-5ed0-40df-adc4-f2632249ffcc req-8d606d51-03f1-441e-a0f2-4a3e15f5b075 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:35:41 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-89289963-5ed0-40df-adc4-f2632249ffcc req-8d606d51-03f1-441e-a0f2-4a3e15f5b075 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:35:41 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-89289963-5ed0-40df-adc4-f2632249ffcc req-8d606d51-03f1-441e-a0f2-4a3e15f5b075 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:35:41 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-89289963-5ed0-40df-adc4-f2632249ffcc req-8d606d51-03f1-441e-a0f2-4a3e15f5b075 service nova] Creating event network-changed:cde3d9e4-9e22-4584-8b11-2a1a9d225fcb for instance 01b50b56-31d2-4143-8585-63713d1bc7e9 on user Apr 19 16:35:41 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-89289963-5ed0-40df-adc4-f2632249ffcc req-8d606d51-03f1-441e-a0f2-4a3e15f5b075 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045702 Apr 19 16:35:41 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 42/124] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:35:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:35:41 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-ad289f22-a9b8-4e4d-a266-c46d6499c89b tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:35:41 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-ad289f22-a9b8-4e4d-a266-c46d6499c89b tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] [instance: 01b50b56-31d2-4143-8585-63713d1bc7e9] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:35:41 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-ad289f22-a9b8-4e4d-a266-c46d6499c89b tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:35:41 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-ad289f22-a9b8-4e4d-a266-c46d6499c89b tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:35:41 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-ad289f22-a9b8-4e4d-a266-c46d6499c89b tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:35:41 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-ad289f22-a9b8-4e4d-a266-c46d6499c89b tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:35:41 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-ad289f22-a9b8-4e4d-a266-c46d6499c89b tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:35:41 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-ad289f22-a9b8-4e4d-a266-c46d6499c89b tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:35:41 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-46f0c1bd-e9cc-4706-ae0d-66121a806185 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-71979822", "imageRef": "ab56c4b1-0117-43b0-84b6-28d06a23f182", "flavorRef": "42", "networks": [{"uuid": "db8bad9b-2d27-4871-8f72-c9b4728ff305"}]}} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:35:41 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-ad289f22-a9b8-4e4d-a266-c46d6499c89b tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/01b50b56-31d2-4143-8585-63713d1bc7e9/ips" status: 200 len: 109 microversion: 2.20 time: 0.039092 Apr 19 16:35:41 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 43/125] 10.0.0.210 () {64 vars in 1366 bytes} [Wed Apr 19 16:35:41 2023] GET /compute/v2.1/servers/01b50b56-31d2-4143-8585-63713d1bc7e9/ips => generated 109 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 16:35:41 user devstack@n-api.service[61472]: DEBUG nova.network.neutron [None req-46f0c1bd-e9cc-4706-ae0d-66121a806185 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] validate_networks() for [('db8bad9b-2d27-4871-8f72-c9b4728ff305', None, None, None, None, None)] {{(pid=61472) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 16:35:41 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-46f0c1bd-e9cc-4706-ae0d-66121a806185 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Flavor limits 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 16:35:41 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-46f0c1bd-e9cc-4706-ae0d-66121a806185 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Image limits 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 16:35:41 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-46f0c1bd-e9cc-4706-ae0d-66121a806185 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Flavor pref 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 16:35:41 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-46f0c1bd-e9cc-4706-ae0d-66121a806185 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Image pref 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 16:35:41 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-46f0c1bd-e9cc-4706-ae0d-66121a806185 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 16:35:41 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-46f0c1bd-e9cc-4706-ae0d-66121a806185 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:35:41 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-46f0c1bd-e9cc-4706-ae0d-66121a806185 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:35:41 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-46f0c1bd-e9cc-4706-ae0d-66121a806185 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:35:41 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-46f0c1bd-e9cc-4706-ae0d-66121a806185 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:35:41 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-46f0c1bd-e9cc-4706-ae0d-66121a806185 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:35:41 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-46f0c1bd-e9cc-4706-ae0d-66121a806185 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:35:41 user devstack@n-api.service[61472]: DEBUG nova.quota [None req-46f0c1bd-e9cc-4706-ae0d-66121a806185 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Getting quotas for project 3a63d3a9c6774bba8f276846597e24ca. Resources: {'instances', 'ram', 'cores'} {{(pid=61472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 16:35:41 user devstack@n-api.service[61472]: DEBUG nova.quota [None req-46f0c1bd-e9cc-4706-ae0d-66121a806185 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Getting quotas for user 25d089267c6a4a1391bb89ae66b49da7 and project 3a63d3a9c6774bba8f276846597e24ca. Resources: {'instances', 'ram', 'cores'} {{(pid=61472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 16:35:41 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-46f0c1bd-e9cc-4706-ae0d-66121a806185 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Going to run 1 instances... {{(pid=61472) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 16:35:41 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-46f0c1bd-e9cc-4706-ae0d-66121a806185 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] [instance: 7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ab56c4b1-0117-43b0-84b6-28d06a23f182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 16:35:41 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-46f0c1bd-e9cc-4706-ae0d-66121a806185 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.549595 Apr 19 16:35:41 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 41/126] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 16:35:41 2023] POST /compute/v2.1/servers => generated 378 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 16:35:41 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-b235304f-88e0-4d94-89c0-56d8cd758956 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:35:41 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-b235304f-88e0-4d94-89c0-56d8cd758956 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] [instance: 7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:35:41 user devstack@n-api.service[61473]: DEBUG nova.policy [None req-b235304f-88e0-4d94-89c0-56d8cd758956 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d089267c6a4a1391bb89ae66b49da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a63d3a9c6774bba8f276846597e24ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61473) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:35:42 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-b235304f-88e0-4d94-89c0-56d8cd758956 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18" status: 200 len: 1209 microversion: 2.1 time: 0.110815 Apr 19 16:35:42 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 43/127] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:35:41 2023] GET /compute/v2.1/servers/7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18 => generated 1209 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:35:42 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-dceef8a4-b957-4dd8-b265-54bb8a12a07c tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:35:42 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-dceef8a4-b957-4dd8-b265-54bb8a12a07c tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] [instance: 01b50b56-31d2-4143-8585-63713d1bc7e9] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:35:42 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-dceef8a4-b957-4dd8-b265-54bb8a12a07c tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:35:42 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-dceef8a4-b957-4dd8-b265-54bb8a12a07c tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:35:42 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-dceef8a4-b957-4dd8-b265-54bb8a12a07c tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:35:42 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-dceef8a4-b957-4dd8-b265-54bb8a12a07c tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:35:42 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-dceef8a4-b957-4dd8-b265-54bb8a12a07c tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:35:42 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-dceef8a4-b957-4dd8-b265-54bb8a12a07c tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:35:42 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-dceef8a4-b957-4dd8-b265-54bb8a12a07c tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] [instance: 01b50b56-31d2-4143-8585-63713d1bc7e9] Going to try to terminate instance {{(pid=61471) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 16:35:42 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-dceef8a4-b957-4dd8-b265-54bb8a12a07c tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/01b50b56-31d2-4143-8585-63713d1bc7e9" status: 204 len: 0 microversion: 2.20 time: 0.139818 Apr 19 16:35:42 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 44/128] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 19 16:35:42 2023] DELETE /compute/v2.1/servers/01b50b56-31d2-4143-8585-63713d1bc7e9 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 19 16:35:42 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-4d5d9e24-d9be-4700-a7d1-206740d9ffec tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:35:42 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-4d5d9e24-d9be-4700-a7d1-206740d9ffec tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] [instance: 01b50b56-31d2-4143-8585-63713d1bc7e9] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:35:42 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-4d5d9e24-d9be-4700-a7d1-206740d9ffec tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:35:42 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-4d5d9e24-d9be-4700-a7d1-206740d9ffec tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:35:42 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-4d5d9e24-d9be-4700-a7d1-206740d9ffec tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:35:42 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-4d5d9e24-d9be-4700-a7d1-206740d9ffec tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:35:42 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-4d5d9e24-d9be-4700-a7d1-206740d9ffec tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:35:42 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-4d5d9e24-d9be-4700-a7d1-206740d9ffec tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:35:43 user devstack@n-api.service[61472]: DEBUG nova.policy [None req-4d5d9e24-d9be-4700-a7d1-206740d9ffec tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34afcb1cb8d2433b9564e5b62b45fe86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29a717b7f334af5a35d9e86c3d4b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61472) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:35:43 user devstack@n-api.service[61472]: DEBUG nova.policy [None req-4d5d9e24-d9be-4700-a7d1-206740d9ffec tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34afcb1cb8d2433b9564e5b62b45fe86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29a717b7f334af5a35d9e86c3d4b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61472) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:35:43 user devstack@n-api.service[61472]: DEBUG nova.policy [None req-4d5d9e24-d9be-4700-a7d1-206740d9ffec tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34afcb1cb8d2433b9564e5b62b45fe86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29a717b7f334af5a35d9e86c3d4b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61472) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:35:43 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-4d5d9e24-d9be-4700-a7d1-206740d9ffec tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/01b50b56-31d2-4143-8585-63713d1bc7e9" status: 200 len: 1710 microversion: 2.20 time: 0.197766 Apr 19 16:35:43 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 42/129] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 16:35:42 2023] GET /compute/v2.1/servers/01b50b56-31d2-4143-8585-63713d1bc7e9 => generated 1710 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 16:35:43 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-4a40c61c-1a93-4872-9430-9a0bc7d72312 req-3a56ace3-0c9a-4626-9e4b-878ab96ed003 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01b50b56-31d2-4143-8585-63713d1bc7e9", "name": "network-vif-unplugged", "status": "completed", "tag": "cde3d9e4-9e22-4584-8b11-2a1a9d225fcb"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:35:43 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-4a40c61c-1a93-4872-9430-9a0bc7d72312 req-3a56ace3-0c9a-4626-9e4b-878ab96ed003 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:35:43 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-4a40c61c-1a93-4872-9430-9a0bc7d72312 req-3a56ace3-0c9a-4626-9e4b-878ab96ed003 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:35:43 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-4a40c61c-1a93-4872-9430-9a0bc7d72312 req-3a56ace3-0c9a-4626-9e4b-878ab96ed003 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:35:43 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-4a40c61c-1a93-4872-9430-9a0bc7d72312 req-3a56ace3-0c9a-4626-9e4b-878ab96ed003 service nova] Creating event network-vif-unplugged:cde3d9e4-9e22-4584-8b11-2a1a9d225fcb for instance 01b50b56-31d2-4143-8585-63713d1bc7e9 on user Apr 19 16:35:43 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-4a40c61c-1a93-4872-9430-9a0bc7d72312 req-3a56ace3-0c9a-4626-9e4b-878ab96ed003 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042804 Apr 19 16:35:43 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 44/130] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:35:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:35:44 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [req-131e94db-64ef-4298-ac5e-c61ad43e3f2b req-07a50e5f-8966-44b9-b772-46f0da30c473 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18", "tag": "5d73369b-1168-483b-9935-81ee93f63187"}]} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:35:44 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-131e94db-64ef-4298-ac5e-c61ad43e3f2b req-07a50e5f-8966-44b9-b772-46f0da30c473 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:35:44 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-131e94db-64ef-4298-ac5e-c61ad43e3f2b req-07a50e5f-8966-44b9-b772-46f0da30c473 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:35:44 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-131e94db-64ef-4298-ac5e-c61ad43e3f2b req-07a50e5f-8966-44b9-b772-46f0da30c473 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:35:44 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-131e94db-64ef-4298-ac5e-c61ad43e3f2b req-07a50e5f-8966-44b9-b772-46f0da30c473 service nova] Creating event network-changed:5d73369b-1168-483b-9935-81ee93f63187 for instance 7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18 on user Apr 19 16:35:44 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [req-131e94db-64ef-4298-ac5e-c61ad43e3f2b req-07a50e5f-8966-44b9-b772-46f0da30c473 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032337 Apr 19 16:35:44 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 45/131] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:35:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:35:45 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [req-9e5ef664-364c-4580-b5ac-a2c7154b94bc req-43952a2d-03e4-4429-89d3-ac9343bbcdf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01b50b56-31d2-4143-8585-63713d1bc7e9", "name": "network-vif-plugged", "status": "completed", "tag": "cde3d9e4-9e22-4584-8b11-2a1a9d225fcb"}]} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:35:45 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-9e5ef664-364c-4580-b5ac-a2c7154b94bc req-43952a2d-03e4-4429-89d3-ac9343bbcdf4 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:35:45 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-9e5ef664-364c-4580-b5ac-a2c7154b94bc req-43952a2d-03e4-4429-89d3-ac9343bbcdf4 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:35:45 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-9e5ef664-364c-4580-b5ac-a2c7154b94bc req-43952a2d-03e4-4429-89d3-ac9343bbcdf4 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:35:45 user devstack@n-api.service[61472]: INFO nova.api.openstack.compute.server_external_events [req-9e5ef664-364c-4580-b5ac-a2c7154b94bc req-43952a2d-03e4-4429-89d3-ac9343bbcdf4 service nova] Creating event network-vif-plugged:cde3d9e4-9e22-4584-8b11-2a1a9d225fcb for instance 01b50b56-31d2-4143-8585-63713d1bc7e9 on user Apr 19 16:35:45 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [req-9e5ef664-364c-4580-b5ac-a2c7154b94bc req-43952a2d-03e4-4429-89d3-ac9343bbcdf4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027529 Apr 19 16:35:45 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 43/132] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:35:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:35:45 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-0be4533e-0fa4-47da-8d64-7fb3c04b69c6 req-87d4b1b5-6998-4b30-b485-c378afe89959 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01b50b56-31d2-4143-8585-63713d1bc7e9", "name": "network-vif-deleted", "tag": "cde3d9e4-9e22-4584-8b11-2a1a9d225fcb"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:35:45 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-0be4533e-0fa4-47da-8d64-7fb3c04b69c6 req-87d4b1b5-6998-4b30-b485-c378afe89959 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:35:45 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-0be4533e-0fa4-47da-8d64-7fb3c04b69c6 req-87d4b1b5-6998-4b30-b485-c378afe89959 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:35:45 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-0be4533e-0fa4-47da-8d64-7fb3c04b69c6 req-87d4b1b5-6998-4b30-b485-c378afe89959 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:35:45 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-0be4533e-0fa4-47da-8d64-7fb3c04b69c6 req-87d4b1b5-6998-4b30-b485-c378afe89959 service nova] Creating event network-vif-deleted:cde3d9e4-9e22-4584-8b11-2a1a9d225fcb for instance 01b50b56-31d2-4143-8585-63713d1bc7e9 on user Apr 19 16:35:45 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-0be4533e-0fa4-47da-8d64-7fb3c04b69c6 req-87d4b1b5-6998-4b30-b485-c378afe89959 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028619 Apr 19 16:35:45 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 45/133] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:35:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:35:45 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-91d432cb-8ef2-4758-8684-02518dc92be7 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:35:45 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-91d432cb-8ef2-4758-8684-02518dc92be7 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] [instance: fbf430be-25fa-4e08-8d5b-08c95b10172a] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:35:45 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-91d432cb-8ef2-4758-8684-02518dc92be7 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:35:45 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-91d432cb-8ef2-4758-8684-02518dc92be7 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:35:45 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-91d432cb-8ef2-4758-8684-02518dc92be7 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:35:45 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-91d432cb-8ef2-4758-8684-02518dc92be7 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:35:45 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-91d432cb-8ef2-4758-8684-02518dc92be7 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:35:45 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-91d432cb-8ef2-4758-8684-02518dc92be7 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:35:45 user devstack@n-api.service[61471]: INFO nova.api.openstack.wsgi [None req-91d432cb-8ef2-4758-8684-02518dc92be7 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] HTTP exception thrown: Instance fbf430be-25fa-4e08-8d5b-08c95b10172a could not be found. Apr 19 16:35:45 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-91d432cb-8ef2-4758-8684-02518dc92be7 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Request method failure captured: Apr 19 16:35:45 user devstack@n-api.service[61471]: request: GET /compute/v2.1/servers/fbf430be-25fa-4e08-8d5b-08c95b10172a HTTP/1.1 Apr 19 16:35:45 user devstack@n-api.service[61471]: Accept: application/json Apr 19 16:35:45 user devstack@n-api.service[61471]: Accept-Encoding: identity Apr 19 16:35:45 user devstack@n-api.service[61471]: Connection: close Apr 19 16:35:45 user devstack@n-api.service[61471]: Content-Length: 0 Apr 19 16:35:45 user devstack@n-api.service[61471]: Content-Type: application/json Apr 19 16:35:45 user devstack@n-api.service[61471]: Host: 10.0.0.210 Apr 19 16:35:45 user devstack@n-api.service[61471]: Openstack-System-Scope: None Apr 19 16:35:45 user devstack@n-api.service[61471]: User-Agent: python-urllib3/1.26.15 Apr 19 16:35:45 user devstack@n-api.service[61471]: X-Auth-Token: gAAAAABkQBe1KSHokT8PQH3k3vnjIt97t532dWuRz8Pml0FOlGyiPoJ_q_-ld3S6cAAgROvvvhUgmEwfCyYUzAgb5BImPOX9fwVjK1KI0GLz312Q5Z2IlqMSmB5SJFoVIfRtPQ9K8GxAdUo5TO_60RdH4gGaVZDRdA94Vol93DCBoXTfp3X86mQ Apr 19 16:35:45 user devstack@n-api.service[61471]: X-Domain-Id: None Apr 19 16:35:45 user devstack@n-api.service[61471]: X-Domain-Name: None Apr 19 16:35:45 user devstack@n-api.service[61471]: X-Identity-Status: Confirmed Apr 19 16:35:45 user devstack@n-api.service[61471]: X-Is-Admin-Project: True Apr 19 16:35:45 user devstack@n-api.service[61471]: X-Project-Domain-Id: default Apr 19 16:35:45 user devstack@n-api.service[61471]: X-Project-Domain-Name: Default Apr 19 16:35:45 user devstack@n-api.service[61471]: X-Project-Id: 821ceccc36de46f780e55a02f25782f4 Apr 19 16:35:45 user devstack@n-api.service[61471]: X-Project-Name: tempest-AttachVolumeNegativeTest-2083894839 Apr 19 16:35:45 user devstack@n-api.service[61471]: X-Role: member,reader Apr 19 16:35:45 user devstack@n-api.service[61471]: X-Roles: member,reader Apr 19 16:35:45 user devstack@n-api.service[61471]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/821ceccc36de46f780e55a02f25782f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/821ceccc36de46f780e55a02f25782f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/821ceccc36de46f780e55a02f25782f4"}]}] Apr 19 16:35:45 user devstack@n-api.service[61471]: X-Tenant: tempest-AttachVolumeNegativeTest-2083894839 Apr 19 16:35:45 user devstack@n-api.service[61471]: X-Tenant-Id: 821ceccc36de46f780e55a02f25782f4 Apr 19 16:35:45 user devstack@n-api.service[61471]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2083894839 Apr 19 16:35:45 user devstack@n-api.service[61471]: X-User: tempest-AttachVolumeNegativeTest-2083894839-project-member Apr 19 16:35:45 user devstack@n-api.service[61471]: X-User-Domain-Id: default Apr 19 16:35:45 user devstack@n-api.service[61471]: X-User-Domain-Name: Default Apr 19 16:35:45 user devstack@n-api.service[61471]: X-User-Id: c2563be52f624ceab060942e8bfcedef Apr 19 16:35:45 user devstack@n-api.service[61471]: X-User-Name: tempest-AttachVolumeNegativeTest-2083894839-project-member Apr 19 16:35:45 user devstack@n-api.service[61471]: method: > Apr 19 16:35:45 user devstack@n-api.service[61471]: exception: Instance fbf430be-25fa-4e08-8d5b-08c95b10172a could not be found. Apr 19 16:35:45 user devstack@n-api.service[61471]: action_args: {'id': 'fbf430be-25fa-4e08-8d5b-08c95b10172a'} Apr 19 16:35:45 user devstack@n-api.service[61471]: {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:35:45 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:35:45 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:35:45 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:35:45 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:35:45 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:35:45 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:35:45 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:35:45 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:35:45 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:35:45 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbf430be-25fa-4e08-8d5b-08c95b10172a could not be found. Apr 19 16:35:45 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:35:45 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:35:45 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:35:45 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:35:45 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:35:45 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:35:45 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:35:45 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:35:45 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:35:45 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:35:45 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 16:35:45 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 16:35:45 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:35:45 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:35:45 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:35:45 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:35:45 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbf430be-25fa-4e08-8d5b-08c95b10172a could not be found. Apr 19 16:35:45 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:35:45 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:35:45 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:35:45 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:35:45 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:35:45 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:35:45 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:35:45 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:35:45 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbf430be-25fa-4e08-8d5b-08c95b10172a could not be found. Apr 19 16:35:45 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:35:45 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-91d432cb-8ef2-4758-8684-02518dc92be7 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Returning 404 to user: Instance fbf430be-25fa-4e08-8d5b-08c95b10172a could not be found. {{(pid=61471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:35:45 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-91d432cb-8ef2-4758-8684-02518dc92be7 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fbf430be-25fa-4e08-8d5b-08c95b10172a" status: 404 len: 111 microversion: 2.1 time: 0.030755 Apr 19 16:35:45 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 46/134] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:35:45 2023] GET /compute/v2.1/servers/fbf430be-25fa-4e08-8d5b-08c95b10172a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 16:35:45 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-98477528-b7d2-4dfb-b54b-20958785f969 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Calling method '.version_select at 0x7fd49736b5b0>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:35:45 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-98477528-b7d2-4dfb-b54b-20958785f969 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-526361184" status: 202 len: 0 microversion: 2.1 time: 0.023716 Apr 19 16:35:45 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 44/135] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 19 16:35:45 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-526361184 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 16:35:46 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-938371a4-efda-479b-89bf-cd10f9ad052b tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Action: 'create', calling method: .version_select at 0x7fd4973a03a0>, body: {"keypair": {"name": "tempest-keypair-376307208", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXle4lfRsYNnuTYFZENLI6jAt+459bsy9BioQ5gPOrCI43az0Q39WI1ZAjNpqDdbVDOSi72bMiyF91ndnzRfrFUvyAjrQEnVv1UpE89bv1oAzGgE6TpoyDazadzYjv5lg=="}} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:35:46 user devstack@n-api.service[61473]: DEBUG nova.quota [None req-938371a4-efda-479b-89bf-cd10f9ad052b tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Getting quotas for project 821ceccc36de46f780e55a02f25782f4. Resources: {'key_pairs'} {{(pid=61473) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 16:35:46 user devstack@n-api.service[61473]: DEBUG nova.quota [None req-938371a4-efda-479b-89bf-cd10f9ad052b tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Getting quotas for user c2563be52f624ceab060942e8bfcedef and project 821ceccc36de46f780e55a02f25782f4. Resources: {'key_pairs'} {{(pid=61473) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 16:35:46 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-938371a4-efda-479b-89bf-cd10f9ad052b tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.062726 Apr 19 16:35:46 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 46/136] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 16:35:46 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:35:46 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [req-0f498013-1036-4e39-a5e2-ff214a5492cf req-216d9ff6-44c3-4588-bf94-c3e8155bc612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18", "name": "network-vif-plugged", "status": "completed", "tag": "5d73369b-1168-483b-9935-81ee93f63187"}]} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:35:46 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-0f498013-1036-4e39-a5e2-ff214a5492cf req-216d9ff6-44c3-4588-bf94-c3e8155bc612 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:35:46 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-0f498013-1036-4e39-a5e2-ff214a5492cf req-216d9ff6-44c3-4588-bf94-c3e8155bc612 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:35:46 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-0f498013-1036-4e39-a5e2-ff214a5492cf req-216d9ff6-44c3-4588-bf94-c3e8155bc612 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:35:46 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-0f498013-1036-4e39-a5e2-ff214a5492cf req-216d9ff6-44c3-4588-bf94-c3e8155bc612 service nova] Creating event network-vif-plugged:5d73369b-1168-483b-9935-81ee93f63187 for instance 7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18 on user Apr 19 16:35:46 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [req-0f498013-1036-4e39-a5e2-ff214a5492cf req-216d9ff6-44c3-4588-bf94-c3e8155bc612 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045491 Apr 19 16:35:46 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 47/137] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:35:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:35:48 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-15b18b34-b8ba-40cb-b3bf-097e19053b2a tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1409189585", "imageRef": "ab56c4b1-0117-43b0-84b6-28d06a23f182", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "543e5868-bf5f-41ca-a4b2-61c1cd6946cf"}], "security_groups": [{"name": "tempest-securitygroup--797965037"}], "key_name": "tempest-keypair-376307208", "user_data": "}} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:35:48 user devstack@n-api.service[61472]: DEBUG nova.network.neutron [None req-15b18b34-b8ba-40cb-b3bf-097e19053b2a tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] validate_networks() for [('543e5868-bf5f-41ca-a4b2-61c1cd6946cf', None, None, None, None, None)] {{(pid=61472) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 16:35:48 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-94736854-d9bf-4c81-a06d-60a84c6f156e req-4a37bfea-9f96-49ee-adf2-64cb961b3c19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18", "name": "network-vif-plugged", "status": "completed", "tag": "5d73369b-1168-483b-9935-81ee93f63187"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:35:48 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-94736854-d9bf-4c81-a06d-60a84c6f156e req-4a37bfea-9f96-49ee-adf2-64cb961b3c19 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:35:48 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-94736854-d9bf-4c81-a06d-60a84c6f156e req-4a37bfea-9f96-49ee-adf2-64cb961b3c19 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:35:48 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-94736854-d9bf-4c81-a06d-60a84c6f156e req-4a37bfea-9f96-49ee-adf2-64cb961b3c19 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:35:48 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-94736854-d9bf-4c81-a06d-60a84c6f156e req-4a37bfea-9f96-49ee-adf2-64cb961b3c19 service nova] Creating event network-vif-plugged:5d73369b-1168-483b-9935-81ee93f63187 for instance 7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18 on user Apr 19 16:35:48 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-94736854-d9bf-4c81-a06d-60a84c6f156e req-4a37bfea-9f96-49ee-adf2-64cb961b3c19 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032546 Apr 19 16:35:48 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 47/138] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:35:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:35:49 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-15b18b34-b8ba-40cb-b3bf-097e19053b2a tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Flavor limits 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 16:35:49 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-15b18b34-b8ba-40cb-b3bf-097e19053b2a tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Image limits 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 16:35:49 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-15b18b34-b8ba-40cb-b3bf-097e19053b2a tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Flavor pref 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 16:35:49 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-15b18b34-b8ba-40cb-b3bf-097e19053b2a tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Image pref 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 16:35:49 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-15b18b34-b8ba-40cb-b3bf-097e19053b2a tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 16:35:49 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-15b18b34-b8ba-40cb-b3bf-097e19053b2a tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:35:49 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-15b18b34-b8ba-40cb-b3bf-097e19053b2a tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:35:49 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-15b18b34-b8ba-40cb-b3bf-097e19053b2a tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:35:49 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-15b18b34-b8ba-40cb-b3bf-097e19053b2a tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:35:49 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-15b18b34-b8ba-40cb-b3bf-097e19053b2a tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:35:49 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-15b18b34-b8ba-40cb-b3bf-097e19053b2a tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:35:49 user devstack@n-api.service[61472]: DEBUG nova.quota [None req-15b18b34-b8ba-40cb-b3bf-097e19053b2a tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Getting quotas for project 821ceccc36de46f780e55a02f25782f4. Resources: {'instances', 'ram', 'cores'} {{(pid=61472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 16:35:49 user devstack@n-api.service[61472]: DEBUG nova.quota [None req-15b18b34-b8ba-40cb-b3bf-097e19053b2a tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Getting quotas for user c2563be52f624ceab060942e8bfcedef and project 821ceccc36de46f780e55a02f25782f4. Resources: {'instances', 'ram', 'cores'} {{(pid=61472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 16:35:49 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-15b18b34-b8ba-40cb-b3bf-097e19053b2a tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Going to run 1 instances... {{(pid=61472) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 16:35:49 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-15b18b34-b8ba-40cb-b3bf-097e19053b2a tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] [instance: 795900b6-2c41-403e-9023-2ee74e755f5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ab56c4b1-0117-43b0-84b6-28d06a23f182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 16:35:49 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-15b18b34-b8ba-40cb-b3bf-097e19053b2a tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 1.264633 Apr 19 16:35:49 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 45/139] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 16:35:48 2023] POST /compute/v2.1/servers => generated 399 bytes in 1266 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 16:35:49 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-77ac831a-59b1-422e-8560-a6e0667b6120 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:35:49 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-77ac831a-59b1-422e-8560-a6e0667b6120 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] [instance: 795900b6-2c41-403e-9023-2ee74e755f5e] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:35:49 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-77ac831a-59b1-422e-8560-a6e0667b6120 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2563be52f624ceab060942e8bfcedef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ceccc36de46f780e55a02f25782f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:35:49 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-77ac831a-59b1-422e-8560-a6e0667b6120 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] 10.0.0.210 "GET /compute/v2.1/servers/795900b6-2c41-403e-9023-2ee74e755f5e" status: 200 len: 1235 microversion: 2.1 time: 0.079949 Apr 19 16:35:49 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 48/140] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:35:49 2023] GET /compute/v2.1/servers/795900b6-2c41-403e-9023-2ee74e755f5e => generated 1235 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:35:51 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-438e02be-ba84-4bb1-b6e7-e6837dc5fdbc tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Action: 'create', calling method: .version_select at 0x7fd4973a1120>, body: {"keypair": {"name": "tempest-keypair-1808529544", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFnI5y0JO6xchnQVVyhRVSXnmL1/UhmTWXoho763VsHl+JGPE6Uk0ODlGS1xiH2MW1oAge5M8jqZhD4Id7aIegS3zI6oU8CApDK48jDjLP7jazji9e3Sdpzss1OOF4EcCg=="}} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:35:51 user devstack@n-api.service[61473]: DEBUG nova.quota [None req-438e02be-ba84-4bb1-b6e7-e6837dc5fdbc tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Getting quotas for project 78962d13860a4df3a8aa100e2afaca6d. Resources: {'key_pairs'} {{(pid=61473) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 16:35:51 user devstack@n-api.service[61473]: DEBUG nova.quota [None req-438e02be-ba84-4bb1-b6e7-e6837dc5fdbc tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Getting quotas for user 023314f8cf79430b83c5184d9a54be45 and project 78962d13860a4df3a8aa100e2afaca6d. Resources: {'key_pairs'} {{(pid=61473) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 16:35:51 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-438e02be-ba84-4bb1-b6e7-e6837dc5fdbc tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.184194 Apr 19 16:35:51 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 48/141] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 16:35:51 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:35:52 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [req-e4577b95-ba1b-43b6-812d-8f9e8e1eed0d req-1994e6ae-e555-4681-9baa-5b1cf0a91c34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "795900b6-2c41-403e-9023-2ee74e755f5e", "tag": "3841b5af-ca7d-4bb2-a319-fa770cc22a33"}]} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:35:52 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-e4577b95-ba1b-43b6-812d-8f9e8e1eed0d req-1994e6ae-e555-4681-9baa-5b1cf0a91c34 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:35:52 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-e4577b95-ba1b-43b6-812d-8f9e8e1eed0d req-1994e6ae-e555-4681-9baa-5b1cf0a91c34 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:35:52 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-e4577b95-ba1b-43b6-812d-8f9e8e1eed0d req-1994e6ae-e555-4681-9baa-5b1cf0a91c34 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:35:52 user devstack@n-api.service[61472]: INFO nova.api.openstack.compute.server_external_events [req-e4577b95-ba1b-43b6-812d-8f9e8e1eed0d req-1994e6ae-e555-4681-9baa-5b1cf0a91c34 service nova] Creating event network-changed:3841b5af-ca7d-4bb2-a319-fa770cc22a33 for instance 795900b6-2c41-403e-9023-2ee74e755f5e on user Apr 19 16:35:52 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [req-e4577b95-ba1b-43b6-812d-8f9e8e1eed0d req-1994e6ae-e555-4681-9baa-5b1cf0a91c34 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033297 Apr 19 16:35:52 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 46/142] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:35:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:35:52 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-1560e812-4272-4010-a53a-dfd8de15f2a8 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1893439761", "imageRef": "ab56c4b1-0117-43b0-84b6-28d06a23f182", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "37516640-5236-4460-80c5-3e22db5fed5e"}], "security_groups": [{"name": "tempest-securitygroup--1269687626"}], "key_name": "tempest-keypair-1808529544", "user_data": "}} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:35:53 user devstack@n-api.service[61471]: DEBUG nova.network.neutron [None req-1560e812-4272-4010-a53a-dfd8de15f2a8 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] validate_networks() for [('37516640-5236-4460-80c5-3e22db5fed5e', None, None, None, None, None)] {{(pid=61471) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 16:35:53 user devstack@n-api.service[61471]: DEBUG nova.virt.hardware [None req-1560e812-4272-4010-a53a-dfd8de15f2a8 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Flavor limits 0:0:0 {{(pid=61471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 16:35:53 user devstack@n-api.service[61471]: DEBUG nova.virt.hardware [None req-1560e812-4272-4010-a53a-dfd8de15f2a8 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Image limits 0:0:0 {{(pid=61471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 16:35:53 user devstack@n-api.service[61471]: DEBUG nova.virt.hardware [None req-1560e812-4272-4010-a53a-dfd8de15f2a8 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Flavor pref 0:0:0 {{(pid=61471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 16:35:53 user devstack@n-api.service[61471]: DEBUG nova.virt.hardware [None req-1560e812-4272-4010-a53a-dfd8de15f2a8 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Image pref 0:0:0 {{(pid=61471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 16:35:53 user devstack@n-api.service[61471]: DEBUG nova.virt.hardware [None req-1560e812-4272-4010-a53a-dfd8de15f2a8 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 16:35:53 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-1560e812-4272-4010-a53a-dfd8de15f2a8 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:35:53 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-1560e812-4272-4010-a53a-dfd8de15f2a8 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:35:53 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-1560e812-4272-4010-a53a-dfd8de15f2a8 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:35:53 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-1560e812-4272-4010-a53a-dfd8de15f2a8 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:35:53 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-1560e812-4272-4010-a53a-dfd8de15f2a8 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:35:53 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-1560e812-4272-4010-a53a-dfd8de15f2a8 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:35:53 user devstack@n-api.service[61471]: DEBUG nova.quota [None req-1560e812-4272-4010-a53a-dfd8de15f2a8 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Getting quotas for project 78962d13860a4df3a8aa100e2afaca6d. Resources: {'instances', 'ram', 'cores'} {{(pid=61471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 16:35:53 user devstack@n-api.service[61471]: DEBUG nova.quota [None req-1560e812-4272-4010-a53a-dfd8de15f2a8 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Getting quotas for user 023314f8cf79430b83c5184d9a54be45 and project 78962d13860a4df3a8aa100e2afaca6d. Resources: {'instances', 'ram', 'cores'} {{(pid=61471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 16:35:53 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-1560e812-4272-4010-a53a-dfd8de15f2a8 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Going to run 1 instances... {{(pid=61471) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 16:35:53 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-1560e812-4272-4010-a53a-dfd8de15f2a8 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] [instance: edd2688e-940e-4ab3-b27c-b6d4aab3efc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ab56c4b1-0117-43b0-84b6-28d06a23f182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61471) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 16:35:53 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-1560e812-4272-4010-a53a-dfd8de15f2a8 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.829474 Apr 19 16:35:53 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 49/143] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 16:35:52 2023] POST /compute/v2.1/servers => generated 407 bytes in 832 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 16:35:53 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-d9fe1fe9-7e03-47ca-a25c-d886f9dd9f51 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:35:53 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-d9fe1fe9-7e03-47ca-a25c-d886f9dd9f51 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] [instance: edd2688e-940e-4ab3-b27c-b6d4aab3efc5] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:35:53 user devstack@n-api.service[61473]: DEBUG nova.policy [None req-d9fe1fe9-7e03-47ca-a25c-d886f9dd9f51 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023314f8cf79430b83c5184d9a54be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78962d13860a4df3a8aa100e2afaca6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61473) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:35:53 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-d9fe1fe9-7e03-47ca-a25c-d886f9dd9f51 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] 10.0.0.210 "GET /compute/v2.1/servers/edd2688e-940e-4ab3-b27c-b6d4aab3efc5" status: 200 len: 1233 microversion: 2.1 time: 0.086723 Apr 19 16:35:53 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 49/144] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:35:53 2023] GET /compute/v2.1/servers/edd2688e-940e-4ab3-b27c-b6d4aab3efc5 => generated 1233 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 16:35:54 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [req-6f2fd822-4b90-414e-8a47-a4fdc9fd1843 req-17ef2be1-b513-4860-b35f-38ef90071c84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "795900b6-2c41-403e-9023-2ee74e755f5e", "name": "network-vif-plugged", "status": "completed", "tag": "3841b5af-ca7d-4bb2-a319-fa770cc22a33"}]} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:35:54 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-6f2fd822-4b90-414e-8a47-a4fdc9fd1843 req-17ef2be1-b513-4860-b35f-38ef90071c84 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:35:54 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-6f2fd822-4b90-414e-8a47-a4fdc9fd1843 req-17ef2be1-b513-4860-b35f-38ef90071c84 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:35:54 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-6f2fd822-4b90-414e-8a47-a4fdc9fd1843 req-17ef2be1-b513-4860-b35f-38ef90071c84 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:35:54 user devstack@n-api.service[61472]: INFO nova.api.openstack.compute.server_external_events [req-6f2fd822-4b90-414e-8a47-a4fdc9fd1843 req-17ef2be1-b513-4860-b35f-38ef90071c84 service nova] Creating event network-vif-plugged:3841b5af-ca7d-4bb2-a319-fa770cc22a33 for instance 795900b6-2c41-403e-9023-2ee74e755f5e on user Apr 19 16:35:54 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [req-6f2fd822-4b90-414e-8a47-a4fdc9fd1843 req-17ef2be1-b513-4860-b35f-38ef90071c84 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068736 Apr 19 16:35:54 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 47/145] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:35:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 16:35:56 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [req-f7e36f2f-6d18-4507-8187-35cb32947c3c req-f80cda0a-2c95-4f7d-ba6a-b92193b0750c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edd2688e-940e-4ab3-b27c-b6d4aab3efc5", "tag": "f8192a07-aa51-45e4-b140-3517cb9813d4"}]} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:35:56 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-f7e36f2f-6d18-4507-8187-35cb32947c3c req-f80cda0a-2c95-4f7d-ba6a-b92193b0750c service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:35:56 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-f7e36f2f-6d18-4507-8187-35cb32947c3c req-f80cda0a-2c95-4f7d-ba6a-b92193b0750c service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:35:56 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-f7e36f2f-6d18-4507-8187-35cb32947c3c req-f80cda0a-2c95-4f7d-ba6a-b92193b0750c service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:35:56 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-f7e36f2f-6d18-4507-8187-35cb32947c3c req-f80cda0a-2c95-4f7d-ba6a-b92193b0750c service nova] Creating event network-changed:f8192a07-aa51-45e4-b140-3517cb9813d4 for instance edd2688e-940e-4ab3-b27c-b6d4aab3efc5 on user Apr 19 16:35:56 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [req-f7e36f2f-6d18-4507-8187-35cb32947c3c req-f80cda0a-2c95-4f7d-ba6a-b92193b0750c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036932 Apr 19 16:35:56 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 50/146] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:35:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:35:56 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-0b5580f8-b0e3-4ffb-84aa-921816ad330f req-e8c1d398-e33f-4e01-ac77-854bab0bddad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "795900b6-2c41-403e-9023-2ee74e755f5e", "name": "network-vif-plugged", "status": "completed", "tag": "3841b5af-ca7d-4bb2-a319-fa770cc22a33"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:35:56 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-0b5580f8-b0e3-4ffb-84aa-921816ad330f req-e8c1d398-e33f-4e01-ac77-854bab0bddad service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:35:56 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-0b5580f8-b0e3-4ffb-84aa-921816ad330f req-e8c1d398-e33f-4e01-ac77-854bab0bddad service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:35:56 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-0b5580f8-b0e3-4ffb-84aa-921816ad330f req-e8c1d398-e33f-4e01-ac77-854bab0bddad service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:35:56 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-0b5580f8-b0e3-4ffb-84aa-921816ad330f req-e8c1d398-e33f-4e01-ac77-854bab0bddad service nova] Creating event network-vif-plugged:3841b5af-ca7d-4bb2-a319-fa770cc22a33 for instance 795900b6-2c41-403e-9023-2ee74e755f5e on user Apr 19 16:35:56 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-0b5580f8-b0e3-4ffb-84aa-921816ad330f req-e8c1d398-e33f-4e01-ac77-854bab0bddad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042120 Apr 19 16:35:56 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 50/147] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:35:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:35:59 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [req-a8272866-9d6f-415f-9f31-0d12a150314b req-f13c6b77-8b9d-4e4d-bbb3-ce77906964de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edd2688e-940e-4ab3-b27c-b6d4aab3efc5", "name": "network-vif-plugged", "status": "completed", "tag": "f8192a07-aa51-45e4-b140-3517cb9813d4"}]} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:35:59 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-a8272866-9d6f-415f-9f31-0d12a150314b req-f13c6b77-8b9d-4e4d-bbb3-ce77906964de service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:35:59 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-a8272866-9d6f-415f-9f31-0d12a150314b req-f13c6b77-8b9d-4e4d-bbb3-ce77906964de service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:35:59 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-a8272866-9d6f-415f-9f31-0d12a150314b req-f13c6b77-8b9d-4e4d-bbb3-ce77906964de service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:35:59 user devstack@n-api.service[61472]: INFO nova.api.openstack.compute.server_external_events [req-a8272866-9d6f-415f-9f31-0d12a150314b req-f13c6b77-8b9d-4e4d-bbb3-ce77906964de service nova] Creating event network-vif-plugged:f8192a07-aa51-45e4-b140-3517cb9813d4 for instance edd2688e-940e-4ab3-b27c-b6d4aab3efc5 on user Apr 19 16:35:59 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [req-a8272866-9d6f-415f-9f31-0d12a150314b req-f13c6b77-8b9d-4e4d-bbb3-ce77906964de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079072 Apr 19 16:35:59 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 48/148] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:35:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:36:01 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [req-1e65b32f-5289-4579-9058-c1c8f55f1278 req-bc16889e-d809-4785-9898-77bab7b0633a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edd2688e-940e-4ab3-b27c-b6d4aab3efc5", "name": "network-vif-plugged", "status": "completed", "tag": "f8192a07-aa51-45e4-b140-3517cb9813d4"}]} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:36:01 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-1e65b32f-5289-4579-9058-c1c8f55f1278 req-bc16889e-d809-4785-9898-77bab7b0633a service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:36:01 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-1e65b32f-5289-4579-9058-c1c8f55f1278 req-bc16889e-d809-4785-9898-77bab7b0633a service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:36:01 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-1e65b32f-5289-4579-9058-c1c8f55f1278 req-bc16889e-d809-4785-9898-77bab7b0633a service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:36:01 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-1e65b32f-5289-4579-9058-c1c8f55f1278 req-bc16889e-d809-4785-9898-77bab7b0633a service nova] Creating event network-vif-plugged:f8192a07-aa51-45e4-b140-3517cb9813d4 for instance edd2688e-940e-4ab3-b27c-b6d4aab3efc5 on user Apr 19 16:36:01 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [req-1e65b32f-5289-4579-9058-c1c8f55f1278 req-bc16889e-d809-4785-9898-77bab7b0633a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037502 Apr 19 16:36:01 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 51/149] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:36:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:36:09 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell0:SELECT=12 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:36:09 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=2 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:36:09 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell1:SELECT=10 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:36:09 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-1495956b-d3eb-43e2-900b-3c7b00ff6c9f tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:36:09 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-1495956b-d3eb-43e2-900b-3c7b00ff6c9f tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] [instance: 131e75dc-8c64-40b1-b21b-40210f4d5425] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:36:09 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-1495956b-d3eb-43e2-900b-3c7b00ff6c9f tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:36:09 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-1495956b-d3eb-43e2-900b-3c7b00ff6c9f tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:36:09 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-1495956b-d3eb-43e2-900b-3c7b00ff6c9f tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:36:09 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-1495956b-d3eb-43e2-900b-3c7b00ff6c9f tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:36:09 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-1495956b-d3eb-43e2-900b-3c7b00ff6c9f tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:36:09 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-1495956b-d3eb-43e2-900b-3c7b00ff6c9f tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:36:10 user devstack@n-api.service[61473]: DEBUG nova.policy [None req-1495956b-d3eb-43e2-900b-3c7b00ff6c9f tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be99c3ba0554acda7b418f66a31c943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee32e72a51414422bfad5875f32b1515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61473) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:36:10 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-1495956b-d3eb-43e2-900b-3c7b00ff6c9f tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] 10.0.0.210 "GET /compute/v2.1/servers/131e75dc-8c64-40b1-b21b-40210f4d5425" status: 200 len: 1494 microversion: 2.1 time: 0.215858 Apr 19 16:36:10 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 51/150] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:36:09 2023] GET /compute/v2.1/servers/131e75dc-8c64-40b1-b21b-40210f4d5425 => generated 1494 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:36:12 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell0:SELECT=4 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:36:12 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell0:SELECT=12 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:36:12 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:36:12 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell1:SELECT=22 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:36:12 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-d059707e-e7d1-4dce-b4c9-e1fc6542735d tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:36:12 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-d059707e-e7d1-4dce-b4c9-e1fc6542735d tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] [instance: f9885d3d-e74d-4250-b096-0df5dde6f3cd] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:36:12 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-d059707e-e7d1-4dce-b4c9-e1fc6542735d tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:36:12 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-d059707e-e7d1-4dce-b4c9-e1fc6542735d tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:36:12 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-d059707e-e7d1-4dce-b4c9-e1fc6542735d tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:36:12 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-d059707e-e7d1-4dce-b4c9-e1fc6542735d tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:36:12 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-d059707e-e7d1-4dce-b4c9-e1fc6542735d tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:36:12 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-d059707e-e7d1-4dce-b4c9-e1fc6542735d tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:36:12 user devstack@n-api.service[61472]: INFO nova.api.openstack.wsgi [None req-d059707e-e7d1-4dce-b4c9-e1fc6542735d tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] HTTP exception thrown: Instance f9885d3d-e74d-4250-b096-0df5dde6f3cd could not be found. Apr 19 16:36:12 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-d059707e-e7d1-4dce-b4c9-e1fc6542735d tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Request method failure captured: Apr 19 16:36:12 user devstack@n-api.service[61472]: request: GET /compute/v2.1/servers/f9885d3d-e74d-4250-b096-0df5dde6f3cd HTTP/1.1 Apr 19 16:36:12 user devstack@n-api.service[61472]: Accept: application/json Apr 19 16:36:12 user devstack@n-api.service[61472]: Accept-Encoding: identity Apr 19 16:36:12 user devstack@n-api.service[61472]: Connection: close Apr 19 16:36:12 user devstack@n-api.service[61472]: Content-Length: 0 Apr 19 16:36:12 user devstack@n-api.service[61472]: Content-Type: application/json Apr 19 16:36:12 user devstack@n-api.service[61472]: Host: 10.0.0.210 Apr 19 16:36:12 user devstack@n-api.service[61472]: Openstack-System-Scope: None Apr 19 16:36:12 user devstack@n-api.service[61472]: User-Agent: python-urllib3/1.26.15 Apr 19 16:36:12 user devstack@n-api.service[61472]: X-Auth-Token: gAAAAABkQBe4DFVIzZZLrFnGX2g438rC96IFGAO20y23hfy45zLAwcuO6K3mUO33vT8slUbG_r8YqnANgyuBm63I2rxLkrlJ048mwt6uzzT918nIyHHRTjOJYUUB4IeFOb5FcaDuWGioBdoSWE40M9buCMGt4cDFeN6_pMg2TSVz75l5xdjN7i8 Apr 19 16:36:12 user devstack@n-api.service[61472]: X-Domain-Id: None Apr 19 16:36:12 user devstack@n-api.service[61472]: X-Domain-Name: None Apr 19 16:36:12 user devstack@n-api.service[61472]: X-Identity-Status: Confirmed Apr 19 16:36:12 user devstack@n-api.service[61472]: X-Is-Admin-Project: True Apr 19 16:36:12 user devstack@n-api.service[61472]: X-Project-Domain-Id: default Apr 19 16:36:12 user devstack@n-api.service[61472]: X-Project-Domain-Name: Default Apr 19 16:36:12 user devstack@n-api.service[61472]: X-Project-Id: fcbe4ed80f09473e98aad29199588a6c Apr 19 16:36:12 user devstack@n-api.service[61472]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1058072018 Apr 19 16:36:12 user devstack@n-api.service[61472]: X-Role: member,reader Apr 19 16:36:12 user devstack@n-api.service[61472]: X-Roles: member,reader Apr 19 16:36:12 user devstack@n-api.service[61472]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fcbe4ed80f09473e98aad29199588a6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fcbe4ed80f09473e98aad29199588a6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fcbe4ed80f09473e98aad29199588a6c"}]}] Apr 19 16:36:12 user devstack@n-api.service[61472]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1058072018 Apr 19 16:36:12 user devstack@n-api.service[61472]: X-Tenant-Id: fcbe4ed80f09473e98aad29199588a6c Apr 19 16:36:12 user devstack@n-api.service[61472]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1058072018 Apr 19 16:36:12 user devstack@n-api.service[61472]: X-User: tempest-AttachSCSIVolumeTestJSON-1058072018-project-member Apr 19 16:36:12 user devstack@n-api.service[61472]: X-User-Domain-Id: default Apr 19 16:36:12 user devstack@n-api.service[61472]: X-User-Domain-Name: Default Apr 19 16:36:12 user devstack@n-api.service[61472]: X-User-Id: 467f608512c4451fb461a5c495bbc9f1 Apr 19 16:36:12 user devstack@n-api.service[61472]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1058072018-project-member Apr 19 16:36:12 user devstack@n-api.service[61472]: method: > Apr 19 16:36:12 user devstack@n-api.service[61472]: exception: Instance f9885d3d-e74d-4250-b096-0df5dde6f3cd could not be found. Apr 19 16:36:12 user devstack@n-api.service[61472]: action_args: {'id': 'f9885d3d-e74d-4250-b096-0df5dde6f3cd'} Apr 19 16:36:12 user devstack@n-api.service[61472]: {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:36:12 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:36:12 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:36:12 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:36:12 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:36:12 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:36:12 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:36:12 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:36:12 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:36:12 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:36:12 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9885d3d-e74d-4250-b096-0df5dde6f3cd could not be found. Apr 19 16:36:12 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:36:12 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:36:12 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:36:12 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:36:12 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:36:12 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:36:12 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:36:12 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:36:12 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:36:12 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:36:12 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 16:36:12 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 16:36:12 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:36:12 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:36:12 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:36:12 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:36:12 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9885d3d-e74d-4250-b096-0df5dde6f3cd could not be found. Apr 19 16:36:12 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:36:12 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:36:12 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:36:12 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:36:12 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:36:12 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:36:12 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:36:12 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:36:12 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9885d3d-e74d-4250-b096-0df5dde6f3cd could not be found. Apr 19 16:36:12 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:36:12 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-d059707e-e7d1-4dce-b4c9-e1fc6542735d tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Returning 404 to user: Instance f9885d3d-e74d-4250-b096-0df5dde6f3cd could not be found. {{(pid=61472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:36:12 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-d059707e-e7d1-4dce-b4c9-e1fc6542735d tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f9885d3d-e74d-4250-b096-0df5dde6f3cd" status: 404 len: 111 microversion: 2.1 time: 0.042435 Apr 19 16:36:12 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 49/151] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:36:12 2023] GET /compute/v2.1/servers/f9885d3d-e74d-4250-b096-0df5dde6f3cd => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 16:36:12 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-efeed078-15ad-4460-be9d-cf3158a0852b tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Calling method '.version_select at 0x7fd4971a5b40>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:36:12 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell0:SELECT=2 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:36:12 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell0:SELECT=8 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:36:12 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:36:12 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:36:12 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-efeed078-15ad-4460-be9d-cf3158a0852b tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-419392040" status: 202 len: 0 microversion: 2.1 time: 0.038994 Apr 19 16:36:12 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 52/152] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 19 16:36:12 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-419392040 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 16:36:13 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-5dc95854-4e2e-4d31-b965-cef74f34c707 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:36:13 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-5dc95854-4e2e-4d31-b965-cef74f34c707 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] [instance: f9885d3d-e74d-4250-b096-0df5dde6f3cd] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:36:13 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-5dc95854-4e2e-4d31-b965-cef74f34c707 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:36:13 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-5dc95854-4e2e-4d31-b965-cef74f34c707 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:36:13 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-5dc95854-4e2e-4d31-b965-cef74f34c707 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:36:13 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-5dc95854-4e2e-4d31-b965-cef74f34c707 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:36:13 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-5dc95854-4e2e-4d31-b965-cef74f34c707 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:36:13 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-5dc95854-4e2e-4d31-b965-cef74f34c707 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:36:13 user devstack@n-api.service[61473]: INFO nova.api.openstack.wsgi [None req-5dc95854-4e2e-4d31-b965-cef74f34c707 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] HTTP exception thrown: Instance f9885d3d-e74d-4250-b096-0df5dde6f3cd could not be found. Apr 19 16:36:13 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-5dc95854-4e2e-4d31-b965-cef74f34c707 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Request method failure captured: Apr 19 16:36:13 user devstack@n-api.service[61473]: request: DELETE /compute/v2.1/servers/f9885d3d-e74d-4250-b096-0df5dde6f3cd HTTP/1.1 Apr 19 16:36:13 user devstack@n-api.service[61473]: Accept: application/json Apr 19 16:36:13 user devstack@n-api.service[61473]: Accept-Encoding: identity Apr 19 16:36:13 user devstack@n-api.service[61473]: Connection: close Apr 19 16:36:13 user devstack@n-api.service[61473]: Content-Length: 0 Apr 19 16:36:13 user devstack@n-api.service[61473]: Content-Type: application/json Apr 19 16:36:13 user devstack@n-api.service[61473]: Host: 10.0.0.210 Apr 19 16:36:13 user devstack@n-api.service[61473]: Openstack-System-Scope: None Apr 19 16:36:13 user devstack@n-api.service[61473]: User-Agent: python-urllib3/1.26.15 Apr 19 16:36:13 user devstack@n-api.service[61473]: X-Auth-Token: gAAAAABkQBe4DFVIzZZLrFnGX2g438rC96IFGAO20y23hfy45zLAwcuO6K3mUO33vT8slUbG_r8YqnANgyuBm63I2rxLkrlJ048mwt6uzzT918nIyHHRTjOJYUUB4IeFOb5FcaDuWGioBdoSWE40M9buCMGt4cDFeN6_pMg2TSVz75l5xdjN7i8 Apr 19 16:36:13 user devstack@n-api.service[61473]: X-Domain-Id: None Apr 19 16:36:13 user devstack@n-api.service[61473]: X-Domain-Name: None Apr 19 16:36:13 user devstack@n-api.service[61473]: X-Identity-Status: Confirmed Apr 19 16:36:13 user devstack@n-api.service[61473]: X-Is-Admin-Project: True Apr 19 16:36:13 user devstack@n-api.service[61473]: X-Project-Domain-Id: default Apr 19 16:36:13 user devstack@n-api.service[61473]: X-Project-Domain-Name: Default Apr 19 16:36:13 user devstack@n-api.service[61473]: X-Project-Id: fcbe4ed80f09473e98aad29199588a6c Apr 19 16:36:13 user devstack@n-api.service[61473]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1058072018 Apr 19 16:36:13 user devstack@n-api.service[61473]: X-Role: member,reader Apr 19 16:36:13 user devstack@n-api.service[61473]: X-Roles: member,reader Apr 19 16:36:13 user devstack@n-api.service[61473]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fcbe4ed80f09473e98aad29199588a6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fcbe4ed80f09473e98aad29199588a6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fcbe4ed80f09473e98aad29199588a6c"}]}] Apr 19 16:36:13 user devstack@n-api.service[61473]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1058072018 Apr 19 16:36:13 user devstack@n-api.service[61473]: X-Tenant-Id: fcbe4ed80f09473e98aad29199588a6c Apr 19 16:36:13 user devstack@n-api.service[61473]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1058072018 Apr 19 16:36:13 user devstack@n-api.service[61473]: X-User: tempest-AttachSCSIVolumeTestJSON-1058072018-project-member Apr 19 16:36:13 user devstack@n-api.service[61473]: X-User-Domain-Id: default Apr 19 16:36:13 user devstack@n-api.service[61473]: X-User-Domain-Name: Default Apr 19 16:36:13 user devstack@n-api.service[61473]: X-User-Id: 467f608512c4451fb461a5c495bbc9f1 Apr 19 16:36:13 user devstack@n-api.service[61473]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1058072018-project-member Apr 19 16:36:13 user devstack@n-api.service[61473]: method: > Apr 19 16:36:13 user devstack@n-api.service[61473]: exception: Instance f9885d3d-e74d-4250-b096-0df5dde6f3cd could not be found. Apr 19 16:36:13 user devstack@n-api.service[61473]: action_args: {'id': 'f9885d3d-e74d-4250-b096-0df5dde6f3cd'} Apr 19 16:36:13 user devstack@n-api.service[61473]: {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:36:13 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:36:13 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:36:13 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:36:13 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:36:13 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:36:13 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:36:13 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:36:13 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:36:13 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:36:13 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9885d3d-e74d-4250-b096-0df5dde6f3cd could not be found. Apr 19 16:36:13 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:36:13 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:36:13 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:36:13 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:36:13 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:36:13 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:36:13 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:36:13 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:36:13 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:36:13 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:36:13 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 19 16:36:13 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 19 16:36:13 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 19 16:36:13 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 19 16:36:13 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:36:13 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:36:13 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:36:13 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:36:13 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9885d3d-e74d-4250-b096-0df5dde6f3cd could not be found. Apr 19 16:36:13 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:36:13 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:36:13 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:36:13 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:36:13 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:36:13 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:36:13 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:36:13 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:36:13 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9885d3d-e74d-4250-b096-0df5dde6f3cd could not be found. Apr 19 16:36:13 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:36:13 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-5dc95854-4e2e-4d31-b965-cef74f34c707 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Returning 404 to user: Instance f9885d3d-e74d-4250-b096-0df5dde6f3cd could not be found. {{(pid=61473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:36:13 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-5dc95854-4e2e-4d31-b965-cef74f34c707 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f9885d3d-e74d-4250-b096-0df5dde6f3cd" status: 404 len: 111 microversion: 2.1 time: 0.033960 Apr 19 16:36:13 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 52/153] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 16:36:13 2023] DELETE /compute/v2.1/servers/f9885d3d-e74d-4250-b096-0df5dde6f3cd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 16:36:13 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-02ffd456-24ce-460a-83b3-5f99530a4da2 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:36:13 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-02ffd456-24ce-460a-83b3-5f99530a4da2 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] [instance: f9885d3d-e74d-4250-b096-0df5dde6f3cd] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:36:13 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-02ffd456-24ce-460a-83b3-5f99530a4da2 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:36:13 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-02ffd456-24ce-460a-83b3-5f99530a4da2 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:36:13 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-02ffd456-24ce-460a-83b3-5f99530a4da2 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:36:13 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-02ffd456-24ce-460a-83b3-5f99530a4da2 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:36:13 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-02ffd456-24ce-460a-83b3-5f99530a4da2 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:36:13 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-02ffd456-24ce-460a-83b3-5f99530a4da2 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:36:13 user devstack@n-api.service[61472]: INFO nova.api.openstack.wsgi [None req-02ffd456-24ce-460a-83b3-5f99530a4da2 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] HTTP exception thrown: Instance f9885d3d-e74d-4250-b096-0df5dde6f3cd could not be found. Apr 19 16:36:13 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-02ffd456-24ce-460a-83b3-5f99530a4da2 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Request method failure captured: Apr 19 16:36:13 user devstack@n-api.service[61472]: request: GET /compute/v2.1/servers/f9885d3d-e74d-4250-b096-0df5dde6f3cd HTTP/1.1 Apr 19 16:36:13 user devstack@n-api.service[61472]: Accept: application/json Apr 19 16:36:13 user devstack@n-api.service[61472]: Accept-Encoding: identity Apr 19 16:36:13 user devstack@n-api.service[61472]: Connection: close Apr 19 16:36:13 user devstack@n-api.service[61472]: Content-Length: 0 Apr 19 16:36:13 user devstack@n-api.service[61472]: Content-Type: application/json Apr 19 16:36:13 user devstack@n-api.service[61472]: Host: 10.0.0.210 Apr 19 16:36:13 user devstack@n-api.service[61472]: Openstack-System-Scope: None Apr 19 16:36:13 user devstack@n-api.service[61472]: User-Agent: python-urllib3/1.26.15 Apr 19 16:36:13 user devstack@n-api.service[61472]: X-Auth-Token: gAAAAABkQBe4DFVIzZZLrFnGX2g438rC96IFGAO20y23hfy45zLAwcuO6K3mUO33vT8slUbG_r8YqnANgyuBm63I2rxLkrlJ048mwt6uzzT918nIyHHRTjOJYUUB4IeFOb5FcaDuWGioBdoSWE40M9buCMGt4cDFeN6_pMg2TSVz75l5xdjN7i8 Apr 19 16:36:13 user devstack@n-api.service[61472]: X-Domain-Id: None Apr 19 16:36:13 user devstack@n-api.service[61472]: X-Domain-Name: None Apr 19 16:36:13 user devstack@n-api.service[61472]: X-Identity-Status: Confirmed Apr 19 16:36:13 user devstack@n-api.service[61472]: X-Is-Admin-Project: True Apr 19 16:36:13 user devstack@n-api.service[61472]: X-Project-Domain-Id: default Apr 19 16:36:13 user devstack@n-api.service[61472]: X-Project-Domain-Name: Default Apr 19 16:36:13 user devstack@n-api.service[61472]: X-Project-Id: fcbe4ed80f09473e98aad29199588a6c Apr 19 16:36:13 user devstack@n-api.service[61472]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1058072018 Apr 19 16:36:13 user devstack@n-api.service[61472]: X-Role: member,reader Apr 19 16:36:13 user devstack@n-api.service[61472]: X-Roles: member,reader Apr 19 16:36:13 user devstack@n-api.service[61472]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fcbe4ed80f09473e98aad29199588a6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fcbe4ed80f09473e98aad29199588a6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fcbe4ed80f09473e98aad29199588a6c"}]}] Apr 19 16:36:13 user devstack@n-api.service[61472]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1058072018 Apr 19 16:36:13 user devstack@n-api.service[61472]: X-Tenant-Id: fcbe4ed80f09473e98aad29199588a6c Apr 19 16:36:13 user devstack@n-api.service[61472]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1058072018 Apr 19 16:36:13 user devstack@n-api.service[61472]: X-User: tempest-AttachSCSIVolumeTestJSON-1058072018-project-member Apr 19 16:36:13 user devstack@n-api.service[61472]: X-User-Domain-Id: default Apr 19 16:36:13 user devstack@n-api.service[61472]: X-User-Domain-Name: Default Apr 19 16:36:13 user devstack@n-api.service[61472]: X-User-Id: 467f608512c4451fb461a5c495bbc9f1 Apr 19 16:36:13 user devstack@n-api.service[61472]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1058072018-project-member Apr 19 16:36:13 user devstack@n-api.service[61472]: method: > Apr 19 16:36:13 user devstack@n-api.service[61472]: exception: Instance f9885d3d-e74d-4250-b096-0df5dde6f3cd could not be found. Apr 19 16:36:13 user devstack@n-api.service[61472]: action_args: {'id': 'f9885d3d-e74d-4250-b096-0df5dde6f3cd'} Apr 19 16:36:13 user devstack@n-api.service[61472]: {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:36:13 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:36:13 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:36:13 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:36:13 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:36:13 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:36:13 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:36:13 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:36:13 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:36:13 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:36:13 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9885d3d-e74d-4250-b096-0df5dde6f3cd could not be found. Apr 19 16:36:13 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:36:13 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:36:13 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:36:13 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:36:13 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:36:13 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:36:13 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:36:13 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:36:13 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:36:13 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:36:13 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 16:36:13 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 16:36:13 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:36:13 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:36:13 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:36:13 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:36:13 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9885d3d-e74d-4250-b096-0df5dde6f3cd could not be found. Apr 19 16:36:13 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:36:13 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:36:13 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:36:13 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:36:13 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:36:13 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:36:13 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:36:13 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:36:13 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9885d3d-e74d-4250-b096-0df5dde6f3cd could not be found. Apr 19 16:36:13 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:36:13 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-02ffd456-24ce-460a-83b3-5f99530a4da2 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] Returning 404 to user: Instance f9885d3d-e74d-4250-b096-0df5dde6f3cd could not be found. {{(pid=61472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:36:13 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-02ffd456-24ce-460a-83b3-5f99530a4da2 tempest-AttachSCSIVolumeTestJSON-1058072018 tempest-AttachSCSIVolumeTestJSON-1058072018-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f9885d3d-e74d-4250-b096-0df5dde6f3cd" status: 404 len: 111 microversion: 2.1 time: 0.034441 Apr 19 16:36:13 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 50/154] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:36:13 2023] GET /compute/v2.1/servers/f9885d3d-e74d-4250-b096-0df5dde6f3cd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 16:36:32 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:36:32 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-7a1a0cad-72d4-4a2d-9b92-e1d11634fd04 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:36:32 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-7a1a0cad-72d4-4a2d-9b92-e1d11634fd04 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] [instance: 7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:36:32 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-7a1a0cad-72d4-4a2d-9b92-e1d11634fd04 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:36:32 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-7a1a0cad-72d4-4a2d-9b92-e1d11634fd04 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:36:32 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-7a1a0cad-72d4-4a2d-9b92-e1d11634fd04 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:36:32 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-7a1a0cad-72d4-4a2d-9b92-e1d11634fd04 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:36:32 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-7a1a0cad-72d4-4a2d-9b92-e1d11634fd04 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:36:32 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-7a1a0cad-72d4-4a2d-9b92-e1d11634fd04 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:36:32 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-7a1a0cad-72d4-4a2d-9b92-e1d11634fd04 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d089267c6a4a1391bb89ae66b49da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a63d3a9c6774bba8f276846597e24ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:36:32 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-7a1a0cad-72d4-4a2d-9b92-e1d11634fd04 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18" status: 200 len: 1492 microversion: 2.1 time: 0.255331 Apr 19 16:36:32 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 53/155] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:36:32 2023] GET /compute/v2.1/servers/7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18 => generated 1492 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:36:33 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-c3df7ea6-fd60-4808-9d46-4861b567b540 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:36:33 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-c3df7ea6-fd60-4808-9d46-4861b567b540 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] [instance: 01b50b56-31d2-4143-8585-63713d1bc7e9] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:36:33 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_api:SELECT=4 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:36:33 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell1:SELECT=8 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:36:33 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-c3df7ea6-fd60-4808-9d46-4861b567b540 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:36:33 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-c3df7ea6-fd60-4808-9d46-4861b567b540 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:36:33 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-c3df7ea6-fd60-4808-9d46-4861b567b540 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:36:33 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-c3df7ea6-fd60-4808-9d46-4861b567b540 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:36:33 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-c3df7ea6-fd60-4808-9d46-4861b567b540 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:36:33 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-c3df7ea6-fd60-4808-9d46-4861b567b540 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:36:33 user devstack@n-api.service[61473]: INFO nova.api.openstack.wsgi [None req-c3df7ea6-fd60-4808-9d46-4861b567b540 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] HTTP exception thrown: Instance 01b50b56-31d2-4143-8585-63713d1bc7e9 could not be found. Apr 19 16:36:33 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-c3df7ea6-fd60-4808-9d46-4861b567b540 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Request method failure captured: Apr 19 16:36:33 user devstack@n-api.service[61473]: request: GET /compute/v2.1/servers/01b50b56-31d2-4143-8585-63713d1bc7e9 HTTP/1.1 Apr 19 16:36:33 user devstack@n-api.service[61473]: Accept: application/json Apr 19 16:36:33 user devstack@n-api.service[61473]: Accept-Encoding: identity Apr 19 16:36:33 user devstack@n-api.service[61473]: Connection: close Apr 19 16:36:33 user devstack@n-api.service[61473]: Content-Length: 0 Apr 19 16:36:33 user devstack@n-api.service[61473]: Content-Type: application/json Apr 19 16:36:33 user devstack@n-api.service[61473]: Host: 10.0.0.210 Apr 19 16:36:33 user devstack@n-api.service[61473]: Openstack-System-Scope: None Apr 19 16:36:33 user devstack@n-api.service[61473]: User-Agent: python-urllib3/1.26.15 Apr 19 16:36:33 user devstack@n-api.service[61473]: X-Auth-Token: gAAAAABkQBfpQ-u-azfabAlvotj0rQjoBYSAwwdbtalXo97-1uWGtb-3J70LWqoYyULHaD5-r8Tw0_rmwdlFubJ2wHduR88gko_stfx0p648gbrxtRIcpHqSgPOdGIA_3JZ8n9JlBb7qsFOzOpr_00QdyDu_86yRrH-UlS-aylJh1eEy92_ONQM Apr 19 16:36:33 user devstack@n-api.service[61473]: X-Domain-Id: None Apr 19 16:36:33 user devstack@n-api.service[61473]: X-Domain-Name: None Apr 19 16:36:33 user devstack@n-api.service[61473]: X-Identity-Status: Confirmed Apr 19 16:36:33 user devstack@n-api.service[61473]: X-Is-Admin-Project: True Apr 19 16:36:33 user devstack@n-api.service[61473]: X-Openstack-Nova-Api-Version: 2.20 Apr 19 16:36:33 user devstack@n-api.service[61473]: X-Project-Domain-Id: default Apr 19 16:36:33 user devstack@n-api.service[61473]: X-Project-Domain-Name: Default Apr 19 16:36:33 user devstack@n-api.service[61473]: X-Project-Id: d29a717b7f334af5a35d9e86c3d4b085 Apr 19 16:36:33 user devstack@n-api.service[61473]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1882422304 Apr 19 16:36:33 user devstack@n-api.service[61473]: X-Role: member,reader Apr 19 16:36:33 user devstack@n-api.service[61473]: X-Roles: member,reader Apr 19 16:36:33 user devstack@n-api.service[61473]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d29a717b7f334af5a35d9e86c3d4b085"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d29a717b7f334af5a35d9e86c3d4b085"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d29a717b7f334af5a35d9e86c3d4b085"}]}] Apr 19 16:36:33 user devstack@n-api.service[61473]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1882422304 Apr 19 16:36:33 user devstack@n-api.service[61473]: X-Tenant-Id: d29a717b7f334af5a35d9e86c3d4b085 Apr 19 16:36:33 user devstack@n-api.service[61473]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1882422304 Apr 19 16:36:33 user devstack@n-api.service[61473]: X-User: tempest-AttachVolumeShelveTestJSON-1882422304-project-member Apr 19 16:36:33 user devstack@n-api.service[61473]: X-User-Domain-Id: default Apr 19 16:36:33 user devstack@n-api.service[61473]: X-User-Domain-Name: Default Apr 19 16:36:33 user devstack@n-api.service[61473]: X-User-Id: 34afcb1cb8d2433b9564e5b62b45fe86 Apr 19 16:36:33 user devstack@n-api.service[61473]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1882422304-project-member Apr 19 16:36:33 user devstack@n-api.service[61473]: method: > Apr 19 16:36:33 user devstack@n-api.service[61473]: exception: Instance 01b50b56-31d2-4143-8585-63713d1bc7e9 could not be found. Apr 19 16:36:33 user devstack@n-api.service[61473]: action_args: {'id': '01b50b56-31d2-4143-8585-63713d1bc7e9'} Apr 19 16:36:33 user devstack@n-api.service[61473]: {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:36:33 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:36:33 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:36:33 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:36:33 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:36:33 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:36:33 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:36:33 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:36:33 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:36:33 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:36:33 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01b50b56-31d2-4143-8585-63713d1bc7e9 could not be found. Apr 19 16:36:33 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:36:33 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:36:33 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:36:33 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:36:33 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:36:33 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:36:33 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:36:33 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:36:33 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:36:33 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:36:33 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 16:36:33 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 16:36:33 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:36:33 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:36:33 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:36:33 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:36:33 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01b50b56-31d2-4143-8585-63713d1bc7e9 could not be found. Apr 19 16:36:33 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:36:33 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:36:33 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:36:33 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:36:33 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:36:33 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:36:33 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:36:33 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:36:33 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01b50b56-31d2-4143-8585-63713d1bc7e9 could not be found. Apr 19 16:36:33 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:36:33 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-c3df7ea6-fd60-4808-9d46-4861b567b540 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Returning 404 to user: Instance 01b50b56-31d2-4143-8585-63713d1bc7e9 could not be found. {{(pid=61473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:36:33 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-c3df7ea6-fd60-4808-9d46-4861b567b540 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/01b50b56-31d2-4143-8585-63713d1bc7e9" status: 404 len: 111 microversion: 2.20 time: 0.032845 Apr 19 16:36:33 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 53/156] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 16:36:33 2023] GET /compute/v2.1/servers/01b50b56-31d2-4143-8585-63713d1bc7e9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 16:36:33 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-242b5725-be37-4e09-a5e1-ca53560d8f16 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Calling method '.version_select at 0x7fd4980839a0>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:36:33 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_api:SELECT=4 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:36:33 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell1:SELECT=4 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:36:33 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-242b5725-be37-4e09-a5e1-ca53560d8f16 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-168235150" status: 204 len: 0 microversion: 2.20 time: 0.030806 Apr 19 16:36:33 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 51/157] 10.0.0.210 () {64 vars in 1336 bytes} [Wed Apr 19 16:36:33 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-168235150 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 19 16:36:33 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-7c7b881d-8fe5-401e-bc36-d5f08b1c6b51 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Action: 'create', calling method: .version_select at 0x7fd4971a5bd0>, body: {"keypair": {"name": "tempest-keypair-379264232", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIo1xk/CSH6mBOXtTYVUD6aNvblvxobZ4IEELsSO/uDs87OlJ8khKiOXZLQwWBIUVn7I/1ZsMV/nWtSSiMaFVNrYYOzbhiv+yb5wBC/s+Vb9/1E5hq29B/NibZNKB7pMTw=="}} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:36:33 user devstack@n-api.service[61471]: DEBUG nova.quota [None req-7c7b881d-8fe5-401e-bc36-d5f08b1c6b51 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Getting quotas for project d29a717b7f334af5a35d9e86c3d4b085. Resources: {'key_pairs'} {{(pid=61471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 16:36:33 user devstack@n-api.service[61471]: DEBUG nova.quota [None req-7c7b881d-8fe5-401e-bc36-d5f08b1c6b51 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Getting quotas for user 34afcb1cb8d2433b9564e5b62b45fe86 and project d29a717b7f334af5a35d9e86c3d4b085. Resources: {'key_pairs'} {{(pid=61471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 16:36:33 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-7c7b881d-8fe5-401e-bc36-d5f08b1c6b51 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.047236 Apr 19 16:36:33 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 54/158] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 19 16:36:33 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 19 16:36:35 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-2357ccb0-fdfb-427d-9f3c-92c691b76307 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-396845578", "imageRef": "ab56c4b1-0117-43b0-84b6-28d06a23f182", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "df1f9af5-f53b-47e4-b42a-55402d78b5c2"}], "security_groups": [{"name": "tempest-securitygroup--899606344"}], "key_name": "tempest-keypair-379264232", "user_data": "}} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:36:36 user devstack@n-api.service[61473]: DEBUG nova.network.neutron [None req-2357ccb0-fdfb-427d-9f3c-92c691b76307 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] validate_networks() for [('df1f9af5-f53b-47e4-b42a-55402d78b5c2', None, None, None, None, None)] {{(pid=61473) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 16:36:36 user devstack@n-api.service[61473]: DEBUG nova.virt.hardware [None req-2357ccb0-fdfb-427d-9f3c-92c691b76307 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Flavor limits 0:0:0 {{(pid=61473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 16:36:36 user devstack@n-api.service[61473]: DEBUG nova.virt.hardware [None req-2357ccb0-fdfb-427d-9f3c-92c691b76307 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Image limits 0:0:0 {{(pid=61473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 16:36:36 user devstack@n-api.service[61473]: DEBUG nova.virt.hardware [None req-2357ccb0-fdfb-427d-9f3c-92c691b76307 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Flavor pref 0:0:0 {{(pid=61473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 16:36:36 user devstack@n-api.service[61473]: DEBUG nova.virt.hardware [None req-2357ccb0-fdfb-427d-9f3c-92c691b76307 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Image pref 0:0:0 {{(pid=61473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 16:36:36 user devstack@n-api.service[61473]: DEBUG nova.virt.hardware [None req-2357ccb0-fdfb-427d-9f3c-92c691b76307 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 16:36:36 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-2357ccb0-fdfb-427d-9f3c-92c691b76307 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:36:36 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-2357ccb0-fdfb-427d-9f3c-92c691b76307 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:36:36 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-2357ccb0-fdfb-427d-9f3c-92c691b76307 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:36:36 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-2357ccb0-fdfb-427d-9f3c-92c691b76307 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:36:36 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-2357ccb0-fdfb-427d-9f3c-92c691b76307 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:36:36 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-2357ccb0-fdfb-427d-9f3c-92c691b76307 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:36:36 user devstack@n-api.service[61473]: DEBUG nova.quota [None req-2357ccb0-fdfb-427d-9f3c-92c691b76307 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Getting quotas for project d29a717b7f334af5a35d9e86c3d4b085. Resources: {'instances', 'ram', 'cores'} {{(pid=61473) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 16:36:36 user devstack@n-api.service[61473]: DEBUG nova.quota [None req-2357ccb0-fdfb-427d-9f3c-92c691b76307 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Getting quotas for user 34afcb1cb8d2433b9564e5b62b45fe86 and project d29a717b7f334af5a35d9e86c3d4b085. Resources: {'instances', 'ram', 'cores'} {{(pid=61473) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 16:36:36 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-2357ccb0-fdfb-427d-9f3c-92c691b76307 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Going to run 1 instances... {{(pid=61473) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 16:36:36 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-2357ccb0-fdfb-427d-9f3c-92c691b76307 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] [instance: c513f20d-c24e-4270-a28e-5374940abf6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ab56c4b1-0117-43b0-84b6-28d06a23f182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61473) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 16:36:36 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-2357ccb0-fdfb-427d-9f3c-92c691b76307 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.663830 Apr 19 16:36:36 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 54/159] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 19 16:36:35 2023] POST /compute/v2.1/servers => generated 399 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 19 16:36:36 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-f723cde5-3eb6-4a6e-a164-e9cb3e497618 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:36:36 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-f723cde5-3eb6-4a6e-a164-e9cb3e497618 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] [instance: c513f20d-c24e-4270-a28e-5374940abf6f] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:36:36 user devstack@n-api.service[61472]: DEBUG nova.policy [None req-f723cde5-3eb6-4a6e-a164-e9cb3e497618 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34afcb1cb8d2433b9564e5b62b45fe86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29a717b7f334af5a35d9e86c3d4b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61472) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:36:36 user devstack@n-api.service[61472]: DEBUG nova.policy [None req-f723cde5-3eb6-4a6e-a164-e9cb3e497618 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34afcb1cb8d2433b9564e5b62b45fe86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29a717b7f334af5a35d9e86c3d4b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61472) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:36:36 user devstack@n-api.service[61472]: DEBUG nova.policy [None req-f723cde5-3eb6-4a6e-a164-e9cb3e497618 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34afcb1cb8d2433b9564e5b62b45fe86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29a717b7f334af5a35d9e86c3d4b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61472) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:36:36 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-f723cde5-3eb6-4a6e-a164-e9cb3e497618 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c513f20d-c24e-4270-a28e-5374940abf6f" status: 200 len: 1274 microversion: 2.20 time: 0.075951 Apr 19 16:36:36 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 52/160] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 16:36:36 2023] GET /compute/v2.1/servers/c513f20d-c24e-4270-a28e-5374940abf6f => generated 1274 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 16:36:39 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [req-17a32204-4aec-4a3f-a4b7-035f79109ad0 req-081a48df-f006-4ebb-b4b3-70e6f3f9f2e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c513f20d-c24e-4270-a28e-5374940abf6f", "tag": "05399020-7272-4195-8ffc-8524c79dbbb8"}]} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:36:39 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-17a32204-4aec-4a3f-a4b7-035f79109ad0 req-081a48df-f006-4ebb-b4b3-70e6f3f9f2e7 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:36:39 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-17a32204-4aec-4a3f-a4b7-035f79109ad0 req-081a48df-f006-4ebb-b4b3-70e6f3f9f2e7 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:36:39 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-17a32204-4aec-4a3f-a4b7-035f79109ad0 req-081a48df-f006-4ebb-b4b3-70e6f3f9f2e7 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:36:39 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-17a32204-4aec-4a3f-a4b7-035f79109ad0 req-081a48df-f006-4ebb-b4b3-70e6f3f9f2e7 service nova] Creating event network-changed:05399020-7272-4195-8ffc-8524c79dbbb8 for instance c513f20d-c24e-4270-a28e-5374940abf6f on user Apr 19 16:36:39 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [req-17a32204-4aec-4a3f-a4b7-035f79109ad0 req-081a48df-f006-4ebb-b4b3-70e6f3f9f2e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030176 Apr 19 16:36:39 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 55/161] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:36:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:36:39 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-f889aaf1-e2a4-4589-b7dd-ed3edf201971 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:36:39 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-f889aaf1-e2a4-4589-b7dd-ed3edf201971 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] [instance: 795900b6-2c41-403e-9023-2ee74e755f5e] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:36:39 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-f889aaf1-e2a4-4589-b7dd-ed3edf201971 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:36:39 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-f889aaf1-e2a4-4589-b7dd-ed3edf201971 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:36:39 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-f889aaf1-e2a4-4589-b7dd-ed3edf201971 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:36:39 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-f889aaf1-e2a4-4589-b7dd-ed3edf201971 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:36:39 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-f889aaf1-e2a4-4589-b7dd-ed3edf201971 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:36:39 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-f889aaf1-e2a4-4589-b7dd-ed3edf201971 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:36:40 user devstack@n-api.service[61473]: DEBUG nova.policy [None req-f889aaf1-e2a4-4589-b7dd-ed3edf201971 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2563be52f624ceab060942e8bfcedef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ceccc36de46f780e55a02f25782f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61473) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:36:40 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-f889aaf1-e2a4-4589-b7dd-ed3edf201971 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] 10.0.0.210 "GET /compute/v2.1/servers/795900b6-2c41-403e-9023-2ee74e755f5e" status: 200 len: 1545 microversion: 2.1 time: 0.331627 Apr 19 16:36:40 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 55/162] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:36:39 2023] GET /compute/v2.1/servers/795900b6-2c41-403e-9023-2ee74e755f5e => generated 1545 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:36:41 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [req-f064d1b1-5d09-4fa0-b847-24c79f883562 req-aa61754b-8f81-49cd-a362-738ea9900039 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c513f20d-c24e-4270-a28e-5374940abf6f", "name": "network-vif-plugged", "status": "completed", "tag": "05399020-7272-4195-8ffc-8524c79dbbb8"}]} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:36:41 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-f064d1b1-5d09-4fa0-b847-24c79f883562 req-aa61754b-8f81-49cd-a362-738ea9900039 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:36:41 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-f064d1b1-5d09-4fa0-b847-24c79f883562 req-aa61754b-8f81-49cd-a362-738ea9900039 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:36:41 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-f064d1b1-5d09-4fa0-b847-24c79f883562 req-aa61754b-8f81-49cd-a362-738ea9900039 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:36:41 user devstack@n-api.service[61472]: INFO nova.api.openstack.compute.server_external_events [req-f064d1b1-5d09-4fa0-b847-24c79f883562 req-aa61754b-8f81-49cd-a362-738ea9900039 service nova] Creating event network-vif-plugged:05399020-7272-4195-8ffc-8524c79dbbb8 for instance c513f20d-c24e-4270-a28e-5374940abf6f on user Apr 19 16:36:41 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [req-f064d1b1-5d09-4fa0-b847-24c79f883562 req-aa61754b-8f81-49cd-a362-738ea9900039 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053913 Apr 19 16:36:41 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 53/163] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:36:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:36:43 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [req-bc878e95-0d7e-4a4f-93f5-a158a3b760a7 req-b91d37ed-4cc0-4be8-a054-f2b1831cc679 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c513f20d-c24e-4270-a28e-5374940abf6f", "name": "network-vif-plugged", "status": "completed", "tag": "05399020-7272-4195-8ffc-8524c79dbbb8"}]} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:36:43 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-bc878e95-0d7e-4a4f-93f5-a158a3b760a7 req-b91d37ed-4cc0-4be8-a054-f2b1831cc679 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:36:43 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-bc878e95-0d7e-4a4f-93f5-a158a3b760a7 req-b91d37ed-4cc0-4be8-a054-f2b1831cc679 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:36:43 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-bc878e95-0d7e-4a4f-93f5-a158a3b760a7 req-b91d37ed-4cc0-4be8-a054-f2b1831cc679 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:36:43 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-bc878e95-0d7e-4a4f-93f5-a158a3b760a7 req-b91d37ed-4cc0-4be8-a054-f2b1831cc679 service nova] Creating event network-vif-plugged:05399020-7272-4195-8ffc-8524c79dbbb8 for instance c513f20d-c24e-4270-a28e-5374940abf6f on user Apr 19 16:36:43 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [req-bc878e95-0d7e-4a4f-93f5-a158a3b760a7 req-b91d37ed-4cc0-4be8-a054-f2b1831cc679 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028387 Apr 19 16:36:43 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 56/164] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:36:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:36:43 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-be09b145-8a8a-43d7-af2b-7ce1c0dccc9e tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:36:43 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-be09b145-8a8a-43d7-af2b-7ce1c0dccc9e tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] [instance: edd2688e-940e-4ab3-b27c-b6d4aab3efc5] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:36:43 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-be09b145-8a8a-43d7-af2b-7ce1c0dccc9e tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:36:43 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-be09b145-8a8a-43d7-af2b-7ce1c0dccc9e tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:36:43 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-be09b145-8a8a-43d7-af2b-7ce1c0dccc9e tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:36:43 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-be09b145-8a8a-43d7-af2b-7ce1c0dccc9e tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:36:43 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-be09b145-8a8a-43d7-af2b-7ce1c0dccc9e tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:36:43 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-be09b145-8a8a-43d7-af2b-7ce1c0dccc9e tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:36:44 user devstack@n-api.service[61473]: DEBUG nova.policy [None req-be09b145-8a8a-43d7-af2b-7ce1c0dccc9e tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023314f8cf79430b83c5184d9a54be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78962d13860a4df3a8aa100e2afaca6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61473) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:36:44 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-be09b145-8a8a-43d7-af2b-7ce1c0dccc9e tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] 10.0.0.210 "GET /compute/v2.1/servers/edd2688e-940e-4ab3-b27c-b6d4aab3efc5" status: 200 len: 1541 microversion: 2.1 time: 0.253004 Apr 19 16:36:44 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 56/165] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:36:43 2023] GET /compute/v2.1/servers/edd2688e-940e-4ab3-b27c-b6d4aab3efc5 => generated 1541 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:36:51 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell0:SELECT=2 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:36:51 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:36:51 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell1:SELECT=2 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:36:51 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-fc569c21-cdd9-49ed-a348-e32b2fa69150 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1490937709", "imageRef": "ab56c4b1-0117-43b0-84b6-28d06a23f182", "flavorRef": "42", "networks": [{"uuid": "bdc7f4b4-1167-484c-ab08-77c4f58bf2f6"}]}} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:36:51 user devstack@n-api.service[61472]: DEBUG nova.network.neutron [None req-fc569c21-cdd9-49ed-a348-e32b2fa69150 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] validate_networks() for [('bdc7f4b4-1167-484c-ab08-77c4f58bf2f6', None, None, None, None, None)] {{(pid=61472) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 16:36:52 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-fc569c21-cdd9-49ed-a348-e32b2fa69150 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Flavor limits 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 16:36:52 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-fc569c21-cdd9-49ed-a348-e32b2fa69150 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Image limits 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 16:36:52 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-fc569c21-cdd9-49ed-a348-e32b2fa69150 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Flavor pref 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 16:36:52 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-fc569c21-cdd9-49ed-a348-e32b2fa69150 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Image pref 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 16:36:52 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-fc569c21-cdd9-49ed-a348-e32b2fa69150 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 16:36:52 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-fc569c21-cdd9-49ed-a348-e32b2fa69150 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:36:52 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-fc569c21-cdd9-49ed-a348-e32b2fa69150 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:36:52 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-fc569c21-cdd9-49ed-a348-e32b2fa69150 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:36:52 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-fc569c21-cdd9-49ed-a348-e32b2fa69150 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:36:52 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-fc569c21-cdd9-49ed-a348-e32b2fa69150 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:36:52 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-fc569c21-cdd9-49ed-a348-e32b2fa69150 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:36:52 user devstack@n-api.service[61472]: DEBUG nova.quota [None req-fc569c21-cdd9-49ed-a348-e32b2fa69150 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Getting quotas for project e58ee4833fd147e2a494be5d7634a2fa. Resources: {'instances', 'ram', 'cores'} {{(pid=61472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 16:36:52 user devstack@n-api.service[61472]: DEBUG nova.quota [None req-fc569c21-cdd9-49ed-a348-e32b2fa69150 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Getting quotas for user 63f2a02626ca4957823de39c9a31d1b8 and project e58ee4833fd147e2a494be5d7634a2fa. Resources: {'instances', 'ram', 'cores'} {{(pid=61472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 16:36:52 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-fc569c21-cdd9-49ed-a348-e32b2fa69150 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Going to run 1 instances... {{(pid=61472) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 16:36:52 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-fc569c21-cdd9-49ed-a348-e32b2fa69150 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] [instance: 269dc247-e424-4102-9c7f-1f3da95afebf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ab56c4b1-0117-43b0-84b6-28d06a23f182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 16:36:52 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-fc569c21-cdd9-49ed-a348-e32b2fa69150 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.643617 Apr 19 16:36:52 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 54/166] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 19 16:36:51 2023] POST /compute/v2.1/servers => generated 378 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 19 16:36:52 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell0:SELECT=4 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:36:52 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-d2b8c042-2228-458e-81e7-22ab69c69065 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:36:52 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-d2b8c042-2228-458e-81e7-22ab69c69065 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] [instance: 269dc247-e424-4102-9c7f-1f3da95afebf] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:36:52 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-d2b8c042-2228-458e-81e7-22ab69c69065 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f2a02626ca4957823de39c9a31d1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ee4833fd147e2a494be5d7634a2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:36:52 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-d2b8c042-2228-458e-81e7-22ab69c69065 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63f2a02626ca4957823de39c9a31d1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ee4833fd147e2a494be5d7634a2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:36:52 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-d2b8c042-2228-458e-81e7-22ab69c69065 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63f2a02626ca4957823de39c9a31d1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ee4833fd147e2a494be5d7634a2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:36:52 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-d2b8c042-2228-458e-81e7-22ab69c69065 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] 10.0.0.210 "GET /compute/v2.1/servers/269dc247-e424-4102-9c7f-1f3da95afebf" status: 200 len: 1395 microversion: 2.87 time: 0.099573 Apr 19 16:36:52 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 57/167] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 16:36:52 2023] GET /compute/v2.1/servers/269dc247-e424-4102-9c7f-1f3da95afebf => generated 1395 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 16:36:54 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-54e0bb3f-f093-4655-9320-3ce10789cee4 req-87126bc3-57bb-440e-9fc2-2fce3fe43498 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "269dc247-e424-4102-9c7f-1f3da95afebf", "tag": "23d34df8-c537-47b0-a008-5a0c4db98175"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:36:54 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell0:SELECT=2 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:36:54 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell0:SELECT=6 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:36:54 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:36:54 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell1:SELECT=16 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:36:54 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-54e0bb3f-f093-4655-9320-3ce10789cee4 req-87126bc3-57bb-440e-9fc2-2fce3fe43498 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:36:54 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-54e0bb3f-f093-4655-9320-3ce10789cee4 req-87126bc3-57bb-440e-9fc2-2fce3fe43498 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:36:54 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-54e0bb3f-f093-4655-9320-3ce10789cee4 req-87126bc3-57bb-440e-9fc2-2fce3fe43498 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:36:54 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-54e0bb3f-f093-4655-9320-3ce10789cee4 req-87126bc3-57bb-440e-9fc2-2fce3fe43498 service nova] Creating event network-changed:23d34df8-c537-47b0-a008-5a0c4db98175 for instance 269dc247-e424-4102-9c7f-1f3da95afebf on user Apr 19 16:36:54 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-54e0bb3f-f093-4655-9320-3ce10789cee4 req-87126bc3-57bb-440e-9fc2-2fce3fe43498 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042723 Apr 19 16:36:54 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 57/168] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:36:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:36:57 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [req-8c142ed0-a2ff-4f20-a505-46322850f0fe req-be13f15b-bd7d-473a-b9ff-adafec8cf07e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "269dc247-e424-4102-9c7f-1f3da95afebf", "name": "network-vif-plugged", "status": "completed", "tag": "23d34df8-c537-47b0-a008-5a0c4db98175"}]} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:36:57 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-8c142ed0-a2ff-4f20-a505-46322850f0fe req-be13f15b-bd7d-473a-b9ff-adafec8cf07e service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:36:57 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-8c142ed0-a2ff-4f20-a505-46322850f0fe req-be13f15b-bd7d-473a-b9ff-adafec8cf07e service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:36:57 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-8c142ed0-a2ff-4f20-a505-46322850f0fe req-be13f15b-bd7d-473a-b9ff-adafec8cf07e service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:36:57 user devstack@n-api.service[61472]: INFO nova.api.openstack.compute.server_external_events [req-8c142ed0-a2ff-4f20-a505-46322850f0fe req-be13f15b-bd7d-473a-b9ff-adafec8cf07e service nova] Creating event network-vif-plugged:23d34df8-c537-47b0-a008-5a0c4db98175 for instance 269dc247-e424-4102-9c7f-1f3da95afebf on user Apr 19 16:36:57 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [req-8c142ed0-a2ff-4f20-a505-46322850f0fe req-be13f15b-bd7d-473a-b9ff-adafec8cf07e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050255 Apr 19 16:36:57 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 55/169] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:36:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 16:36:59 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [req-9470e9ab-fc85-4862-826d-aa9dc843b07e req-ce2d625a-3b6c-46af-80b3-2e39483e0b68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "269dc247-e424-4102-9c7f-1f3da95afebf", "name": "network-vif-plugged", "status": "completed", "tag": "23d34df8-c537-47b0-a008-5a0c4db98175"}]} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:36:59 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell1:SELECT=10 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:36:59 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-9470e9ab-fc85-4862-826d-aa9dc843b07e req-ce2d625a-3b6c-46af-80b3-2e39483e0b68 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:36:59 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-9470e9ab-fc85-4862-826d-aa9dc843b07e req-ce2d625a-3b6c-46af-80b3-2e39483e0b68 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:36:59 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-9470e9ab-fc85-4862-826d-aa9dc843b07e req-ce2d625a-3b6c-46af-80b3-2e39483e0b68 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:36:59 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-9470e9ab-fc85-4862-826d-aa9dc843b07e req-ce2d625a-3b6c-46af-80b3-2e39483e0b68 service nova] Creating event network-vif-plugged:23d34df8-c537-47b0-a008-5a0c4db98175 for instance 269dc247-e424-4102-9c7f-1f3da95afebf on user Apr 19 16:36:59 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [req-9470e9ab-fc85-4862-826d-aa9dc843b07e req-ce2d625a-3b6c-46af-80b3-2e39483e0b68 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031538 Apr 19 16:36:59 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 58/170] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:36:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:37:11 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell1:SELECT=2 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:37:11 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_api:SELECT=2 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:37:11 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-b143f418-e51c-42bb-84e0-3bfdaf957835 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:37:11 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-b143f418-e51c-42bb-84e0-3bfdaf957835 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] [instance: 131e75dc-8c64-40b1-b21b-40210f4d5425] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:37:11 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-b143f418-e51c-42bb-84e0-3bfdaf957835 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:37:11 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-b143f418-e51c-42bb-84e0-3bfdaf957835 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:37:11 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-b143f418-e51c-42bb-84e0-3bfdaf957835 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:37:11 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-b143f418-e51c-42bb-84e0-3bfdaf957835 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:37:11 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-b143f418-e51c-42bb-84e0-3bfdaf957835 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:37:11 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-b143f418-e51c-42bb-84e0-3bfdaf957835 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:37:11 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-b143f418-e51c-42bb-84e0-3bfdaf957835 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] [instance: 131e75dc-8c64-40b1-b21b-40210f4d5425] Going to try to terminate instance {{(pid=61473) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 16:37:11 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-b143f418-e51c-42bb-84e0-3bfdaf957835 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/131e75dc-8c64-40b1-b21b-40210f4d5425" status: 204 len: 0 microversion: 2.1 time: 0.119764 Apr 19 16:37:11 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 58/171] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 16:37:11 2023] DELETE /compute/v2.1/servers/131e75dc-8c64-40b1-b21b-40210f4d5425 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 16:37:11 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell0:SELECT=2 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:37:11 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell0:SELECT=6 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:37:11 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:37:11 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell1:SELECT=4 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:37:11 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-ea4293c2-afe4-46c7-ab20-af4a035c3c34 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:37:11 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-ea4293c2-afe4-46c7-ab20-af4a035c3c34 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] [instance: 131e75dc-8c64-40b1-b21b-40210f4d5425] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:37:11 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-ea4293c2-afe4-46c7-ab20-af4a035c3c34 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:37:11 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-ea4293c2-afe4-46c7-ab20-af4a035c3c34 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:37:11 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-ea4293c2-afe4-46c7-ab20-af4a035c3c34 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:37:11 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-ea4293c2-afe4-46c7-ab20-af4a035c3c34 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:37:11 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-ea4293c2-afe4-46c7-ab20-af4a035c3c34 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:37:11 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-ea4293c2-afe4-46c7-ab20-af4a035c3c34 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:37:11 user devstack@n-api.service[61472]: DEBUG nova.policy [None req-ea4293c2-afe4-46c7-ab20-af4a035c3c34 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be99c3ba0554acda7b418f66a31c943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee32e72a51414422bfad5875f32b1515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61472) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:37:11 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-ea4293c2-afe4-46c7-ab20-af4a035c3c34 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] 10.0.0.210 "GET /compute/v2.1/servers/131e75dc-8c64-40b1-b21b-40210f4d5425" status: 200 len: 1500 microversion: 2.1 time: 0.246979 Apr 19 16:37:11 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 56/172] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:37:11 2023] GET /compute/v2.1/servers/131e75dc-8c64-40b1-b21b-40210f4d5425 => generated 1500 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:37:12 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell0:SELECT=2 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:37:12 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:37:12 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell1:SELECT=2 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:37:12 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [req-a6b61d58-8d23-4520-88a2-ffa89c9126a0 req-ebe6e42d-fe3c-464d-b444-ddd3bfe052b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "131e75dc-8c64-40b1-b21b-40210f4d5425", "name": "network-vif-unplugged", "status": "completed", "tag": "631b17c6-36e9-4d11-ad59-6e544f474a4c"}]} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:37:12 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-a6b61d58-8d23-4520-88a2-ffa89c9126a0 req-ebe6e42d-fe3c-464d-b444-ddd3bfe052b8 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:37:12 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-a6b61d58-8d23-4520-88a2-ffa89c9126a0 req-ebe6e42d-fe3c-464d-b444-ddd3bfe052b8 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:37:12 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-a6b61d58-8d23-4520-88a2-ffa89c9126a0 req-ebe6e42d-fe3c-464d-b444-ddd3bfe052b8 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:37:12 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-a6b61d58-8d23-4520-88a2-ffa89c9126a0 req-ebe6e42d-fe3c-464d-b444-ddd3bfe052b8 service nova] Creating event network-vif-unplugged:631b17c6-36e9-4d11-ad59-6e544f474a4c for instance 131e75dc-8c64-40b1-b21b-40210f4d5425 on user Apr 19 16:37:12 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [req-a6b61d58-8d23-4520-88a2-ffa89c9126a0 req-ebe6e42d-fe3c-464d-b444-ddd3bfe052b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038279 Apr 19 16:37:12 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 59/173] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:37:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:37:13 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-289c5c2d-56ea-47ed-99f1-0bcc764dda8c req-b451265a-1258-4b6d-89c4-6022637cffb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "131e75dc-8c64-40b1-b21b-40210f4d5425", "name": "network-vif-deleted", "tag": "631b17c6-36e9-4d11-ad59-6e544f474a4c"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:37:13 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-289c5c2d-56ea-47ed-99f1-0bcc764dda8c req-b451265a-1258-4b6d-89c4-6022637cffb0 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:37:13 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-289c5c2d-56ea-47ed-99f1-0bcc764dda8c req-b451265a-1258-4b6d-89c4-6022637cffb0 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:37:13 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-289c5c2d-56ea-47ed-99f1-0bcc764dda8c req-b451265a-1258-4b6d-89c4-6022637cffb0 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:37:13 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-289c5c2d-56ea-47ed-99f1-0bcc764dda8c req-b451265a-1258-4b6d-89c4-6022637cffb0 service nova] Creating event network-vif-deleted:631b17c6-36e9-4d11-ad59-6e544f474a4c for instance 131e75dc-8c64-40b1-b21b-40210f4d5425 on user Apr 19 16:37:13 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-289c5c2d-56ea-47ed-99f1-0bcc764dda8c req-b451265a-1258-4b6d-89c4-6022637cffb0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027802 Apr 19 16:37:13 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 59/174] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:37:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:37:14 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [req-6315e798-4d6a-47a6-ac3d-7aaab198e882 req-db370f78-0556-451f-b10f-0e76d84936a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "131e75dc-8c64-40b1-b21b-40210f4d5425", "name": "network-vif-plugged", "status": "completed", "tag": "631b17c6-36e9-4d11-ad59-6e544f474a4c"}]} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:37:14 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-6315e798-4d6a-47a6-ac3d-7aaab198e882 req-db370f78-0556-451f-b10f-0e76d84936a1 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:37:14 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-6315e798-4d6a-47a6-ac3d-7aaab198e882 req-db370f78-0556-451f-b10f-0e76d84936a1 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:37:14 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-6315e798-4d6a-47a6-ac3d-7aaab198e882 req-db370f78-0556-451f-b10f-0e76d84936a1 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:37:14 user devstack@n-api.service[61472]: INFO nova.api.openstack.compute.server_external_events [req-6315e798-4d6a-47a6-ac3d-7aaab198e882 req-db370f78-0556-451f-b10f-0e76d84936a1 service nova] Creating event network-vif-plugged:631b17c6-36e9-4d11-ad59-6e544f474a4c for instance 131e75dc-8c64-40b1-b21b-40210f4d5425 on user Apr 19 16:37:14 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [req-6315e798-4d6a-47a6-ac3d-7aaab198e882 req-db370f78-0556-451f-b10f-0e76d84936a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028372 Apr 19 16:37:14 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 57/175] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:37:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:37:26 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_api:SELECT=2 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:37:26 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell1:SELECT=2 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:37:26 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-bc792f5b-3672-4e3d-aa7e-96bbce751878 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:37:26 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-bc792f5b-3672-4e3d-aa7e-96bbce751878 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] [instance: c513f20d-c24e-4270-a28e-5374940abf6f] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:37:26 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-bc792f5b-3672-4e3d-aa7e-96bbce751878 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:37:26 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-bc792f5b-3672-4e3d-aa7e-96bbce751878 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:37:26 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-bc792f5b-3672-4e3d-aa7e-96bbce751878 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:37:26 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-bc792f5b-3672-4e3d-aa7e-96bbce751878 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:37:26 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-bc792f5b-3672-4e3d-aa7e-96bbce751878 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:37:26 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-bc792f5b-3672-4e3d-aa7e-96bbce751878 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:37:27 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-bc792f5b-3672-4e3d-aa7e-96bbce751878 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34afcb1cb8d2433b9564e5b62b45fe86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29a717b7f334af5a35d9e86c3d4b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:37:27 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-bc792f5b-3672-4e3d-aa7e-96bbce751878 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34afcb1cb8d2433b9564e5b62b45fe86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29a717b7f334af5a35d9e86c3d4b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:37:27 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-bc792f5b-3672-4e3d-aa7e-96bbce751878 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34afcb1cb8d2433b9564e5b62b45fe86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29a717b7f334af5a35d9e86c3d4b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:37:27 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-bc792f5b-3672-4e3d-aa7e-96bbce751878 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c513f20d-c24e-4270-a28e-5374940abf6f" status: 200 len: 1585 microversion: 2.20 time: 0.285936 Apr 19 16:37:27 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 60/176] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 16:37:26 2023] GET /compute/v2.1/servers/c513f20d-c24e-4270-a28e-5374940abf6f => generated 1585 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 16:37:32 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:37:32 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:37:32 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-e3fbbbd9-b142-458b-aa37-fc45433a19a3 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:37:32 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-e3fbbbd9-b142-458b-aa37-fc45433a19a3 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] [instance: 7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:37:32 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-e3fbbbd9-b142-458b-aa37-fc45433a19a3 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:37:32 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-e3fbbbd9-b142-458b-aa37-fc45433a19a3 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:37:32 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-e3fbbbd9-b142-458b-aa37-fc45433a19a3 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:37:32 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-e3fbbbd9-b142-458b-aa37-fc45433a19a3 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:37:32 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-e3fbbbd9-b142-458b-aa37-fc45433a19a3 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:37:32 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-e3fbbbd9-b142-458b-aa37-fc45433a19a3 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:37:32 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-e3fbbbd9-b142-458b-aa37-fc45433a19a3 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] [instance: 7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18] Going to try to terminate instance {{(pid=61473) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 16:37:32 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-e3fbbbd9-b142-458b-aa37-fc45433a19a3 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18" status: 204 len: 0 microversion: 2.1 time: 0.121876 Apr 19 16:37:32 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 60/177] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 16:37:32 2023] DELETE /compute/v2.1/servers/7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 16:37:32 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_api:SELECT=4 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:37:32 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell1:SELECT=8 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:37:32 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-0ecfd2c0-f2a1-4e25-b09b-4aa829c0b4f6 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:37:32 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-0ecfd2c0-f2a1-4e25-b09b-4aa829c0b4f6 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] [instance: 7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:37:32 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-0ecfd2c0-f2a1-4e25-b09b-4aa829c0b4f6 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:37:32 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-0ecfd2c0-f2a1-4e25-b09b-4aa829c0b4f6 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:37:32 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-0ecfd2c0-f2a1-4e25-b09b-4aa829c0b4f6 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:37:32 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-0ecfd2c0-f2a1-4e25-b09b-4aa829c0b4f6 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:37:32 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-0ecfd2c0-f2a1-4e25-b09b-4aa829c0b4f6 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:37:32 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-0ecfd2c0-f2a1-4e25-b09b-4aa829c0b4f6 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:37:32 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [req-5f3a9fcd-d34e-4f82-a3bd-66c852a196f3 req-8359fdbd-86a7-452e-b0ab-c4872f5a89ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18", "name": "network-vif-unplugged", "status": "completed", "tag": "5d73369b-1168-483b-9935-81ee93f63187"}]} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:37:32 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-5f3a9fcd-d34e-4f82-a3bd-66c852a196f3 req-8359fdbd-86a7-452e-b0ab-c4872f5a89ae service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:37:32 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-5f3a9fcd-d34e-4f82-a3bd-66c852a196f3 req-8359fdbd-86a7-452e-b0ab-c4872f5a89ae service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:37:32 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-5f3a9fcd-d34e-4f82-a3bd-66c852a196f3 req-8359fdbd-86a7-452e-b0ab-c4872f5a89ae service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:37:32 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-5f3a9fcd-d34e-4f82-a3bd-66c852a196f3 req-8359fdbd-86a7-452e-b0ab-c4872f5a89ae service nova] Creating event network-vif-unplugged:5d73369b-1168-483b-9935-81ee93f63187 for instance 7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18 on user Apr 19 16:37:32 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [req-5f3a9fcd-d34e-4f82-a3bd-66c852a196f3 req-8359fdbd-86a7-452e-b0ab-c4872f5a89ae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033894 Apr 19 16:37:32 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 61/178] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:37:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:37:32 user devstack@n-api.service[61472]: DEBUG nova.policy [None req-0ecfd2c0-f2a1-4e25-b09b-4aa829c0b4f6 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d089267c6a4a1391bb89ae66b49da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a63d3a9c6774bba8f276846597e24ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61472) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:37:32 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-0ecfd2c0-f2a1-4e25-b09b-4aa829c0b4f6 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18" status: 200 len: 1498 microversion: 2.1 time: 0.288198 Apr 19 16:37:32 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 58/179] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:37:32 2023] GET /compute/v2.1/servers/7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18 => generated 1498 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:37:34 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-75380b66-af9a-4ea1-9861-a2f2a8f49292 req-b98aa692-e836-4305-a231-e11260b50ce2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18", "name": "network-vif-plugged", "status": "completed", "tag": "5d73369b-1168-483b-9935-81ee93f63187"}, {"server_uuid": "7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18", "name": "network-vif-deleted", "tag": "5d73369b-1168-483b-9935-81ee93f63187"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:37:34 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-75380b66-af9a-4ea1-9861-a2f2a8f49292 req-b98aa692-e836-4305-a231-e11260b50ce2 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:37:34 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-75380b66-af9a-4ea1-9861-a2f2a8f49292 req-b98aa692-e836-4305-a231-e11260b50ce2 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:37:34 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-75380b66-af9a-4ea1-9861-a2f2a8f49292 req-b98aa692-e836-4305-a231-e11260b50ce2 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:37:34 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-75380b66-af9a-4ea1-9861-a2f2a8f49292 req-b98aa692-e836-4305-a231-e11260b50ce2 service nova] Creating event network-vif-plugged:5d73369b-1168-483b-9935-81ee93f63187 for instance 7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18 on user Apr 19 16:37:34 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-75380b66-af9a-4ea1-9861-a2f2a8f49292 req-b98aa692-e836-4305-a231-e11260b50ce2 service nova] Creating event network-vif-deleted:5d73369b-1168-483b-9935-81ee93f63187 for instance 7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18 on user Apr 19 16:37:34 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-75380b66-af9a-4ea1-9861-a2f2a8f49292 req-b98aa692-e836-4305-a231-e11260b50ce2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036289 Apr 19 16:37:34 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 61/180] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:37:34 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:37:40 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-95632fb2-fec6-4f7e-ab34-0f2113c44f3a tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:37:40 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-95632fb2-fec6-4f7e-ab34-0f2113c44f3a tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] [instance: 795900b6-2c41-403e-9023-2ee74e755f5e] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:37:40 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-95632fb2-fec6-4f7e-ab34-0f2113c44f3a tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:37:40 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-95632fb2-fec6-4f7e-ab34-0f2113c44f3a tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:37:40 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-95632fb2-fec6-4f7e-ab34-0f2113c44f3a tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:37:40 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-95632fb2-fec6-4f7e-ab34-0f2113c44f3a tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:37:40 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-95632fb2-fec6-4f7e-ab34-0f2113c44f3a tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:37:40 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-95632fb2-fec6-4f7e-ab34-0f2113c44f3a tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:37:40 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-95632fb2-fec6-4f7e-ab34-0f2113c44f3a tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] 10.0.0.210 "GET /compute/v2.1/servers/795900b6-2c41-403e-9023-2ee74e755f5e/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.246467 Apr 19 16:37:40 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 62/181] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 16:37:40 2023] GET /compute/v2.1/servers/795900b6-2c41-403e-9023-2ee74e755f5e/os-interface => generated 283 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:37:41 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [req-5ab556c6-d2df-4f98-bb6b-675de641e54c req-cb4cd4ba-dd43-45db-a3c1-31e865f60928 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "795900b6-2c41-403e-9023-2ee74e755f5e", "tag": "3841b5af-ca7d-4bb2-a319-fa770cc22a33"}]} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:37:41 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-5ab556c6-d2df-4f98-bb6b-675de641e54c req-cb4cd4ba-dd43-45db-a3c1-31e865f60928 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:37:41 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-5ab556c6-d2df-4f98-bb6b-675de641e54c req-cb4cd4ba-dd43-45db-a3c1-31e865f60928 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:37:41 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-5ab556c6-d2df-4f98-bb6b-675de641e54c req-cb4cd4ba-dd43-45db-a3c1-31e865f60928 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:37:41 user devstack@n-api.service[61472]: INFO nova.api.openstack.compute.server_external_events [req-5ab556c6-d2df-4f98-bb6b-675de641e54c req-cb4cd4ba-dd43-45db-a3c1-31e865f60928 service nova] Creating event network-changed:3841b5af-ca7d-4bb2-a319-fa770cc22a33 for instance 795900b6-2c41-403e-9023-2ee74e755f5e on user Apr 19 16:37:41 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [req-5ab556c6-d2df-4f98-bb6b-675de641e54c req-cb4cd4ba-dd43-45db-a3c1-31e865f60928 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027778 Apr 19 16:37:41 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 59/182] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:37:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:37:41 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-5583e09e-1940-4785-8226-f68fc180bea7 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:37:41 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-5583e09e-1940-4785-8226-f68fc180bea7 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] [instance: 795900b6-2c41-403e-9023-2ee74e755f5e] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:37:41 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-5583e09e-1940-4785-8226-f68fc180bea7 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:37:41 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-5583e09e-1940-4785-8226-f68fc180bea7 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:37:41 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-5583e09e-1940-4785-8226-f68fc180bea7 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:37:41 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-5583e09e-1940-4785-8226-f68fc180bea7 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:37:41 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-5583e09e-1940-4785-8226-f68fc180bea7 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:37:41 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-5583e09e-1940-4785-8226-f68fc180bea7 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:37:41 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-5583e09e-1940-4785-8226-f68fc180bea7 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] 10.0.0.210 "GET /compute/v2.1/servers/795900b6-2c41-403e-9023-2ee74e755f5e/ips" status: 200 len: 109 microversion: 2.1 time: 0.032237 Apr 19 16:37:41 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 62/183] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 19 16:37:41 2023] GET /compute/v2.1/servers/795900b6-2c41-403e-9023-2ee74e755f5e/ips => generated 109 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:37:42 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-5f06ccfe-a9d9-40d3-9960-5be53c5056f1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:37:42 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-5f06ccfe-a9d9-40d3-9960-5be53c5056f1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] [instance: 269dc247-e424-4102-9c7f-1f3da95afebf] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:37:42 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-5f06ccfe-a9d9-40d3-9960-5be53c5056f1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:37:42 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-5f06ccfe-a9d9-40d3-9960-5be53c5056f1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:37:42 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-5f06ccfe-a9d9-40d3-9960-5be53c5056f1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:37:42 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-5f06ccfe-a9d9-40d3-9960-5be53c5056f1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:37:42 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-5f06ccfe-a9d9-40d3-9960-5be53c5056f1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:37:42 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-5f06ccfe-a9d9-40d3-9960-5be53c5056f1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:37:42 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-5f06ccfe-a9d9-40d3-9960-5be53c5056f1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f2a02626ca4957823de39c9a31d1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ee4833fd147e2a494be5d7634a2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:37:42 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-5f06ccfe-a9d9-40d3-9960-5be53c5056f1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63f2a02626ca4957823de39c9a31d1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ee4833fd147e2a494be5d7634a2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:37:42 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-5f06ccfe-a9d9-40d3-9960-5be53c5056f1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63f2a02626ca4957823de39c9a31d1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ee4833fd147e2a494be5d7634a2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:37:42 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-5f06ccfe-a9d9-40d3-9960-5be53c5056f1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] 10.0.0.210 "GET /compute/v2.1/servers/269dc247-e424-4102-9c7f-1f3da95afebf" status: 200 len: 1691 microversion: 2.87 time: 0.274291 Apr 19 16:37:42 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 63/184] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 16:37:42 2023] GET /compute/v2.1/servers/269dc247-e424-4102-9c7f-1f3da95afebf => generated 1691 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 16:37:43 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-26cd9e1d-3bd5-4e80-bbe6-fe438aa78f74 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:37:43 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-26cd9e1d-3bd5-4e80-bbe6-fe438aa78f74 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] [instance: 795900b6-2c41-403e-9023-2ee74e755f5e] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:37:43 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-26cd9e1d-3bd5-4e80-bbe6-fe438aa78f74 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:37:43 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-26cd9e1d-3bd5-4e80-bbe6-fe438aa78f74 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:37:43 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-26cd9e1d-3bd5-4e80-bbe6-fe438aa78f74 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:37:43 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-26cd9e1d-3bd5-4e80-bbe6-fe438aa78f74 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:37:43 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-26cd9e1d-3bd5-4e80-bbe6-fe438aa78f74 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:37:43 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-26cd9e1d-3bd5-4e80-bbe6-fe438aa78f74 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:37:43 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-26cd9e1d-3bd5-4e80-bbe6-fe438aa78f74 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] [instance: 795900b6-2c41-403e-9023-2ee74e755f5e] Going to try to terminate instance {{(pid=61472) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 16:37:43 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-26cd9e1d-3bd5-4e80-bbe6-fe438aa78f74 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/795900b6-2c41-403e-9023-2ee74e755f5e" status: 204 len: 0 microversion: 2.1 time: 0.105698 Apr 19 16:37:43 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 60/185] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 16:37:43 2023] DELETE /compute/v2.1/servers/795900b6-2c41-403e-9023-2ee74e755f5e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 16:37:43 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-1b10827c-1161-4ee6-abcb-6e6f833d63a3 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:37:43 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-1b10827c-1161-4ee6-abcb-6e6f833d63a3 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] [instance: 795900b6-2c41-403e-9023-2ee74e755f5e] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:37:43 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-1b10827c-1161-4ee6-abcb-6e6f833d63a3 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:37:43 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-1b10827c-1161-4ee6-abcb-6e6f833d63a3 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:37:43 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-1b10827c-1161-4ee6-abcb-6e6f833d63a3 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:37:43 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-1b10827c-1161-4ee6-abcb-6e6f833d63a3 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:37:43 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-1b10827c-1161-4ee6-abcb-6e6f833d63a3 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:37:43 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-1b10827c-1161-4ee6-abcb-6e6f833d63a3 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:37:43 user devstack@n-api.service[61473]: DEBUG nova.policy [None req-1b10827c-1161-4ee6-abcb-6e6f833d63a3 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2563be52f624ceab060942e8bfcedef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ceccc36de46f780e55a02f25782f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61473) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:37:43 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-1b10827c-1161-4ee6-abcb-6e6f833d63a3 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] 10.0.0.210 "GET /compute/v2.1/servers/795900b6-2c41-403e-9023-2ee74e755f5e" status: 200 len: 1670 microversion: 2.1 time: 0.339869 Apr 19 16:37:43 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 63/186] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:37:43 2023] GET /compute/v2.1/servers/795900b6-2c41-403e-9023-2ee74e755f5e => generated 1670 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:37:43 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [req-1e2c352d-913f-445e-83d9-7c9825ec4b19 req-ce1a3471-9b48-4fe7-aeca-f6f756b725ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "795900b6-2c41-403e-9023-2ee74e755f5e", "name": "network-vif-unplugged", "status": "completed", "tag": "3841b5af-ca7d-4bb2-a319-fa770cc22a33"}]} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:37:43 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-1e2c352d-913f-445e-83d9-7c9825ec4b19 req-ce1a3471-9b48-4fe7-aeca-f6f756b725ea service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:37:43 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-1e2c352d-913f-445e-83d9-7c9825ec4b19 req-ce1a3471-9b48-4fe7-aeca-f6f756b725ea service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:37:43 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-1e2c352d-913f-445e-83d9-7c9825ec4b19 req-ce1a3471-9b48-4fe7-aeca-f6f756b725ea service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:37:43 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-1e2c352d-913f-445e-83d9-7c9825ec4b19 req-ce1a3471-9b48-4fe7-aeca-f6f756b725ea service nova] Creating event network-vif-unplugged:3841b5af-ca7d-4bb2-a319-fa770cc22a33 for instance 795900b6-2c41-403e-9023-2ee74e755f5e on user Apr 19 16:37:43 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [req-1e2c352d-913f-445e-83d9-7c9825ec4b19 req-ce1a3471-9b48-4fe7-aeca-f6f756b725ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028204 Apr 19 16:37:43 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 64/187] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:37:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:37:44 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-ca2fb787-d67b-4437-88fb-fe58d238a736 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:37:44 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-ca2fb787-d67b-4437-88fb-fe58d238a736 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] [instance: edd2688e-940e-4ab3-b27c-b6d4aab3efc5] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:37:44 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-ca2fb787-d67b-4437-88fb-fe58d238a736 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:37:44 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-ca2fb787-d67b-4437-88fb-fe58d238a736 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:37:44 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-ca2fb787-d67b-4437-88fb-fe58d238a736 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:37:44 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-ca2fb787-d67b-4437-88fb-fe58d238a736 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:37:44 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-ca2fb787-d67b-4437-88fb-fe58d238a736 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:37:44 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-ca2fb787-d67b-4437-88fb-fe58d238a736 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:37:44 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-ca2fb787-d67b-4437-88fb-fe58d238a736 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] 10.0.0.210 "GET /compute/v2.1/servers/edd2688e-940e-4ab3-b27c-b6d4aab3efc5/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.192379 Apr 19 16:37:44 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 61/188] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 16:37:44 2023] GET /compute/v2.1/servers/edd2688e-940e-4ab3-b27c-b6d4aab3efc5/os-interface => generated 283 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:37:44 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-9ee72ea9-f389-44db-abf6-0ebaf515afb7 req-bab617b4-ae94-4de2-9804-7002b5d9b859 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "795900b6-2c41-403e-9023-2ee74e755f5e", "name": "network-vif-deleted", "tag": "3841b5af-ca7d-4bb2-a319-fa770cc22a33"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:37:44 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-9ee72ea9-f389-44db-abf6-0ebaf515afb7 req-bab617b4-ae94-4de2-9804-7002b5d9b859 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:37:44 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-9ee72ea9-f389-44db-abf6-0ebaf515afb7 req-bab617b4-ae94-4de2-9804-7002b5d9b859 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:37:44 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-9ee72ea9-f389-44db-abf6-0ebaf515afb7 req-bab617b4-ae94-4de2-9804-7002b5d9b859 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:37:44 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-9ee72ea9-f389-44db-abf6-0ebaf515afb7 req-bab617b4-ae94-4de2-9804-7002b5d9b859 service nova] Creating event network-vif-deleted:3841b5af-ca7d-4bb2-a319-fa770cc22a33 for instance 795900b6-2c41-403e-9023-2ee74e755f5e on user Apr 19 16:37:44 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-9ee72ea9-f389-44db-abf6-0ebaf515afb7 req-bab617b4-ae94-4de2-9804-7002b5d9b859 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035757 Apr 19 16:37:44 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 64/189] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:37:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:37:45 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-bd476786-aec5-4a55-a305-a5e05a72c7cf tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:37:45 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-bd476786-aec5-4a55-a305-a5e05a72c7cf tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] [instance: edd2688e-940e-4ab3-b27c-b6d4aab3efc5] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:37:45 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-bd476786-aec5-4a55-a305-a5e05a72c7cf tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:37:45 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-bd476786-aec5-4a55-a305-a5e05a72c7cf tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:37:45 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-bd476786-aec5-4a55-a305-a5e05a72c7cf tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:37:45 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-bd476786-aec5-4a55-a305-a5e05a72c7cf tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:37:45 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-bd476786-aec5-4a55-a305-a5e05a72c7cf tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:37:45 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-bd476786-aec5-4a55-a305-a5e05a72c7cf tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:37:45 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-bd476786-aec5-4a55-a305-a5e05a72c7cf tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023314f8cf79430b83c5184d9a54be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78962d13860a4df3a8aa100e2afaca6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:37:45 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-bd476786-aec5-4a55-a305-a5e05a72c7cf tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] 10.0.0.210 "GET /compute/v2.1/servers/edd2688e-940e-4ab3-b27c-b6d4aab3efc5" status: 200 len: 1541 microversion: 2.1 time: 0.243952 Apr 19 16:37:45 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 65/190] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:37:45 2023] GET /compute/v2.1/servers/edd2688e-940e-4ab3-b27c-b6d4aab3efc5 => generated 1541 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:37:45 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-896c570c-28e1-4796-8258-83c1d2e88451 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:37:45 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-896c570c-28e1-4796-8258-83c1d2e88451 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] [instance: edd2688e-940e-4ab3-b27c-b6d4aab3efc5] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:37:45 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-896c570c-28e1-4796-8258-83c1d2e88451 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:37:45 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-896c570c-28e1-4796-8258-83c1d2e88451 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:37:45 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-896c570c-28e1-4796-8258-83c1d2e88451 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:37:45 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-896c570c-28e1-4796-8258-83c1d2e88451 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:37:45 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-896c570c-28e1-4796-8258-83c1d2e88451 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:37:45 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-896c570c-28e1-4796-8258-83c1d2e88451 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:37:45 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-f68e8148-7179-4099-bdd1-afccb71790ef req-843e5caf-e2f4-4e0e-833c-147a4372875b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "795900b6-2c41-403e-9023-2ee74e755f5e", "name": "network-vif-plugged", "status": "completed", "tag": "3841b5af-ca7d-4bb2-a319-fa770cc22a33"}, {"name": "network-changed", "server_uuid": "edd2688e-940e-4ab3-b27c-b6d4aab3efc5", "tag": "f8192a07-aa51-45e4-b140-3517cb9813d4"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:37:45 user devstack@n-api.service[61472]: DEBUG nova.policy [None req-896c570c-28e1-4796-8258-83c1d2e88451 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023314f8cf79430b83c5184d9a54be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78962d13860a4df3a8aa100e2afaca6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61472) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:37:45 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-f68e8148-7179-4099-bdd1-afccb71790ef req-843e5caf-e2f4-4e0e-833c-147a4372875b service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:37:45 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-f68e8148-7179-4099-bdd1-afccb71790ef req-843e5caf-e2f4-4e0e-833c-147a4372875b service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:37:45 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-f68e8148-7179-4099-bdd1-afccb71790ef req-843e5caf-e2f4-4e0e-833c-147a4372875b service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:37:45 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-896c570c-28e1-4796-8258-83c1d2e88451 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] 10.0.0.210 "GET /compute/v2.1/servers/edd2688e-940e-4ab3-b27c-b6d4aab3efc5" status: 200 len: 1541 microversion: 2.1 time: 0.175815 Apr 19 16:37:45 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 62/191] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:37:45 2023] GET /compute/v2.1/servers/edd2688e-940e-4ab3-b27c-b6d4aab3efc5 => generated 1541 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:37:45 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-f68e8148-7179-4099-bdd1-afccb71790ef req-843e5caf-e2f4-4e0e-833c-147a4372875b service nova] Creating event network-vif-plugged:3841b5af-ca7d-4bb2-a319-fa770cc22a33 for instance 795900b6-2c41-403e-9023-2ee74e755f5e on user Apr 19 16:37:45 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-f68e8148-7179-4099-bdd1-afccb71790ef req-843e5caf-e2f4-4e0e-833c-147a4372875b service nova] Creating event network-changed:f8192a07-aa51-45e4-b140-3517cb9813d4 for instance edd2688e-940e-4ab3-b27c-b6d4aab3efc5 on user Apr 19 16:37:45 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-f68e8148-7179-4099-bdd1-afccb71790ef req-843e5caf-e2f4-4e0e-833c-147a4372875b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.032306 Apr 19 16:37:45 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 65/192] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:37:45 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:38:01 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-03f6fff8-3c03-43d2-b394-7f65fd3edc4d tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:38:01 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-03f6fff8-3c03-43d2-b394-7f65fd3edc4d tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] [instance: 131e75dc-8c64-40b1-b21b-40210f4d5425] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:38:01 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_api:SELECT=14 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:38:01 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell1:SELECT=26 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:38:01 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-03f6fff8-3c03-43d2-b394-7f65fd3edc4d tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:38:01 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-03f6fff8-3c03-43d2-b394-7f65fd3edc4d tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:38:01 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-03f6fff8-3c03-43d2-b394-7f65fd3edc4d tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:38:01 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-03f6fff8-3c03-43d2-b394-7f65fd3edc4d tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:38:01 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-03f6fff8-3c03-43d2-b394-7f65fd3edc4d tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:38:01 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-03f6fff8-3c03-43d2-b394-7f65fd3edc4d tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:38:02 user devstack@n-api.service[61471]: INFO nova.api.openstack.wsgi [None req-03f6fff8-3c03-43d2-b394-7f65fd3edc4d tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] HTTP exception thrown: Instance 131e75dc-8c64-40b1-b21b-40210f4d5425 could not be found. Apr 19 16:38:02 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-03f6fff8-3c03-43d2-b394-7f65fd3edc4d tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Request method failure captured: Apr 19 16:38:02 user devstack@n-api.service[61471]: request: GET /compute/v2.1/servers/131e75dc-8c64-40b1-b21b-40210f4d5425 HTTP/1.1 Apr 19 16:38:02 user devstack@n-api.service[61471]: Accept: application/json Apr 19 16:38:02 user devstack@n-api.service[61471]: Accept-Encoding: identity Apr 19 16:38:02 user devstack@n-api.service[61471]: Connection: close Apr 19 16:38:02 user devstack@n-api.service[61471]: Content-Length: 0 Apr 19 16:38:02 user devstack@n-api.service[61471]: Content-Type: application/json Apr 19 16:38:02 user devstack@n-api.service[61471]: Host: 10.0.0.210 Apr 19 16:38:02 user devstack@n-api.service[61471]: Openstack-System-Scope: None Apr 19 16:38:02 user devstack@n-api.service[61471]: User-Agent: python-urllib3/1.26.15 Apr 19 16:38:02 user devstack@n-api.service[61471]: X-Auth-Token: gAAAAABkQBe7WEOKbTv5dhOvCmDmECRc3hvx1T4oHDfHV7vpCP0Oweo2-oahRXHc1Qi4oi3rye81Es5GziFyKdgG5dtxuEUBm_yNWtGvHANgtuXvQe-T8KtgBZhiqbt8YO9BavTfBk1ul9u9py6Puufy5zUymv0L7lN86JcDgeUb19Jsr-71Vko Apr 19 16:38:02 user devstack@n-api.service[61471]: X-Domain-Id: None Apr 19 16:38:02 user devstack@n-api.service[61471]: X-Domain-Name: None Apr 19 16:38:02 user devstack@n-api.service[61471]: X-Identity-Status: Confirmed Apr 19 16:38:02 user devstack@n-api.service[61471]: X-Is-Admin-Project: True Apr 19 16:38:02 user devstack@n-api.service[61471]: X-Project-Domain-Id: default Apr 19 16:38:02 user devstack@n-api.service[61471]: X-Project-Domain-Name: Default Apr 19 16:38:02 user devstack@n-api.service[61471]: X-Project-Id: ee32e72a51414422bfad5875f32b1515 Apr 19 16:38:02 user devstack@n-api.service[61471]: X-Project-Name: tempest-VolumesAdminNegativeTest-1517925245 Apr 19 16:38:02 user devstack@n-api.service[61471]: X-Role: member,reader Apr 19 16:38:02 user devstack@n-api.service[61471]: X-Roles: member,reader Apr 19 16:38:02 user devstack@n-api.service[61471]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ee32e72a51414422bfad5875f32b1515"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ee32e72a51414422bfad5875f32b1515"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ee32e72a51414422bfad5875f32b1515"}]}] Apr 19 16:38:02 user devstack@n-api.service[61471]: X-Tenant: tempest-VolumesAdminNegativeTest-1517925245 Apr 19 16:38:02 user devstack@n-api.service[61471]: X-Tenant-Id: ee32e72a51414422bfad5875f32b1515 Apr 19 16:38:02 user devstack@n-api.service[61471]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1517925245 Apr 19 16:38:02 user devstack@n-api.service[61471]: X-User: tempest-VolumesAdminNegativeTest-1517925245-project-member Apr 19 16:38:02 user devstack@n-api.service[61471]: X-User-Domain-Id: default Apr 19 16:38:02 user devstack@n-api.service[61471]: X-User-Domain-Name: Default Apr 19 16:38:02 user devstack@n-api.service[61471]: X-User-Id: 6be99c3ba0554acda7b418f66a31c943 Apr 19 16:38:02 user devstack@n-api.service[61471]: X-User-Name: tempest-VolumesAdminNegativeTest-1517925245-project-member Apr 19 16:38:02 user devstack@n-api.service[61471]: method: > Apr 19 16:38:02 user devstack@n-api.service[61471]: exception: Instance 131e75dc-8c64-40b1-b21b-40210f4d5425 could not be found. Apr 19 16:38:02 user devstack@n-api.service[61471]: action_args: {'id': '131e75dc-8c64-40b1-b21b-40210f4d5425'} Apr 19 16:38:02 user devstack@n-api.service[61471]: {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:38:02 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:38:02 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:38:02 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:38:02 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:38:02 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:38:02 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:38:02 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:38:02 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:38:02 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:38:02 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 131e75dc-8c64-40b1-b21b-40210f4d5425 could not be found. Apr 19 16:38:02 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:38:02 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:38:02 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:38:02 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:38:02 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:38:02 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:38:02 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:38:02 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:38:02 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:38:02 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:38:02 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 16:38:02 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 16:38:02 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:38:02 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:38:02 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:38:02 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:38:02 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 131e75dc-8c64-40b1-b21b-40210f4d5425 could not be found. Apr 19 16:38:02 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:38:02 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:38:02 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:38:02 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:38:02 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:38:02 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:38:02 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:38:02 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:38:02 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 131e75dc-8c64-40b1-b21b-40210f4d5425 could not be found. Apr 19 16:38:02 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:38:02 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-03f6fff8-3c03-43d2-b394-7f65fd3edc4d tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Returning 404 to user: Instance 131e75dc-8c64-40b1-b21b-40210f4d5425 could not be found. {{(pid=61471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:38:02 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-03f6fff8-3c03-43d2-b394-7f65fd3edc4d tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] 10.0.0.210 "GET /compute/v2.1/servers/131e75dc-8c64-40b1-b21b-40210f4d5425" status: 404 len: 111 microversion: 2.1 time: 0.031355 Apr 19 16:38:02 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 66/193] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:38:01 2023] GET /compute/v2.1/servers/131e75dc-8c64-40b1-b21b-40210f4d5425 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 16:38:02 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:38:02 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:38:02 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-4f92a5dc-1f83-4eb9-ab0f-6f9ebd7a4ca7 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:38:02 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-4f92a5dc-1f83-4eb9-ab0f-6f9ebd7a4ca7 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] [instance: ded3b7ea-2e6a-4aa9-b658-424a8bea42bc] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:38:02 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-4f92a5dc-1f83-4eb9-ab0f-6f9ebd7a4ca7 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:38:02 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-4f92a5dc-1f83-4eb9-ab0f-6f9ebd7a4ca7 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:38:02 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-4f92a5dc-1f83-4eb9-ab0f-6f9ebd7a4ca7 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:38:02 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-4f92a5dc-1f83-4eb9-ab0f-6f9ebd7a4ca7 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:38:02 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-4f92a5dc-1f83-4eb9-ab0f-6f9ebd7a4ca7 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:38:02 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-4f92a5dc-1f83-4eb9-ab0f-6f9ebd7a4ca7 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:38:02 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-4f92a5dc-1f83-4eb9-ab0f-6f9ebd7a4ca7 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] [instance: ded3b7ea-2e6a-4aa9-b658-424a8bea42bc] Going to try to terminate instance {{(pid=61472) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 16:38:02 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-4f92a5dc-1f83-4eb9-ab0f-6f9ebd7a4ca7 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ded3b7ea-2e6a-4aa9-b658-424a8bea42bc" status: 204 len: 0 microversion: 2.1 time: 0.119240 Apr 19 16:38:02 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 63/194] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 16:38:02 2023] DELETE /compute/v2.1/servers/ded3b7ea-2e6a-4aa9-b658-424a8bea42bc => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 16:38:02 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-08b07382-bdde-4132-8b4b-2d6ada158a79 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:38:02 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-08b07382-bdde-4132-8b4b-2d6ada158a79 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] [instance: ded3b7ea-2e6a-4aa9-b658-424a8bea42bc] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:38:02 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:38:02 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:38:02 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-08b07382-bdde-4132-8b4b-2d6ada158a79 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:38:02 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-08b07382-bdde-4132-8b4b-2d6ada158a79 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:38:02 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-08b07382-bdde-4132-8b4b-2d6ada158a79 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:38:02 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-08b07382-bdde-4132-8b4b-2d6ada158a79 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:38:02 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-08b07382-bdde-4132-8b4b-2d6ada158a79 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:38:02 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-08b07382-bdde-4132-8b4b-2d6ada158a79 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:38:02 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [req-55e6f25f-3cc7-471e-84b9-472149fb12ef req-0b5b1a10-aa7a-4497-a2e1-ee7c3b146bb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ded3b7ea-2e6a-4aa9-b658-424a8bea42bc", "name": "network-vif-unplugged", "status": "completed", "tag": "58b610d1-d4a8-4a99-a790-15b652fc7345"}]} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:38:02 user devstack@n-api.service[61473]: DEBUG nova.policy [None req-08b07382-bdde-4132-8b4b-2d6ada158a79 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be99c3ba0554acda7b418f66a31c943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee32e72a51414422bfad5875f32b1515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61473) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:38:02 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-55e6f25f-3cc7-471e-84b9-472149fb12ef req-0b5b1a10-aa7a-4497-a2e1-ee7c3b146bb5 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:38:02 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-55e6f25f-3cc7-471e-84b9-472149fb12ef req-0b5b1a10-aa7a-4497-a2e1-ee7c3b146bb5 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:38:02 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-55e6f25f-3cc7-471e-84b9-472149fb12ef req-0b5b1a10-aa7a-4497-a2e1-ee7c3b146bb5 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:38:02 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-08b07382-bdde-4132-8b4b-2d6ada158a79 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ded3b7ea-2e6a-4aa9-b658-424a8bea42bc" status: 200 len: 1669 microversion: 2.1 time: 0.242665 Apr 19 16:38:02 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 66/195] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:38:02 2023] GET /compute/v2.1/servers/ded3b7ea-2e6a-4aa9-b658-424a8bea42bc => generated 1669 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:38:02 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-55e6f25f-3cc7-471e-84b9-472149fb12ef req-0b5b1a10-aa7a-4497-a2e1-ee7c3b146bb5 service nova] Creating event network-vif-unplugged:58b610d1-d4a8-4a99-a790-15b652fc7345 for instance ded3b7ea-2e6a-4aa9-b658-424a8bea42bc on user Apr 19 16:38:02 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [req-55e6f25f-3cc7-471e-84b9-472149fb12ef req-0b5b1a10-aa7a-4497-a2e1-ee7c3b146bb5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034238 Apr 19 16:38:02 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 67/196] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:38:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:38:04 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [req-f8cc6ea6-6af7-48a8-83b8-b8d0fb9759c3 req-2238451e-aa64-46db-9e66-bf4b5ba47e71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ded3b7ea-2e6a-4aa9-b658-424a8bea42bc", "name": "network-vif-plugged", "status": "completed", "tag": "58b610d1-d4a8-4a99-a790-15b652fc7345"}, {"server_uuid": "ded3b7ea-2e6a-4aa9-b658-424a8bea42bc", "name": "network-vif-deleted", "tag": "58b610d1-d4a8-4a99-a790-15b652fc7345"}]} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:38:04 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-f8cc6ea6-6af7-48a8-83b8-b8d0fb9759c3 req-2238451e-aa64-46db-9e66-bf4b5ba47e71 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:38:04 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-f8cc6ea6-6af7-48a8-83b8-b8d0fb9759c3 req-2238451e-aa64-46db-9e66-bf4b5ba47e71 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:38:04 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-f8cc6ea6-6af7-48a8-83b8-b8d0fb9759c3 req-2238451e-aa64-46db-9e66-bf4b5ba47e71 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:38:04 user devstack@n-api.service[61472]: INFO nova.api.openstack.compute.server_external_events [req-f8cc6ea6-6af7-48a8-83b8-b8d0fb9759c3 req-2238451e-aa64-46db-9e66-bf4b5ba47e71 service nova] Creating event network-vif-plugged:58b610d1-d4a8-4a99-a790-15b652fc7345 for instance ded3b7ea-2e6a-4aa9-b658-424a8bea42bc on user Apr 19 16:38:04 user devstack@n-api.service[61472]: INFO nova.api.openstack.compute.server_external_events [req-f8cc6ea6-6af7-48a8-83b8-b8d0fb9759c3 req-2238451e-aa64-46db-9e66-bf4b5ba47e71 service nova] Creating event network-vif-deleted:58b610d1-d4a8-4a99-a790-15b652fc7345 for instance ded3b7ea-2e6a-4aa9-b658-424a8bea42bc on user Apr 19 16:38:04 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [req-f8cc6ea6-6af7-48a8-83b8-b8d0fb9759c3 req-2238451e-aa64-46db-9e66-bf4b5ba47e71 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037356 Apr 19 16:38:04 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 64/197] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:38:04 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:38:22 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-d6a5df3c-b5f8-4d53-a42d-24c50ce5f9eb tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:38:22 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-d6a5df3c-b5f8-4d53-a42d-24c50ce5f9eb tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] [instance: 7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:38:22 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_api:SELECT=2 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:38:22 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell1:SELECT=6 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:38:22 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-d6a5df3c-b5f8-4d53-a42d-24c50ce5f9eb tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:38:22 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-d6a5df3c-b5f8-4d53-a42d-24c50ce5f9eb tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:38:22 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-d6a5df3c-b5f8-4d53-a42d-24c50ce5f9eb tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:38:22 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-d6a5df3c-b5f8-4d53-a42d-24c50ce5f9eb tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:38:22 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-d6a5df3c-b5f8-4d53-a42d-24c50ce5f9eb tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:38:22 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-d6a5df3c-b5f8-4d53-a42d-24c50ce5f9eb tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:38:22 user devstack@n-api.service[61473]: INFO nova.api.openstack.wsgi [None req-d6a5df3c-b5f8-4d53-a42d-24c50ce5f9eb tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] HTTP exception thrown: Instance 7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18 could not be found. Apr 19 16:38:22 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-d6a5df3c-b5f8-4d53-a42d-24c50ce5f9eb tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Request method failure captured: Apr 19 16:38:22 user devstack@n-api.service[61473]: request: GET /compute/v2.1/servers/7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18 HTTP/1.1 Apr 19 16:38:22 user devstack@n-api.service[61473]: Accept: application/json Apr 19 16:38:22 user devstack@n-api.service[61473]: Accept-Encoding: identity Apr 19 16:38:22 user devstack@n-api.service[61473]: Connection: close Apr 19 16:38:22 user devstack@n-api.service[61473]: Content-Length: 0 Apr 19 16:38:22 user devstack@n-api.service[61473]: Content-Type: application/json Apr 19 16:38:22 user devstack@n-api.service[61473]: Host: 10.0.0.210 Apr 19 16:38:22 user devstack@n-api.service[61473]: Openstack-System-Scope: None Apr 19 16:38:22 user devstack@n-api.service[61473]: User-Agent: python-urllib3/1.26.15 Apr 19 16:38:22 user devstack@n-api.service[61473]: X-Auth-Token: gAAAAABkQBft97Lb8vXwWY10e1qffFSo9pCiKV_nxukKPY9LMmdZSFBRwKuoOKIxCFrqpqDeRzdcPSEDj68b-o5l31Z4_eRDXw1gJEuFqqj2Tw860aOgd5ZQADEQT3q0cIaqtXe8wGfwGxbcOzsvtQA5rYII5DcCVXxTcc7A5yhZxtXMgTKih84 Apr 19 16:38:22 user devstack@n-api.service[61473]: X-Domain-Id: None Apr 19 16:38:22 user devstack@n-api.service[61473]: X-Domain-Name: None Apr 19 16:38:22 user devstack@n-api.service[61473]: X-Identity-Status: Confirmed Apr 19 16:38:22 user devstack@n-api.service[61473]: X-Is-Admin-Project: True Apr 19 16:38:22 user devstack@n-api.service[61473]: X-Project-Domain-Id: default Apr 19 16:38:22 user devstack@n-api.service[61473]: X-Project-Domain-Name: Default Apr 19 16:38:22 user devstack@n-api.service[61473]: X-Project-Id: 3a63d3a9c6774bba8f276846597e24ca Apr 19 16:38:22 user devstack@n-api.service[61473]: X-Project-Name: tempest-ServersNegativeTestJSON-415326023 Apr 19 16:38:22 user devstack@n-api.service[61473]: X-Role: member,reader Apr 19 16:38:22 user devstack@n-api.service[61473]: X-Roles: member,reader Apr 19 16:38:22 user devstack@n-api.service[61473]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3a63d3a9c6774bba8f276846597e24ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3a63d3a9c6774bba8f276846597e24ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3a63d3a9c6774bba8f276846597e24ca"}]}] Apr 19 16:38:22 user devstack@n-api.service[61473]: X-Tenant: tempest-ServersNegativeTestJSON-415326023 Apr 19 16:38:22 user devstack@n-api.service[61473]: X-Tenant-Id: 3a63d3a9c6774bba8f276846597e24ca Apr 19 16:38:22 user devstack@n-api.service[61473]: X-Tenant-Name: tempest-ServersNegativeTestJSON-415326023 Apr 19 16:38:22 user devstack@n-api.service[61473]: X-User: tempest-ServersNegativeTestJSON-415326023-project-member Apr 19 16:38:22 user devstack@n-api.service[61473]: X-User-Domain-Id: default Apr 19 16:38:22 user devstack@n-api.service[61473]: X-User-Domain-Name: Default Apr 19 16:38:22 user devstack@n-api.service[61473]: X-User-Id: 25d089267c6a4a1391bb89ae66b49da7 Apr 19 16:38:22 user devstack@n-api.service[61473]: X-User-Name: tempest-ServersNegativeTestJSON-415326023-project-member Apr 19 16:38:22 user devstack@n-api.service[61473]: method: > Apr 19 16:38:22 user devstack@n-api.service[61473]: exception: Instance 7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18 could not be found. Apr 19 16:38:22 user devstack@n-api.service[61473]: action_args: {'id': '7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18'} Apr 19 16:38:22 user devstack@n-api.service[61473]: {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:38:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:38:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:38:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:38:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:38:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:38:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:38:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:38:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:38:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:38:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18 could not be found. Apr 19 16:38:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:38:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:38:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:38:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:38:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:38:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:38:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:38:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:38:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:38:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:38:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 16:38:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 16:38:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:38:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:38:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:38:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:38:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18 could not be found. Apr 19 16:38:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:38:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:38:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:38:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:38:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:38:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:38:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:38:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:38:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18 could not be found. Apr 19 16:38:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:38:22 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-d6a5df3c-b5f8-4d53-a42d-24c50ce5f9eb tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Returning 404 to user: Instance 7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18 could not be found. {{(pid=61473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:38:22 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-d6a5df3c-b5f8-4d53-a42d-24c50ce5f9eb tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18" status: 404 len: 111 microversion: 2.1 time: 0.032113 Apr 19 16:38:22 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 67/198] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:38:22 2023] GET /compute/v2.1/servers/7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 16:38:22 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_api:SELECT=4 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:38:22 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell1:SELECT=4 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:38:22 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-51864932-464f-4741-8f21-ab33b42235d8 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:38:22 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-51864932-464f-4741-8f21-ab33b42235d8 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] [instance: 11eee783-802b-438a-bc43-a59b6c33ce63] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:38:22 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-51864932-464f-4741-8f21-ab33b42235d8 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:38:22 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-51864932-464f-4741-8f21-ab33b42235d8 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:38:22 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-51864932-464f-4741-8f21-ab33b42235d8 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:38:22 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-51864932-464f-4741-8f21-ab33b42235d8 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:38:22 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-51864932-464f-4741-8f21-ab33b42235d8 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:38:22 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-51864932-464f-4741-8f21-ab33b42235d8 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:38:23 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-51864932-464f-4741-8f21-ab33b42235d8 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d089267c6a4a1391bb89ae66b49da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a63d3a9c6774bba8f276846597e24ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:38:23 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-51864932-464f-4741-8f21-ab33b42235d8 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11eee783-802b-438a-bc43-a59b6c33ce63" status: 200 len: 1494 microversion: 2.1 time: 0.217824 Apr 19 16:38:23 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 68/199] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:38:22 2023] GET /compute/v2.1/servers/11eee783-802b-438a-bc43-a59b6c33ce63 => generated 1494 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:38:27 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:38:27 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:38:27 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-b89e0c61-5872-4bbe-8206-2d6c6e1956d5 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:38:27 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-b89e0c61-5872-4bbe-8206-2d6c6e1956d5 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] [instance: c513f20d-c24e-4270-a28e-5374940abf6f] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:38:27 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-b89e0c61-5872-4bbe-8206-2d6c6e1956d5 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:38:27 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-b89e0c61-5872-4bbe-8206-2d6c6e1956d5 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:38:27 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-b89e0c61-5872-4bbe-8206-2d6c6e1956d5 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:38:27 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-b89e0c61-5872-4bbe-8206-2d6c6e1956d5 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:38:27 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-b89e0c61-5872-4bbe-8206-2d6c6e1956d5 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:38:27 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-b89e0c61-5872-4bbe-8206-2d6c6e1956d5 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:38:27 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-b89e0c61-5872-4bbe-8206-2d6c6e1956d5 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c513f20d-c24e-4270-a28e-5374940abf6f/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.257172 Apr 19 16:38:27 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 65/200] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 19 16:38:27 2023] GET /compute/v2.1/servers/c513f20d-c24e-4270-a28e-5374940abf6f/os-interface => generated 283 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 16:38:28 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-8fae1f96-9c4e-4a89-b071-a8ab2b0b6ebc req-80d15ae8-55a6-484f-9338-dc89da6cab0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c513f20d-c24e-4270-a28e-5374940abf6f", "tag": "05399020-7272-4195-8ffc-8524c79dbbb8"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:38:28 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-8fae1f96-9c4e-4a89-b071-a8ab2b0b6ebc req-80d15ae8-55a6-484f-9338-dc89da6cab0a service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:38:28 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-8fae1f96-9c4e-4a89-b071-a8ab2b0b6ebc req-80d15ae8-55a6-484f-9338-dc89da6cab0a service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:38:28 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-8fae1f96-9c4e-4a89-b071-a8ab2b0b6ebc req-80d15ae8-55a6-484f-9338-dc89da6cab0a service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:38:28 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-8fae1f96-9c4e-4a89-b071-a8ab2b0b6ebc req-80d15ae8-55a6-484f-9338-dc89da6cab0a service nova] Creating event network-changed:05399020-7272-4195-8ffc-8524c79dbbb8 for instance c513f20d-c24e-4270-a28e-5374940abf6f on user Apr 19 16:38:28 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-8fae1f96-9c4e-4a89-b071-a8ab2b0b6ebc req-80d15ae8-55a6-484f-9338-dc89da6cab0a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081394 Apr 19 16:38:28 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 68/201] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:38:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:38:28 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-c0c12437-322e-4ebb-90a9-216184aaa870 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:38:28 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-c0c12437-322e-4ebb-90a9-216184aaa870 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] [instance: c513f20d-c24e-4270-a28e-5374940abf6f] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:38:28 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-c0c12437-322e-4ebb-90a9-216184aaa870 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:38:28 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-c0c12437-322e-4ebb-90a9-216184aaa870 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:38:28 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-c0c12437-322e-4ebb-90a9-216184aaa870 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:38:28 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-c0c12437-322e-4ebb-90a9-216184aaa870 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:38:28 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-c0c12437-322e-4ebb-90a9-216184aaa870 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:38:28 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-c0c12437-322e-4ebb-90a9-216184aaa870 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:38:28 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-c0c12437-322e-4ebb-90a9-216184aaa870 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c513f20d-c24e-4270-a28e-5374940abf6f/ips" status: 200 len: 110 microversion: 2.20 time: 0.034465 Apr 19 16:38:28 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 69/202] 10.0.0.210 () {64 vars in 1366 bytes} [Wed Apr 19 16:38:28 2023] GET /compute/v2.1/servers/c513f20d-c24e-4270-a28e-5374940abf6f/ips => generated 110 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 16:38:29 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-be4676fd-b4d1-42b1-bedf-616d38a3e607 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:38:29 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-be4676fd-b4d1-42b1-bedf-616d38a3e607 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] [instance: c513f20d-c24e-4270-a28e-5374940abf6f] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:38:29 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-be4676fd-b4d1-42b1-bedf-616d38a3e607 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:38:29 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-be4676fd-b4d1-42b1-bedf-616d38a3e607 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:38:29 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-be4676fd-b4d1-42b1-bedf-616d38a3e607 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:38:29 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-be4676fd-b4d1-42b1-bedf-616d38a3e607 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:38:29 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-be4676fd-b4d1-42b1-bedf-616d38a3e607 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:38:29 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-be4676fd-b4d1-42b1-bedf-616d38a3e607 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:38:29 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-be4676fd-b4d1-42b1-bedf-616d38a3e607 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] [instance: c513f20d-c24e-4270-a28e-5374940abf6f] Going to try to terminate instance {{(pid=61472) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 16:38:29 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-be4676fd-b4d1-42b1-bedf-616d38a3e607 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c513f20d-c24e-4270-a28e-5374940abf6f" status: 204 len: 0 microversion: 2.20 time: 0.101657 Apr 19 16:38:29 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 66/203] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 19 16:38:29 2023] DELETE /compute/v2.1/servers/c513f20d-c24e-4270-a28e-5374940abf6f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 19 16:38:29 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-b635670f-d716-40d8-a696-a6c62b7bb938 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:38:29 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-b635670f-d716-40d8-a696-a6c62b7bb938 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] [instance: c513f20d-c24e-4270-a28e-5374940abf6f] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:38:29 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-b635670f-d716-40d8-a696-a6c62b7bb938 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:38:29 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-b635670f-d716-40d8-a696-a6c62b7bb938 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:38:29 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-b635670f-d716-40d8-a696-a6c62b7bb938 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:38:29 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-b635670f-d716-40d8-a696-a6c62b7bb938 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:38:29 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-b635670f-d716-40d8-a696-a6c62b7bb938 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:38:29 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-b635670f-d716-40d8-a696-a6c62b7bb938 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:38:29 user devstack@n-api.service[61473]: DEBUG nova.policy [None req-b635670f-d716-40d8-a696-a6c62b7bb938 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34afcb1cb8d2433b9564e5b62b45fe86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29a717b7f334af5a35d9e86c3d4b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61473) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:38:29 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [req-4d6b2507-a1a7-4734-8b10-f1b7e486a555 req-35d9dbe4-f61d-4d7d-9c24-814e6cf575c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c513f20d-c24e-4270-a28e-5374940abf6f", "name": "network-vif-unplugged", "status": "completed", "tag": "05399020-7272-4195-8ffc-8524c79dbbb8"}]} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:38:29 user devstack@n-api.service[61473]: DEBUG nova.policy [None req-b635670f-d716-40d8-a696-a6c62b7bb938 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34afcb1cb8d2433b9564e5b62b45fe86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29a717b7f334af5a35d9e86c3d4b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61473) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:38:29 user devstack@n-api.service[61473]: DEBUG nova.policy [None req-b635670f-d716-40d8-a696-a6c62b7bb938 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34afcb1cb8d2433b9564e5b62b45fe86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29a717b7f334af5a35d9e86c3d4b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61473) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:38:29 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-b635670f-d716-40d8-a696-a6c62b7bb938 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c513f20d-c24e-4270-a28e-5374940abf6f" status: 200 len: 1710 microversion: 2.20 time: 0.303181 Apr 19 16:38:29 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 69/204] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 16:38:29 2023] GET /compute/v2.1/servers/c513f20d-c24e-4270-a28e-5374940abf6f => generated 1710 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 16:38:29 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-4d6b2507-a1a7-4734-8b10-f1b7e486a555 req-35d9dbe4-f61d-4d7d-9c24-814e6cf575c3 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:38:29 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-4d6b2507-a1a7-4734-8b10-f1b7e486a555 req-35d9dbe4-f61d-4d7d-9c24-814e6cf575c3 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:38:29 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-4d6b2507-a1a7-4734-8b10-f1b7e486a555 req-35d9dbe4-f61d-4d7d-9c24-814e6cf575c3 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:38:29 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-4d6b2507-a1a7-4734-8b10-f1b7e486a555 req-35d9dbe4-f61d-4d7d-9c24-814e6cf575c3 service nova] Creating event network-vif-unplugged:05399020-7272-4195-8ffc-8524c79dbbb8 for instance c513f20d-c24e-4270-a28e-5374940abf6f on user Apr 19 16:38:29 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [req-4d6b2507-a1a7-4734-8b10-f1b7e486a555 req-35d9dbe4-f61d-4d7d-9c24-814e6cf575c3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087213 Apr 19 16:38:29 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 70/205] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:38:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:38:31 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [req-d63b1049-1b44-4f0b-a6f1-6871be53f688 req-8a70db54-a7cb-4848-a65a-026854c8d23c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c513f20d-c24e-4270-a28e-5374940abf6f", "name": "network-vif-deleted", "tag": "05399020-7272-4195-8ffc-8524c79dbbb8"}]} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:38:31 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-d63b1049-1b44-4f0b-a6f1-6871be53f688 req-8a70db54-a7cb-4848-a65a-026854c8d23c service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:38:31 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-d63b1049-1b44-4f0b-a6f1-6871be53f688 req-8a70db54-a7cb-4848-a65a-026854c8d23c service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:38:31 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-d63b1049-1b44-4f0b-a6f1-6871be53f688 req-8a70db54-a7cb-4848-a65a-026854c8d23c service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:38:31 user devstack@n-api.service[61472]: INFO nova.api.openstack.compute.server_external_events [req-d63b1049-1b44-4f0b-a6f1-6871be53f688 req-8a70db54-a7cb-4848-a65a-026854c8d23c service nova] Creating event network-vif-deleted:05399020-7272-4195-8ffc-8524c79dbbb8 for instance c513f20d-c24e-4270-a28e-5374940abf6f on user Apr 19 16:38:31 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [req-d63b1049-1b44-4f0b-a6f1-6871be53f688 req-8a70db54-a7cb-4848-a65a-026854c8d23c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034070 Apr 19 16:38:31 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 67/206] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:38:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:38:31 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-312d4cfc-02f8-4416-ad92-32915f7fa5f0 req-162625d5-befd-4450-98f0-2a8a36b64c7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c513f20d-c24e-4270-a28e-5374940abf6f", "name": "network-vif-plugged", "status": "completed", "tag": "05399020-7272-4195-8ffc-8524c79dbbb8"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:38:31 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-312d4cfc-02f8-4416-ad92-32915f7fa5f0 req-162625d5-befd-4450-98f0-2a8a36b64c7b service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:38:31 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-312d4cfc-02f8-4416-ad92-32915f7fa5f0 req-162625d5-befd-4450-98f0-2a8a36b64c7b service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:38:31 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-312d4cfc-02f8-4416-ad92-32915f7fa5f0 req-162625d5-befd-4450-98f0-2a8a36b64c7b service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:38:31 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-312d4cfc-02f8-4416-ad92-32915f7fa5f0 req-162625d5-befd-4450-98f0-2a8a36b64c7b service nova] Creating event network-vif-plugged:05399020-7272-4195-8ffc-8524c79dbbb8 for instance c513f20d-c24e-4270-a28e-5374940abf6f on user Apr 19 16:38:31 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-312d4cfc-02f8-4416-ad92-32915f7fa5f0 req-162625d5-befd-4450-98f0-2a8a36b64c7b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031828 Apr 19 16:38:31 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 70/207] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:38:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:38:33 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-adc6ea91-450c-4386-b623-ce9fb04dd29c tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:38:33 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-adc6ea91-450c-4386-b623-ce9fb04dd29c tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] [instance: 795900b6-2c41-403e-9023-2ee74e755f5e] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:38:33 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-adc6ea91-450c-4386-b623-ce9fb04dd29c tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:38:33 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-adc6ea91-450c-4386-b623-ce9fb04dd29c tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:38:33 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-adc6ea91-450c-4386-b623-ce9fb04dd29c tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:38:33 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-adc6ea91-450c-4386-b623-ce9fb04dd29c tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:38:33 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-adc6ea91-450c-4386-b623-ce9fb04dd29c tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:38:33 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-adc6ea91-450c-4386-b623-ce9fb04dd29c tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:38:33 user devstack@n-api.service[61471]: INFO nova.api.openstack.wsgi [None req-adc6ea91-450c-4386-b623-ce9fb04dd29c tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] HTTP exception thrown: Instance 795900b6-2c41-403e-9023-2ee74e755f5e could not be found. Apr 19 16:38:33 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-adc6ea91-450c-4386-b623-ce9fb04dd29c tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Request method failure captured: Apr 19 16:38:33 user devstack@n-api.service[61471]: request: GET /compute/v2.1/servers/795900b6-2c41-403e-9023-2ee74e755f5e HTTP/1.1 Apr 19 16:38:33 user devstack@n-api.service[61471]: Accept: application/json Apr 19 16:38:33 user devstack@n-api.service[61471]: Accept-Encoding: identity Apr 19 16:38:33 user devstack@n-api.service[61471]: Connection: close Apr 19 16:38:33 user devstack@n-api.service[61471]: Content-Length: 0 Apr 19 16:38:33 user devstack@n-api.service[61471]: Content-Type: application/json Apr 19 16:38:33 user devstack@n-api.service[61471]: Host: 10.0.0.210 Apr 19 16:38:33 user devstack@n-api.service[61471]: Openstack-System-Scope: None Apr 19 16:38:33 user devstack@n-api.service[61471]: User-Agent: python-urllib3/1.26.15 Apr 19 16:38:33 user devstack@n-api.service[61471]: X-Auth-Token: gAAAAABkQBe1KSHokT8PQH3k3vnjIt97t532dWuRz8Pml0FOlGyiPoJ_q_-ld3S6cAAgROvvvhUgmEwfCyYUzAgb5BImPOX9fwVjK1KI0GLz312Q5Z2IlqMSmB5SJFoVIfRtPQ9K8GxAdUo5TO_60RdH4gGaVZDRdA94Vol93DCBoXTfp3X86mQ Apr 19 16:38:33 user devstack@n-api.service[61471]: X-Domain-Id: None Apr 19 16:38:33 user devstack@n-api.service[61471]: X-Domain-Name: None Apr 19 16:38:33 user devstack@n-api.service[61471]: X-Identity-Status: Confirmed Apr 19 16:38:33 user devstack@n-api.service[61471]: X-Is-Admin-Project: True Apr 19 16:38:33 user devstack@n-api.service[61471]: X-Project-Domain-Id: default Apr 19 16:38:33 user devstack@n-api.service[61471]: X-Project-Domain-Name: Default Apr 19 16:38:33 user devstack@n-api.service[61471]: X-Project-Id: 821ceccc36de46f780e55a02f25782f4 Apr 19 16:38:33 user devstack@n-api.service[61471]: X-Project-Name: tempest-AttachVolumeNegativeTest-2083894839 Apr 19 16:38:33 user devstack@n-api.service[61471]: X-Role: member,reader Apr 19 16:38:33 user devstack@n-api.service[61471]: X-Roles: member,reader Apr 19 16:38:33 user devstack@n-api.service[61471]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/821ceccc36de46f780e55a02f25782f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/821ceccc36de46f780e55a02f25782f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/821ceccc36de46f780e55a02f25782f4"}]}] Apr 19 16:38:33 user devstack@n-api.service[61471]: X-Tenant: tempest-AttachVolumeNegativeTest-2083894839 Apr 19 16:38:33 user devstack@n-api.service[61471]: X-Tenant-Id: 821ceccc36de46f780e55a02f25782f4 Apr 19 16:38:33 user devstack@n-api.service[61471]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2083894839 Apr 19 16:38:33 user devstack@n-api.service[61471]: X-User: tempest-AttachVolumeNegativeTest-2083894839-project-member Apr 19 16:38:33 user devstack@n-api.service[61471]: X-User-Domain-Id: default Apr 19 16:38:33 user devstack@n-api.service[61471]: X-User-Domain-Name: Default Apr 19 16:38:33 user devstack@n-api.service[61471]: X-User-Id: c2563be52f624ceab060942e8bfcedef Apr 19 16:38:33 user devstack@n-api.service[61471]: X-User-Name: tempest-AttachVolumeNegativeTest-2083894839-project-member Apr 19 16:38:33 user devstack@n-api.service[61471]: method: > Apr 19 16:38:33 user devstack@n-api.service[61471]: exception: Instance 795900b6-2c41-403e-9023-2ee74e755f5e could not be found. Apr 19 16:38:33 user devstack@n-api.service[61471]: action_args: {'id': '795900b6-2c41-403e-9023-2ee74e755f5e'} Apr 19 16:38:33 user devstack@n-api.service[61471]: {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:38:33 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:38:33 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:38:33 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:38:33 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:38:33 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:38:33 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:38:33 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:38:33 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:38:33 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:38:33 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 795900b6-2c41-403e-9023-2ee74e755f5e could not be found. Apr 19 16:38:33 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:38:33 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:38:33 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:38:33 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:38:33 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:38:33 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:38:33 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:38:33 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:38:33 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:38:33 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:38:33 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 16:38:33 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 16:38:33 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:38:33 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:38:33 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:38:33 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:38:33 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 795900b6-2c41-403e-9023-2ee74e755f5e could not be found. Apr 19 16:38:33 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:38:33 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:38:33 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:38:33 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:38:33 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:38:33 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:38:33 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:38:33 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:38:33 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 795900b6-2c41-403e-9023-2ee74e755f5e could not be found. Apr 19 16:38:33 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:38:33 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-adc6ea91-450c-4386-b623-ce9fb04dd29c tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Returning 404 to user: Instance 795900b6-2c41-403e-9023-2ee74e755f5e could not be found. {{(pid=61471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:38:33 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-adc6ea91-450c-4386-b623-ce9fb04dd29c tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] 10.0.0.210 "GET /compute/v2.1/servers/795900b6-2c41-403e-9023-2ee74e755f5e" status: 404 len: 111 microversion: 2.1 time: 0.135537 Apr 19 16:38:33 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 71/208] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:38:33 2023] GET /compute/v2.1/servers/795900b6-2c41-403e-9023-2ee74e755f5e => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 16:38:33 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-adf67924-a521-4321-981b-945b4de5ac72 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Calling method '.version_select at 0x7fd49710e0e0>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:38:33 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-adf67924-a521-4321-981b-945b4de5ac72 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-376307208" status: 202 len: 0 microversion: 2.1 time: 0.022964 Apr 19 16:38:33 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 68/209] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 19 16:38:33 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-376307208 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 16:38:34 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-aef8af40-a766-4b0a-a713-074f8614d0ec tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Action: 'create', calling method: .version_select at 0x7fd497d8a5f0>, body: {"keypair": {"name": "tempest-keypair-367895079", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9gNQxDUtjKeU/tGZ7h6vms+tSkd6pB8W6AT1qI2pL0l3l8B6xxdecgdgmm7DG/cLoaPtXLy9iOK/lhC1C/W89kCchW4hXArZBit5IHTF4cMvnjlMqrvjP7A6IHvh57mw=="}} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:38:34 user devstack@n-api.service[61473]: DEBUG nova.quota [None req-aef8af40-a766-4b0a-a713-074f8614d0ec tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Getting quotas for project 821ceccc36de46f780e55a02f25782f4. Resources: {'key_pairs'} {{(pid=61473) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 16:38:34 user devstack@n-api.service[61473]: DEBUG nova.quota [None req-aef8af40-a766-4b0a-a713-074f8614d0ec tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Getting quotas for user c2563be52f624ceab060942e8bfcedef and project 821ceccc36de46f780e55a02f25782f4. Resources: {'key_pairs'} {{(pid=61473) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 16:38:34 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-aef8af40-a766-4b0a-a713-074f8614d0ec tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052438 Apr 19 16:38:34 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 71/210] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 16:38:34 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:38:35 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-0a969217-50f4-4ac3-9eb6-5c03ab43b60c tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:38:35 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-0a969217-50f4-4ac3-9eb6-5c03ab43b60c tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] [instance: edd2688e-940e-4ab3-b27c-b6d4aab3efc5] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:38:35 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-0a969217-50f4-4ac3-9eb6-5c03ab43b60c tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:38:35 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-0a969217-50f4-4ac3-9eb6-5c03ab43b60c tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:38:35 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-0a969217-50f4-4ac3-9eb6-5c03ab43b60c tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:38:35 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-0a969217-50f4-4ac3-9eb6-5c03ab43b60c tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:38:35 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-0a969217-50f4-4ac3-9eb6-5c03ab43b60c tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:38:35 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-0a969217-50f4-4ac3-9eb6-5c03ab43b60c tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:38:35 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-e7422c2b-17b4-43a2-aa72-e82edb3d7c05 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-294206784", "imageRef": "ab56c4b1-0117-43b0-84b6-28d06a23f182", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "543e5868-bf5f-41ca-a4b2-61c1cd6946cf"}], "security_groups": [{"name": "tempest-securitygroup--1504106713"}], "key_name": "tempest-keypair-367895079", "user_data": "}} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:38:36 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-0a969217-50f4-4ac3-9eb6-5c03ab43b60c tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023314f8cf79430b83c5184d9a54be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78962d13860a4df3a8aa100e2afaca6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:38:36 user devstack@n-api.service[61472]: DEBUG nova.network.neutron [None req-e7422c2b-17b4-43a2-aa72-e82edb3d7c05 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] validate_networks() for [('543e5868-bf5f-41ca-a4b2-61c1cd6946cf', None, None, None, None, None)] {{(pid=61472) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 16:38:36 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-0a969217-50f4-4ac3-9eb6-5c03ab43b60c tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] 10.0.0.210 "GET /compute/v2.1/servers/edd2688e-940e-4ab3-b27c-b6d4aab3efc5" status: 200 len: 1659 microversion: 2.1 time: 0.237269 Apr 19 16:38:36 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 72/211] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:38:35 2023] GET /compute/v2.1/servers/edd2688e-940e-4ab3-b27c-b6d4aab3efc5 => generated 1659 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:38:36 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-9f04e43d-05e4-4463-83fc-3aee6a145d6f tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:38:36 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-9f04e43d-05e4-4463-83fc-3aee6a145d6f tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] [instance: edd2688e-940e-4ab3-b27c-b6d4aab3efc5] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:38:36 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-9f04e43d-05e4-4463-83fc-3aee6a145d6f tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:38:36 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-9f04e43d-05e4-4463-83fc-3aee6a145d6f tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:38:36 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-9f04e43d-05e4-4463-83fc-3aee6a145d6f tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:38:36 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-9f04e43d-05e4-4463-83fc-3aee6a145d6f tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:38:36 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-9f04e43d-05e4-4463-83fc-3aee6a145d6f tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:38:36 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-9f04e43d-05e4-4463-83fc-3aee6a145d6f tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:38:36 user devstack@n-api.service[61473]: DEBUG nova.policy [None req-9f04e43d-05e4-4463-83fc-3aee6a145d6f tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023314f8cf79430b83c5184d9a54be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78962d13860a4df3a8aa100e2afaca6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61473) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:38:36 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-9f04e43d-05e4-4463-83fc-3aee6a145d6f tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] 10.0.0.210 "GET /compute/v2.1/servers/edd2688e-940e-4ab3-b27c-b6d4aab3efc5" status: 200 len: 1659 microversion: 2.1 time: 0.141624 Apr 19 16:38:36 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 72/212] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:38:36 2023] GET /compute/v2.1/servers/edd2688e-940e-4ab3-b27c-b6d4aab3efc5 => generated 1659 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:38:36 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-e7422c2b-17b4-43a2-aa72-e82edb3d7c05 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Flavor limits 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 16:38:36 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-e7422c2b-17b4-43a2-aa72-e82edb3d7c05 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Image limits 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 16:38:36 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-e7422c2b-17b4-43a2-aa72-e82edb3d7c05 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Flavor pref 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 16:38:36 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-e7422c2b-17b4-43a2-aa72-e82edb3d7c05 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Image pref 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 16:38:36 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-e7422c2b-17b4-43a2-aa72-e82edb3d7c05 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 16:38:36 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-e7422c2b-17b4-43a2-aa72-e82edb3d7c05 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:38:36 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-e7422c2b-17b4-43a2-aa72-e82edb3d7c05 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:38:36 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-e7422c2b-17b4-43a2-aa72-e82edb3d7c05 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:38:36 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-e7422c2b-17b4-43a2-aa72-e82edb3d7c05 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:38:36 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-e7422c2b-17b4-43a2-aa72-e82edb3d7c05 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:38:36 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-e7422c2b-17b4-43a2-aa72-e82edb3d7c05 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:38:36 user devstack@n-api.service[61472]: DEBUG nova.quota [None req-e7422c2b-17b4-43a2-aa72-e82edb3d7c05 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Getting quotas for project 821ceccc36de46f780e55a02f25782f4. Resources: {'instances', 'ram', 'cores'} {{(pid=61472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 16:38:36 user devstack@n-api.service[61472]: DEBUG nova.quota [None req-e7422c2b-17b4-43a2-aa72-e82edb3d7c05 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Getting quotas for user c2563be52f624ceab060942e8bfcedef and project 821ceccc36de46f780e55a02f25782f4. Resources: {'instances', 'ram', 'cores'} {{(pid=61472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 16:38:36 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-e7422c2b-17b4-43a2-aa72-e82edb3d7c05 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Going to run 1 instances... {{(pid=61472) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 16:38:36 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-e7422c2b-17b4-43a2-aa72-e82edb3d7c05 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] [instance: a674a13f-daf9-4a94-b8ec-48e0426eacb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ab56c4b1-0117-43b0-84b6-28d06a23f182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 16:38:36 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-e7422c2b-17b4-43a2-aa72-e82edb3d7c05 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.788771 Apr 19 16:38:36 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 69/213] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 16:38:35 2023] POST /compute/v2.1/servers => generated 400 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 16:38:36 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-c68a375f-c93d-4782-a8fe-9e42f977606e tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:38:36 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-c68a375f-c93d-4782-a8fe-9e42f977606e tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] [instance: a674a13f-daf9-4a94-b8ec-48e0426eacb2] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:38:36 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-c68a375f-c93d-4782-a8fe-9e42f977606e tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2563be52f624ceab060942e8bfcedef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ceccc36de46f780e55a02f25782f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:38:36 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-c68a375f-c93d-4782-a8fe-9e42f977606e tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a674a13f-daf9-4a94-b8ec-48e0426eacb2" status: 200 len: 1234 microversion: 2.1 time: 0.066902 Apr 19 16:38:36 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 73/214] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:38:36 2023] GET /compute/v2.1/servers/a674a13f-daf9-4a94-b8ec-48e0426eacb2 => generated 1234 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:38:39 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-991e88cd-3fc4-4c27-950d-d271d38bd121 req-37a397a7-f790-4a85-b441-6b58d7c180d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a674a13f-daf9-4a94-b8ec-48e0426eacb2", "tag": "b59f650d-f906-41fc-a3bd-17631861ada4"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:38:39 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-991e88cd-3fc4-4c27-950d-d271d38bd121 req-37a397a7-f790-4a85-b441-6b58d7c180d1 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:38:39 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-991e88cd-3fc4-4c27-950d-d271d38bd121 req-37a397a7-f790-4a85-b441-6b58d7c180d1 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:38:39 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-991e88cd-3fc4-4c27-950d-d271d38bd121 req-37a397a7-f790-4a85-b441-6b58d7c180d1 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:38:39 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-991e88cd-3fc4-4c27-950d-d271d38bd121 req-37a397a7-f790-4a85-b441-6b58d7c180d1 service nova] Creating event network-changed:b59f650d-f906-41fc-a3bd-17631861ada4 for instance a674a13f-daf9-4a94-b8ec-48e0426eacb2 on user Apr 19 16:38:39 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-991e88cd-3fc4-4c27-950d-d271d38bd121 req-37a397a7-f790-4a85-b441-6b58d7c180d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030721 Apr 19 16:38:39 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 73/215] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:38:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:38:41 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [req-450ea0c4-64dc-4f05-afa7-7931f354cb46 req-711b3c03-2b69-4847-86d9-43bbb1ac60ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a674a13f-daf9-4a94-b8ec-48e0426eacb2", "name": "network-vif-plugged", "status": "completed", "tag": "b59f650d-f906-41fc-a3bd-17631861ada4"}]} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:38:41 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-450ea0c4-64dc-4f05-afa7-7931f354cb46 req-711b3c03-2b69-4847-86d9-43bbb1ac60ca service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:38:41 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-450ea0c4-64dc-4f05-afa7-7931f354cb46 req-711b3c03-2b69-4847-86d9-43bbb1ac60ca service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:38:41 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-450ea0c4-64dc-4f05-afa7-7931f354cb46 req-711b3c03-2b69-4847-86d9-43bbb1ac60ca service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:38:41 user devstack@n-api.service[61472]: INFO nova.api.openstack.compute.server_external_events [req-450ea0c4-64dc-4f05-afa7-7931f354cb46 req-711b3c03-2b69-4847-86d9-43bbb1ac60ca service nova] Creating event network-vif-plugged:b59f650d-f906-41fc-a3bd-17631861ada4 for instance a674a13f-daf9-4a94-b8ec-48e0426eacb2 on user Apr 19 16:38:41 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [req-450ea0c4-64dc-4f05-afa7-7931f354cb46 req-711b3c03-2b69-4847-86d9-43bbb1ac60ca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039950 Apr 19 16:38:41 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 70/216] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:38:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:38:42 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-67a1b1e4-9526-4fc0-9c71-f6f5b1730784 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-214451105"}} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:38:42 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-67a1b1e4-9526-4fc0-9c71-f6f5b1730784 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] [instance: 269dc247-e424-4102-9c7f-1f3da95afebf] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:38:42 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-67a1b1e4-9526-4fc0-9c71-f6f5b1730784 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:38:42 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-67a1b1e4-9526-4fc0-9c71-f6f5b1730784 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:38:42 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-67a1b1e4-9526-4fc0-9c71-f6f5b1730784 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:38:42 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-67a1b1e4-9526-4fc0-9c71-f6f5b1730784 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:38:42 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-67a1b1e4-9526-4fc0-9c71-f6f5b1730784 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:38:42 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-67a1b1e4-9526-4fc0-9c71-f6f5b1730784 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:38:43 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-329a67a9-61f8-441c-9f95-41bf45af3cba req-2a81e755-2b77-42e7-a6b6-4912b542e866 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a674a13f-daf9-4a94-b8ec-48e0426eacb2", "name": "network-vif-plugged", "status": "completed", "tag": "b59f650d-f906-41fc-a3bd-17631861ada4"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:38:43 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-329a67a9-61f8-441c-9f95-41bf45af3cba req-2a81e755-2b77-42e7-a6b6-4912b542e866 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:38:43 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-329a67a9-61f8-441c-9f95-41bf45af3cba req-2a81e755-2b77-42e7-a6b6-4912b542e866 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:38:43 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-329a67a9-61f8-441c-9f95-41bf45af3cba req-2a81e755-2b77-42e7-a6b6-4912b542e866 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:38:43 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-329a67a9-61f8-441c-9f95-41bf45af3cba req-2a81e755-2b77-42e7-a6b6-4912b542e866 service nova] Creating event network-vif-plugged:b59f650d-f906-41fc-a3bd-17631861ada4 for instance a674a13f-daf9-4a94-b8ec-48e0426eacb2 on user Apr 19 16:38:43 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-329a67a9-61f8-441c-9f95-41bf45af3cba req-2a81e755-2b77-42e7-a6b6-4912b542e866 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028959 Apr 19 16:38:43 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 74/217] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:38:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:38:43 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-67a1b1e4-9526-4fc0-9c71-f6f5b1730784 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] 10.0.0.210 "POST /compute/v2.1/servers/269dc247-e424-4102-9c7f-1f3da95afebf/action" status: 202 len: 52 microversion: 2.87 time: 0.979374 Apr 19 16:38:43 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 74/218] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 19 16:38:42 2023] POST /compute/v2.1/servers/269dc247-e424-4102-9c7f-1f3da95afebf/action => generated 52 bytes in 981 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 19 16:38:48 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-05025f92-e587-4450-a720-776fc70abd5c tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:38:48 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-05025f92-e587-4450-a720-776fc70abd5c tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] [instance: 269dc247-e424-4102-9c7f-1f3da95afebf] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:38:48 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell0:SELECT=2 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:38:48 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell0:SELECT=6 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:38:48 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-05025f92-e587-4450-a720-776fc70abd5c tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:38:48 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-05025f92-e587-4450-a720-776fc70abd5c tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:38:48 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-05025f92-e587-4450-a720-776fc70abd5c tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:38:48 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-05025f92-e587-4450-a720-776fc70abd5c tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:38:48 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-05025f92-e587-4450-a720-776fc70abd5c tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:38:48 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-05025f92-e587-4450-a720-776fc70abd5c tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:38:49 user devstack@n-api.service[61472]: DEBUG nova.policy [None req-05025f92-e587-4450-a720-776fc70abd5c tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f2a02626ca4957823de39c9a31d1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ee4833fd147e2a494be5d7634a2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61472) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:38:49 user devstack@n-api.service[61472]: DEBUG nova.policy [None req-05025f92-e587-4450-a720-776fc70abd5c tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63f2a02626ca4957823de39c9a31d1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ee4833fd147e2a494be5d7634a2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61472) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:38:49 user devstack@n-api.service[61472]: DEBUG nova.policy [None req-05025f92-e587-4450-a720-776fc70abd5c tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63f2a02626ca4957823de39c9a31d1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ee4833fd147e2a494be5d7634a2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61472) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:38:49 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-05025f92-e587-4450-a720-776fc70abd5c tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] 10.0.0.210 "GET /compute/v2.1/servers/269dc247-e424-4102-9c7f-1f3da95afebf" status: 200 len: 1691 microversion: 2.87 time: 0.280095 Apr 19 16:38:49 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 71/219] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 16:38:48 2023] GET /compute/v2.1/servers/269dc247-e424-4102-9c7f-1f3da95afebf => generated 1691 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 16:38:52 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell0:SELECT=4 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:38:52 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-49013871-496b-43ec-b7f7-0fedfae8ad79 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:38:52 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-49013871-496b-43ec-b7f7-0fedfae8ad79 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] [instance: ded3b7ea-2e6a-4aa9-b658-424a8bea42bc] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:38:52 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-49013871-496b-43ec-b7f7-0fedfae8ad79 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:38:52 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-49013871-496b-43ec-b7f7-0fedfae8ad79 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:38:52 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-49013871-496b-43ec-b7f7-0fedfae8ad79 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:38:52 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-49013871-496b-43ec-b7f7-0fedfae8ad79 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:38:52 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-49013871-496b-43ec-b7f7-0fedfae8ad79 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:38:52 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-49013871-496b-43ec-b7f7-0fedfae8ad79 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:38:52 user devstack@n-api.service[61473]: INFO nova.api.openstack.wsgi [None req-49013871-496b-43ec-b7f7-0fedfae8ad79 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] HTTP exception thrown: Instance ded3b7ea-2e6a-4aa9-b658-424a8bea42bc could not be found. Apr 19 16:38:52 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-49013871-496b-43ec-b7f7-0fedfae8ad79 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Request method failure captured: Apr 19 16:38:52 user devstack@n-api.service[61473]: request: GET /compute/v2.1/servers/ded3b7ea-2e6a-4aa9-b658-424a8bea42bc HTTP/1.1 Apr 19 16:38:52 user devstack@n-api.service[61473]: Accept: application/json Apr 19 16:38:52 user devstack@n-api.service[61473]: Accept-Encoding: identity Apr 19 16:38:52 user devstack@n-api.service[61473]: Connection: close Apr 19 16:38:52 user devstack@n-api.service[61473]: Content-Length: 0 Apr 19 16:38:52 user devstack@n-api.service[61473]: Content-Type: application/json Apr 19 16:38:52 user devstack@n-api.service[61473]: Host: 10.0.0.210 Apr 19 16:38:52 user devstack@n-api.service[61473]: Openstack-System-Scope: None Apr 19 16:38:52 user devstack@n-api.service[61473]: User-Agent: python-urllib3/1.26.15 Apr 19 16:38:52 user devstack@n-api.service[61473]: X-Auth-Token: gAAAAABkQBe7WEOKbTv5dhOvCmDmECRc3hvx1T4oHDfHV7vpCP0Oweo2-oahRXHc1Qi4oi3rye81Es5GziFyKdgG5dtxuEUBm_yNWtGvHANgtuXvQe-T8KtgBZhiqbt8YO9BavTfBk1ul9u9py6Puufy5zUymv0L7lN86JcDgeUb19Jsr-71Vko Apr 19 16:38:52 user devstack@n-api.service[61473]: X-Domain-Id: None Apr 19 16:38:52 user devstack@n-api.service[61473]: X-Domain-Name: None Apr 19 16:38:52 user devstack@n-api.service[61473]: X-Identity-Status: Confirmed Apr 19 16:38:52 user devstack@n-api.service[61473]: X-Is-Admin-Project: True Apr 19 16:38:52 user devstack@n-api.service[61473]: X-Project-Domain-Id: default Apr 19 16:38:52 user devstack@n-api.service[61473]: X-Project-Domain-Name: Default Apr 19 16:38:52 user devstack@n-api.service[61473]: X-Project-Id: ee32e72a51414422bfad5875f32b1515 Apr 19 16:38:52 user devstack@n-api.service[61473]: X-Project-Name: tempest-VolumesAdminNegativeTest-1517925245 Apr 19 16:38:52 user devstack@n-api.service[61473]: X-Role: member,reader Apr 19 16:38:52 user devstack@n-api.service[61473]: X-Roles: member,reader Apr 19 16:38:52 user devstack@n-api.service[61473]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ee32e72a51414422bfad5875f32b1515"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ee32e72a51414422bfad5875f32b1515"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ee32e72a51414422bfad5875f32b1515"}]}] Apr 19 16:38:52 user devstack@n-api.service[61473]: X-Tenant: tempest-VolumesAdminNegativeTest-1517925245 Apr 19 16:38:52 user devstack@n-api.service[61473]: X-Tenant-Id: ee32e72a51414422bfad5875f32b1515 Apr 19 16:38:52 user devstack@n-api.service[61473]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1517925245 Apr 19 16:38:52 user devstack@n-api.service[61473]: X-User: tempest-VolumesAdminNegativeTest-1517925245-project-member Apr 19 16:38:52 user devstack@n-api.service[61473]: X-User-Domain-Id: default Apr 19 16:38:52 user devstack@n-api.service[61473]: X-User-Domain-Name: Default Apr 19 16:38:52 user devstack@n-api.service[61473]: X-User-Id: 6be99c3ba0554acda7b418f66a31c943 Apr 19 16:38:52 user devstack@n-api.service[61473]: X-User-Name: tempest-VolumesAdminNegativeTest-1517925245-project-member Apr 19 16:38:52 user devstack@n-api.service[61473]: method: > Apr 19 16:38:52 user devstack@n-api.service[61473]: exception: Instance ded3b7ea-2e6a-4aa9-b658-424a8bea42bc could not be found. Apr 19 16:38:52 user devstack@n-api.service[61473]: action_args: {'id': 'ded3b7ea-2e6a-4aa9-b658-424a8bea42bc'} Apr 19 16:38:52 user devstack@n-api.service[61473]: {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:38:52 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:38:52 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:38:52 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:38:52 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:38:52 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:38:52 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:38:52 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:38:52 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:38:52 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:38:52 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ded3b7ea-2e6a-4aa9-b658-424a8bea42bc could not be found. Apr 19 16:38:52 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:38:52 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:38:52 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:38:52 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:38:52 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:38:52 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:38:52 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:38:52 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:38:52 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:38:52 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:38:52 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 16:38:52 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 16:38:52 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:38:52 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:38:52 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:38:52 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:38:52 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ded3b7ea-2e6a-4aa9-b658-424a8bea42bc could not be found. Apr 19 16:38:52 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:38:52 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:38:52 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:38:52 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:38:52 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:38:52 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:38:52 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:38:52 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:38:52 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ded3b7ea-2e6a-4aa9-b658-424a8bea42bc could not be found. Apr 19 16:38:52 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:38:52 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-49013871-496b-43ec-b7f7-0fedfae8ad79 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Returning 404 to user: Instance ded3b7ea-2e6a-4aa9-b658-424a8bea42bc could not be found. {{(pid=61473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:38:52 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-49013871-496b-43ec-b7f7-0fedfae8ad79 tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ded3b7ea-2e6a-4aa9-b658-424a8bea42bc" status: 404 len: 111 microversion: 2.1 time: 0.140592 Apr 19 16:38:52 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 75/220] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:38:52 2023] GET /compute/v2.1/servers/ded3b7ea-2e6a-4aa9-b658-424a8bea42bc => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 16:38:52 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell0:SELECT=2 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:38:52 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-da37f6a1-db0b-4fad-88c6-0114b9f0833e tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] Calling method '.version_select at 0x7fd4971a7520>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:38:52 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-da37f6a1-db0b-4fad-88c6-0114b9f0833e tempest-VolumesAdminNegativeTest-1517925245 tempest-VolumesAdminNegativeTest-1517925245-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1825122389" status: 202 len: 0 microversion: 2.1 time: 0.021979 Apr 19 16:38:52 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 75/221] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 19 16:38:52 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1825122389 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 16:39:01 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:39:01 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:39:01 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-ca4a5be9-ba14-488f-abf2-818eeb0b7ca0 tempest-VolumesGetTestJSON-1911529716 tempest-VolumesGetTestJSON-1911529716-project-member] Action: 'create', calling method: .version_select at 0x7fd49710dea0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-688887528", "metadata": {"Type": "work"}}} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:39:02 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-ca4a5be9-ba14-488f-abf2-818eeb0b7ca0 tempest-VolumesGetTestJSON-1911529716 tempest-VolumesGetTestJSON-1911529716-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.476832 Apr 19 16:39:02 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 72/222] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 19 16:39:01 2023] POST /compute/v2.1/os-volumes => generated 352 bytes in 479 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 19 16:39:02 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-99f5abb2-0c8a-4908-9699-99213af32f8f tempest-VolumesGetTestJSON-1911529716 tempest-VolumesGetTestJSON-1911529716-project-member] Calling method '.version_select at 0x7fd49711ed40>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:39:02 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-99f5abb2-0c8a-4908-9699-99213af32f8f tempest-VolumesGetTestJSON-1911529716 tempest-VolumesGetTestJSON-1911529716-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/8ff4b978-bbb1-4aef-a9bb-c9b3c503a61a" status: 200 len: 349 microversion: 2.1 time: 0.052243 Apr 19 16:39:02 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 76/223] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 19 16:39:02 2023] GET /compute/v2.1/os-volumes/8ff4b978-bbb1-4aef-a9bb-c9b3c503a61a => generated 349 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:39:03 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:39:03 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:39:03 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-cd812899-a20d-40fa-966f-315ee68e1753 tempest-VolumesGetTestJSON-1911529716 tempest-VolumesGetTestJSON-1911529716-project-member] Calling method '.version_select at 0x7fd4971f04c0>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:39:03 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-cd812899-a20d-40fa-966f-315ee68e1753 tempest-VolumesGetTestJSON-1911529716 tempest-VolumesGetTestJSON-1911529716-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/8ff4b978-bbb1-4aef-a9bb-c9b3c503a61a" status: 200 len: 349 microversion: 2.1 time: 0.066898 Apr 19 16:39:03 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 76/224] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 19 16:39:03 2023] GET /compute/v2.1/os-volumes/8ff4b978-bbb1-4aef-a9bb-c9b3c503a61a => generated 349 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:39:03 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-bb492274-8865-444a-a982-01c360ac8146 tempest-VolumesGetTestJSON-1911529716 tempest-VolumesGetTestJSON-1911529716-project-member] Calling method '.version_select at 0x7fd49716e050>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:39:03 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-bb492274-8865-444a-a982-01c360ac8146 tempest-VolumesGetTestJSON-1911529716 tempest-VolumesGetTestJSON-1911529716-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/8ff4b978-bbb1-4aef-a9bb-c9b3c503a61a" status: 202 len: 0 microversion: 2.1 time: 0.111043 Apr 19 16:39:03 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 73/225] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 19 16:39:03 2023] DELETE /compute/v2.1/os-volumes/8ff4b978-bbb1-4aef-a9bb-c9b3c503a61a => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 16:39:03 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:39:03 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell1:SELECT=24 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:39:03 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-176593fe-27ab-4e66-8a2d-e630b45044c2 tempest-VolumesGetTestJSON-1911529716 tempest-VolumesGetTestJSON-1911529716-project-member] Calling method '.version_select at 0x7fd49711f490>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:39:03 user devstack@n-api.service[61473]: INFO nova.api.openstack.wsgi [None req-176593fe-27ab-4e66-8a2d-e630b45044c2 tempest-VolumesGetTestJSON-1911529716 tempest-VolumesGetTestJSON-1911529716-project-member] HTTP exception thrown: Volume 8ff4b978-bbb1-4aef-a9bb-c9b3c503a61a could not be found. Apr 19 16:39:03 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-176593fe-27ab-4e66-8a2d-e630b45044c2 tempest-VolumesGetTestJSON-1911529716 tempest-VolumesGetTestJSON-1911529716-project-member] Request method failure captured: Apr 19 16:39:03 user devstack@n-api.service[61473]: request: GET /compute/v2.1/os-volumes/8ff4b978-bbb1-4aef-a9bb-c9b3c503a61a HTTP/1.1 Apr 19 16:39:03 user devstack@n-api.service[61473]: Accept: application/json Apr 19 16:39:03 user devstack@n-api.service[61473]: Accept-Encoding: identity Apr 19 16:39:03 user devstack@n-api.service[61473]: Connection: close Apr 19 16:39:03 user devstack@n-api.service[61473]: Content-Length: 0 Apr 19 16:39:03 user devstack@n-api.service[61473]: Content-Type: application/json Apr 19 16:39:03 user devstack@n-api.service[61473]: Host: 10.0.0.210 Apr 19 16:39:03 user devstack@n-api.service[61473]: Openstack-System-Scope: None Apr 19 16:39:03 user devstack@n-api.service[61473]: User-Agent: python-urllib3/1.26.15 Apr 19 16:39:03 user devstack@n-api.service[61473]: X-Auth-Token: gAAAAABkQBklIi0zg4BeQpov1HMtFgBos4QBia588Ofscs3d-dDCwH-84wun6hIb-7PIADZ9RXVaoAxrETfilQK3mU950fUzcmRkObMoR_jrrQbqACjurukkmrzSp-g_H6V0MooVGAwqstT_FMcxmyeWBXzuS8lki0kBwaT-WMRzjG0ngr9UvaM Apr 19 16:39:03 user devstack@n-api.service[61473]: X-Domain-Id: None Apr 19 16:39:03 user devstack@n-api.service[61473]: X-Domain-Name: None Apr 19 16:39:03 user devstack@n-api.service[61473]: X-Identity-Status: Confirmed Apr 19 16:39:03 user devstack@n-api.service[61473]: X-Is-Admin-Project: True Apr 19 16:39:03 user devstack@n-api.service[61473]: X-Project-Domain-Id: default Apr 19 16:39:03 user devstack@n-api.service[61473]: X-Project-Domain-Name: Default Apr 19 16:39:03 user devstack@n-api.service[61473]: X-Project-Id: 290666b5db9845f7a74b110edcfbc0f2 Apr 19 16:39:03 user devstack@n-api.service[61473]: X-Project-Name: tempest-VolumesGetTestJSON-1911529716 Apr 19 16:39:03 user devstack@n-api.service[61473]: X-Role: member,reader Apr 19 16:39:03 user devstack@n-api.service[61473]: X-Roles: member,reader Apr 19 16:39:03 user devstack@n-api.service[61473]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/290666b5db9845f7a74b110edcfbc0f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/290666b5db9845f7a74b110edcfbc0f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/290666b5db9845f7a74b110edcfbc0f2"}]}] Apr 19 16:39:03 user devstack@n-api.service[61473]: X-Tenant: tempest-VolumesGetTestJSON-1911529716 Apr 19 16:39:03 user devstack@n-api.service[61473]: X-Tenant-Id: 290666b5db9845f7a74b110edcfbc0f2 Apr 19 16:39:03 user devstack@n-api.service[61473]: X-Tenant-Name: tempest-VolumesGetTestJSON-1911529716 Apr 19 16:39:03 user devstack@n-api.service[61473]: X-User: tempest-VolumesGetTestJSON-1911529716-project-member Apr 19 16:39:03 user devstack@n-api.service[61473]: X-User-Domain-Id: default Apr 19 16:39:03 user devstack@n-api.service[61473]: X-User-Domain-Name: Default Apr 19 16:39:03 user devstack@n-api.service[61473]: X-User-Id: ef980e67120444b78f6b76f578547ddf Apr 19 16:39:03 user devstack@n-api.service[61473]: X-User-Name: tempest-VolumesGetTestJSON-1911529716-project-member Apr 19 16:39:03 user devstack@n-api.service[61473]: method: Apr 19 16:39:03 user devstack@n-api.service[61473]: exception: Volume 8ff4b978-bbb1-4aef-a9bb-c9b3c503a61a could not be found. Apr 19 16:39:03 user devstack@n-api.service[61473]: action_args: {'id': '8ff4b978-bbb1-4aef-a9bb-c9b3c503a61a'} Apr 19 16:39:03 user devstack@n-api.service[61473]: {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8ff4b978-bbb1-4aef-a9bb-c9b3c503a61a could not be found. (HTTP 404) (Request-ID: req-9b7dbeaf-55f0-424c-bf5e-b96efc97c9f5) Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8ff4b978-bbb1-4aef-a9bb-c9b3c503a61a could not be found. Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8ff4b978-bbb1-4aef-a9bb-c9b3c503a61a could not be found. Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8ff4b978-bbb1-4aef-a9bb-c9b3c503a61a could not be found. Apr 19 16:39:03 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:39:03 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-176593fe-27ab-4e66-8a2d-e630b45044c2 tempest-VolumesGetTestJSON-1911529716 tempest-VolumesGetTestJSON-1911529716-project-member] Returning 404 to user: Volume 8ff4b978-bbb1-4aef-a9bb-c9b3c503a61a could not be found. {{(pid=61473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:39:03 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-176593fe-27ab-4e66-8a2d-e630b45044c2 tempest-VolumesGetTestJSON-1911529716 tempest-VolumesGetTestJSON-1911529716-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/8ff4b978-bbb1-4aef-a9bb-c9b3c503a61a" status: 404 len: 109 microversion: 2.1 time: 0.044970 Apr 19 16:39:03 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 77/226] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 19 16:39:03 2023] GET /compute/v2.1/os-volumes/8ff4b978-bbb1-4aef-a9bb-c9b3c503a61a => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 16:39:20 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-500c6305-e8e8-45ff-9c25-419c10a07039 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:39:20 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-500c6305-e8e8-45ff-9c25-419c10a07039 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] [instance: c513f20d-c24e-4270-a28e-5374940abf6f] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:39:20 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-500c6305-e8e8-45ff-9c25-419c10a07039 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:39:20 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-500c6305-e8e8-45ff-9c25-419c10a07039 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:39:20 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-500c6305-e8e8-45ff-9c25-419c10a07039 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:39:20 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-500c6305-e8e8-45ff-9c25-419c10a07039 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:39:20 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-500c6305-e8e8-45ff-9c25-419c10a07039 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:39:20 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-500c6305-e8e8-45ff-9c25-419c10a07039 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:39:20 user devstack@n-api.service[61471]: INFO nova.api.openstack.wsgi [None req-500c6305-e8e8-45ff-9c25-419c10a07039 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] HTTP exception thrown: Instance c513f20d-c24e-4270-a28e-5374940abf6f could not be found. Apr 19 16:39:20 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-500c6305-e8e8-45ff-9c25-419c10a07039 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Request method failure captured: Apr 19 16:39:20 user devstack@n-api.service[61471]: request: GET /compute/v2.1/servers/c513f20d-c24e-4270-a28e-5374940abf6f HTTP/1.1 Apr 19 16:39:20 user devstack@n-api.service[61471]: Accept: application/json Apr 19 16:39:20 user devstack@n-api.service[61471]: Accept-Encoding: identity Apr 19 16:39:20 user devstack@n-api.service[61471]: Connection: close Apr 19 16:39:20 user devstack@n-api.service[61471]: Content-Length: 0 Apr 19 16:39:20 user devstack@n-api.service[61471]: Content-Type: application/json Apr 19 16:39:20 user devstack@n-api.service[61471]: Host: 10.0.0.210 Apr 19 16:39:20 user devstack@n-api.service[61471]: Openstack-System-Scope: None Apr 19 16:39:20 user devstack@n-api.service[61471]: User-Agent: python-urllib3/1.26.15 Apr 19 16:39:20 user devstack@n-api.service[61471]: X-Auth-Token: gAAAAABkQBfpQ-u-azfabAlvotj0rQjoBYSAwwdbtalXo97-1uWGtb-3J70LWqoYyULHaD5-r8Tw0_rmwdlFubJ2wHduR88gko_stfx0p648gbrxtRIcpHqSgPOdGIA_3JZ8n9JlBb7qsFOzOpr_00QdyDu_86yRrH-UlS-aylJh1eEy92_ONQM Apr 19 16:39:20 user devstack@n-api.service[61471]: X-Domain-Id: None Apr 19 16:39:20 user devstack@n-api.service[61471]: X-Domain-Name: None Apr 19 16:39:20 user devstack@n-api.service[61471]: X-Identity-Status: Confirmed Apr 19 16:39:20 user devstack@n-api.service[61471]: X-Is-Admin-Project: True Apr 19 16:39:20 user devstack@n-api.service[61471]: X-Openstack-Nova-Api-Version: 2.20 Apr 19 16:39:20 user devstack@n-api.service[61471]: X-Project-Domain-Id: default Apr 19 16:39:20 user devstack@n-api.service[61471]: X-Project-Domain-Name: Default Apr 19 16:39:20 user devstack@n-api.service[61471]: X-Project-Id: d29a717b7f334af5a35d9e86c3d4b085 Apr 19 16:39:20 user devstack@n-api.service[61471]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1882422304 Apr 19 16:39:20 user devstack@n-api.service[61471]: X-Role: member,reader Apr 19 16:39:20 user devstack@n-api.service[61471]: X-Roles: member,reader Apr 19 16:39:20 user devstack@n-api.service[61471]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d29a717b7f334af5a35d9e86c3d4b085"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d29a717b7f334af5a35d9e86c3d4b085"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d29a717b7f334af5a35d9e86c3d4b085"}]}] Apr 19 16:39:20 user devstack@n-api.service[61471]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1882422304 Apr 19 16:39:20 user devstack@n-api.service[61471]: X-Tenant-Id: d29a717b7f334af5a35d9e86c3d4b085 Apr 19 16:39:20 user devstack@n-api.service[61471]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1882422304 Apr 19 16:39:20 user devstack@n-api.service[61471]: X-User: tempest-AttachVolumeShelveTestJSON-1882422304-project-member Apr 19 16:39:20 user devstack@n-api.service[61471]: X-User-Domain-Id: default Apr 19 16:39:20 user devstack@n-api.service[61471]: X-User-Domain-Name: Default Apr 19 16:39:20 user devstack@n-api.service[61471]: X-User-Id: 34afcb1cb8d2433b9564e5b62b45fe86 Apr 19 16:39:20 user devstack@n-api.service[61471]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1882422304-project-member Apr 19 16:39:20 user devstack@n-api.service[61471]: method: > Apr 19 16:39:20 user devstack@n-api.service[61471]: exception: Instance c513f20d-c24e-4270-a28e-5374940abf6f could not be found. Apr 19 16:39:20 user devstack@n-api.service[61471]: action_args: {'id': 'c513f20d-c24e-4270-a28e-5374940abf6f'} Apr 19 16:39:20 user devstack@n-api.service[61471]: {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:39:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:39:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:39:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:39:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:39:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:39:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:39:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:39:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:39:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:39:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c513f20d-c24e-4270-a28e-5374940abf6f could not be found. Apr 19 16:39:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:39:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:39:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:39:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:39:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:39:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:39:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:39:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:39:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:39:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:39:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 16:39:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 16:39:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:39:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:39:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:39:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:39:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c513f20d-c24e-4270-a28e-5374940abf6f could not be found. Apr 19 16:39:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:39:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:39:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:39:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:39:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:39:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:39:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:39:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:39:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c513f20d-c24e-4270-a28e-5374940abf6f could not be found. Apr 19 16:39:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:39:20 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-500c6305-e8e8-45ff-9c25-419c10a07039 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Returning 404 to user: Instance c513f20d-c24e-4270-a28e-5374940abf6f could not be found. {{(pid=61471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:39:20 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-500c6305-e8e8-45ff-9c25-419c10a07039 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c513f20d-c24e-4270-a28e-5374940abf6f" status: 404 len: 111 microversion: 2.20 time: 0.277222 Apr 19 16:39:20 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 77/227] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 16:39:19 2023] GET /compute/v2.1/servers/c513f20d-c24e-4270-a28e-5374940abf6f => generated 111 bytes in 278 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 16:39:20 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-71adbb65-8e84-4db6-b584-7b38dded5f32 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Calling method '.version_select at 0x7fd49710e0e0>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:39:20 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-71adbb65-8e84-4db6-b584-7b38dded5f32 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-379264232" status: 204 len: 0 microversion: 2.20 time: 0.023253 Apr 19 16:39:20 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 74/228] 10.0.0.210 () {64 vars in 1336 bytes} [Wed Apr 19 16:39:20 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-379264232 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 19 16:39:21 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-8ed317df-50e6-4b8a-9a48-e00c0fd28131 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:39:21 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-8ed317df-50e6-4b8a-9a48-e00c0fd28131 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] [instance: c513f20d-c24e-4270-a28e-5374940abf6f] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:39:21 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-8ed317df-50e6-4b8a-9a48-e00c0fd28131 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:39:21 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-8ed317df-50e6-4b8a-9a48-e00c0fd28131 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:39:21 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-8ed317df-50e6-4b8a-9a48-e00c0fd28131 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:39:21 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-8ed317df-50e6-4b8a-9a48-e00c0fd28131 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:39:21 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-8ed317df-50e6-4b8a-9a48-e00c0fd28131 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:39:21 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-8ed317df-50e6-4b8a-9a48-e00c0fd28131 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:39:21 user devstack@n-api.service[61473]: INFO nova.api.openstack.wsgi [None req-8ed317df-50e6-4b8a-9a48-e00c0fd28131 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] HTTP exception thrown: Instance c513f20d-c24e-4270-a28e-5374940abf6f could not be found. Apr 19 16:39:21 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-8ed317df-50e6-4b8a-9a48-e00c0fd28131 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Request method failure captured: Apr 19 16:39:21 user devstack@n-api.service[61473]: request: DELETE /compute/v2.1/servers/c513f20d-c24e-4270-a28e-5374940abf6f HTTP/1.1 Apr 19 16:39:21 user devstack@n-api.service[61473]: Accept: application/json Apr 19 16:39:21 user devstack@n-api.service[61473]: Accept-Encoding: identity Apr 19 16:39:21 user devstack@n-api.service[61473]: Connection: close Apr 19 16:39:21 user devstack@n-api.service[61473]: Content-Length: 0 Apr 19 16:39:21 user devstack@n-api.service[61473]: Content-Type: application/json Apr 19 16:39:21 user devstack@n-api.service[61473]: Host: 10.0.0.210 Apr 19 16:39:21 user devstack@n-api.service[61473]: Openstack-System-Scope: None Apr 19 16:39:21 user devstack@n-api.service[61473]: User-Agent: python-urllib3/1.26.15 Apr 19 16:39:21 user devstack@n-api.service[61473]: X-Auth-Token: gAAAAABkQBfpQ-u-azfabAlvotj0rQjoBYSAwwdbtalXo97-1uWGtb-3J70LWqoYyULHaD5-r8Tw0_rmwdlFubJ2wHduR88gko_stfx0p648gbrxtRIcpHqSgPOdGIA_3JZ8n9JlBb7qsFOzOpr_00QdyDu_86yRrH-UlS-aylJh1eEy92_ONQM Apr 19 16:39:21 user devstack@n-api.service[61473]: X-Domain-Id: None Apr 19 16:39:21 user devstack@n-api.service[61473]: X-Domain-Name: None Apr 19 16:39:21 user devstack@n-api.service[61473]: X-Identity-Status: Confirmed Apr 19 16:39:21 user devstack@n-api.service[61473]: X-Is-Admin-Project: True Apr 19 16:39:21 user devstack@n-api.service[61473]: X-Openstack-Nova-Api-Version: 2.20 Apr 19 16:39:21 user devstack@n-api.service[61473]: X-Project-Domain-Id: default Apr 19 16:39:21 user devstack@n-api.service[61473]: X-Project-Domain-Name: Default Apr 19 16:39:21 user devstack@n-api.service[61473]: X-Project-Id: d29a717b7f334af5a35d9e86c3d4b085 Apr 19 16:39:21 user devstack@n-api.service[61473]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1882422304 Apr 19 16:39:21 user devstack@n-api.service[61473]: X-Role: member,reader Apr 19 16:39:21 user devstack@n-api.service[61473]: X-Roles: member,reader Apr 19 16:39:21 user devstack@n-api.service[61473]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d29a717b7f334af5a35d9e86c3d4b085"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d29a717b7f334af5a35d9e86c3d4b085"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d29a717b7f334af5a35d9e86c3d4b085"}]}] Apr 19 16:39:21 user devstack@n-api.service[61473]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1882422304 Apr 19 16:39:21 user devstack@n-api.service[61473]: X-Tenant-Id: d29a717b7f334af5a35d9e86c3d4b085 Apr 19 16:39:21 user devstack@n-api.service[61473]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1882422304 Apr 19 16:39:21 user devstack@n-api.service[61473]: X-User: tempest-AttachVolumeShelveTestJSON-1882422304-project-member Apr 19 16:39:21 user devstack@n-api.service[61473]: X-User-Domain-Id: default Apr 19 16:39:21 user devstack@n-api.service[61473]: X-User-Domain-Name: Default Apr 19 16:39:21 user devstack@n-api.service[61473]: X-User-Id: 34afcb1cb8d2433b9564e5b62b45fe86 Apr 19 16:39:21 user devstack@n-api.service[61473]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1882422304-project-member Apr 19 16:39:21 user devstack@n-api.service[61473]: method: > Apr 19 16:39:21 user devstack@n-api.service[61473]: exception: Instance c513f20d-c24e-4270-a28e-5374940abf6f could not be found. Apr 19 16:39:21 user devstack@n-api.service[61473]: action_args: {'id': 'c513f20d-c24e-4270-a28e-5374940abf6f'} Apr 19 16:39:21 user devstack@n-api.service[61473]: {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c513f20d-c24e-4270-a28e-5374940abf6f could not be found. Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c513f20d-c24e-4270-a28e-5374940abf6f could not be found. Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c513f20d-c24e-4270-a28e-5374940abf6f could not be found. Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:39:21 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-8ed317df-50e6-4b8a-9a48-e00c0fd28131 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Returning 404 to user: Instance c513f20d-c24e-4270-a28e-5374940abf6f could not be found. {{(pid=61473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:39:21 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-8ed317df-50e6-4b8a-9a48-e00c0fd28131 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c513f20d-c24e-4270-a28e-5374940abf6f" status: 404 len: 111 microversion: 2.20 time: 0.033979 Apr 19 16:39:21 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 78/229] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 19 16:39:21 2023] DELETE /compute/v2.1/servers/c513f20d-c24e-4270-a28e-5374940abf6f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 16:39:21 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-9e9bdd59-a89c-4ac9-a174-01cc7797b01d tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:39:21 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-9e9bdd59-a89c-4ac9-a174-01cc7797b01d tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] [instance: c513f20d-c24e-4270-a28e-5374940abf6f] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:39:21 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-9e9bdd59-a89c-4ac9-a174-01cc7797b01d tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:39:21 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-9e9bdd59-a89c-4ac9-a174-01cc7797b01d tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:39:21 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-9e9bdd59-a89c-4ac9-a174-01cc7797b01d tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:39:21 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-9e9bdd59-a89c-4ac9-a174-01cc7797b01d tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:39:21 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-9e9bdd59-a89c-4ac9-a174-01cc7797b01d tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:39:21 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-9e9bdd59-a89c-4ac9-a174-01cc7797b01d tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:39:21 user devstack@n-api.service[61471]: INFO nova.api.openstack.wsgi [None req-9e9bdd59-a89c-4ac9-a174-01cc7797b01d tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] HTTP exception thrown: Instance c513f20d-c24e-4270-a28e-5374940abf6f could not be found. Apr 19 16:39:21 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-9e9bdd59-a89c-4ac9-a174-01cc7797b01d tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Request method failure captured: Apr 19 16:39:21 user devstack@n-api.service[61471]: request: GET /compute/v2.1/servers/c513f20d-c24e-4270-a28e-5374940abf6f HTTP/1.1 Apr 19 16:39:21 user devstack@n-api.service[61471]: Accept: application/json Apr 19 16:39:21 user devstack@n-api.service[61471]: Accept-Encoding: identity Apr 19 16:39:21 user devstack@n-api.service[61471]: Connection: close Apr 19 16:39:21 user devstack@n-api.service[61471]: Content-Length: 0 Apr 19 16:39:21 user devstack@n-api.service[61471]: Content-Type: application/json Apr 19 16:39:21 user devstack@n-api.service[61471]: Host: 10.0.0.210 Apr 19 16:39:21 user devstack@n-api.service[61471]: Openstack-System-Scope: None Apr 19 16:39:21 user devstack@n-api.service[61471]: User-Agent: python-urllib3/1.26.15 Apr 19 16:39:21 user devstack@n-api.service[61471]: X-Auth-Token: gAAAAABkQBfpQ-u-azfabAlvotj0rQjoBYSAwwdbtalXo97-1uWGtb-3J70LWqoYyULHaD5-r8Tw0_rmwdlFubJ2wHduR88gko_stfx0p648gbrxtRIcpHqSgPOdGIA_3JZ8n9JlBb7qsFOzOpr_00QdyDu_86yRrH-UlS-aylJh1eEy92_ONQM Apr 19 16:39:21 user devstack@n-api.service[61471]: X-Domain-Id: None Apr 19 16:39:21 user devstack@n-api.service[61471]: X-Domain-Name: None Apr 19 16:39:21 user devstack@n-api.service[61471]: X-Identity-Status: Confirmed Apr 19 16:39:21 user devstack@n-api.service[61471]: X-Is-Admin-Project: True Apr 19 16:39:21 user devstack@n-api.service[61471]: X-Openstack-Nova-Api-Version: 2.20 Apr 19 16:39:21 user devstack@n-api.service[61471]: X-Project-Domain-Id: default Apr 19 16:39:21 user devstack@n-api.service[61471]: X-Project-Domain-Name: Default Apr 19 16:39:21 user devstack@n-api.service[61471]: X-Project-Id: d29a717b7f334af5a35d9e86c3d4b085 Apr 19 16:39:21 user devstack@n-api.service[61471]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1882422304 Apr 19 16:39:21 user devstack@n-api.service[61471]: X-Role: member,reader Apr 19 16:39:21 user devstack@n-api.service[61471]: X-Roles: member,reader Apr 19 16:39:21 user devstack@n-api.service[61471]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d29a717b7f334af5a35d9e86c3d4b085"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d29a717b7f334af5a35d9e86c3d4b085"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d29a717b7f334af5a35d9e86c3d4b085"}]}] Apr 19 16:39:21 user devstack@n-api.service[61471]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1882422304 Apr 19 16:39:21 user devstack@n-api.service[61471]: X-Tenant-Id: d29a717b7f334af5a35d9e86c3d4b085 Apr 19 16:39:21 user devstack@n-api.service[61471]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1882422304 Apr 19 16:39:21 user devstack@n-api.service[61471]: X-User: tempest-AttachVolumeShelveTestJSON-1882422304-project-member Apr 19 16:39:21 user devstack@n-api.service[61471]: X-User-Domain-Id: default Apr 19 16:39:21 user devstack@n-api.service[61471]: X-User-Domain-Name: Default Apr 19 16:39:21 user devstack@n-api.service[61471]: X-User-Id: 34afcb1cb8d2433b9564e5b62b45fe86 Apr 19 16:39:21 user devstack@n-api.service[61471]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1882422304-project-member Apr 19 16:39:21 user devstack@n-api.service[61471]: method: > Apr 19 16:39:21 user devstack@n-api.service[61471]: exception: Instance c513f20d-c24e-4270-a28e-5374940abf6f could not be found. Apr 19 16:39:21 user devstack@n-api.service[61471]: action_args: {'id': 'c513f20d-c24e-4270-a28e-5374940abf6f'} Apr 19 16:39:21 user devstack@n-api.service[61471]: {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:39:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:39:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:39:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:39:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:39:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:39:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:39:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:39:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:39:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:39:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c513f20d-c24e-4270-a28e-5374940abf6f could not be found. Apr 19 16:39:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:39:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:39:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:39:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:39:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:39:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:39:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:39:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:39:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:39:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:39:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 16:39:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 16:39:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:39:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:39:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:39:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:39:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c513f20d-c24e-4270-a28e-5374940abf6f could not be found. Apr 19 16:39:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:39:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:39:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:39:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:39:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:39:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:39:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:39:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:39:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c513f20d-c24e-4270-a28e-5374940abf6f could not be found. Apr 19 16:39:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:39:21 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-9e9bdd59-a89c-4ac9-a174-01cc7797b01d tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Returning 404 to user: Instance c513f20d-c24e-4270-a28e-5374940abf6f could not be found. {{(pid=61471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:39:21 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-9e9bdd59-a89c-4ac9-a174-01cc7797b01d tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c513f20d-c24e-4270-a28e-5374940abf6f" status: 404 len: 111 microversion: 2.20 time: 0.028160 Apr 19 16:39:21 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 78/230] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 16:39:21 2023] GET /compute/v2.1/servers/c513f20d-c24e-4270-a28e-5374940abf6f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 16:39:21 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-becfb4ef-7b3c-4626-a82e-2339cfae3319 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:39:21 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-becfb4ef-7b3c-4626-a82e-2339cfae3319 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] [instance: 01b50b56-31d2-4143-8585-63713d1bc7e9] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:39:21 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-becfb4ef-7b3c-4626-a82e-2339cfae3319 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:39:21 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-becfb4ef-7b3c-4626-a82e-2339cfae3319 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:39:21 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-becfb4ef-7b3c-4626-a82e-2339cfae3319 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:39:21 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-becfb4ef-7b3c-4626-a82e-2339cfae3319 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:39:21 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-becfb4ef-7b3c-4626-a82e-2339cfae3319 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:39:21 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-becfb4ef-7b3c-4626-a82e-2339cfae3319 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:39:21 user devstack@n-api.service[61472]: INFO nova.api.openstack.wsgi [None req-becfb4ef-7b3c-4626-a82e-2339cfae3319 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] HTTP exception thrown: Instance 01b50b56-31d2-4143-8585-63713d1bc7e9 could not be found. Apr 19 16:39:21 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-becfb4ef-7b3c-4626-a82e-2339cfae3319 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Request method failure captured: Apr 19 16:39:21 user devstack@n-api.service[61472]: request: DELETE /compute/v2.1/servers/01b50b56-31d2-4143-8585-63713d1bc7e9 HTTP/1.1 Apr 19 16:39:21 user devstack@n-api.service[61472]: Accept: application/json Apr 19 16:39:21 user devstack@n-api.service[61472]: Accept-Encoding: identity Apr 19 16:39:21 user devstack@n-api.service[61472]: Connection: close Apr 19 16:39:21 user devstack@n-api.service[61472]: Content-Length: 0 Apr 19 16:39:21 user devstack@n-api.service[61472]: Content-Type: application/json Apr 19 16:39:21 user devstack@n-api.service[61472]: Host: 10.0.0.210 Apr 19 16:39:21 user devstack@n-api.service[61472]: Openstack-System-Scope: None Apr 19 16:39:21 user devstack@n-api.service[61472]: User-Agent: python-urllib3/1.26.15 Apr 19 16:39:21 user devstack@n-api.service[61472]: X-Auth-Token: gAAAAABkQBfpQ-u-azfabAlvotj0rQjoBYSAwwdbtalXo97-1uWGtb-3J70LWqoYyULHaD5-r8Tw0_rmwdlFubJ2wHduR88gko_stfx0p648gbrxtRIcpHqSgPOdGIA_3JZ8n9JlBb7qsFOzOpr_00QdyDu_86yRrH-UlS-aylJh1eEy92_ONQM Apr 19 16:39:21 user devstack@n-api.service[61472]: X-Domain-Id: None Apr 19 16:39:21 user devstack@n-api.service[61472]: X-Domain-Name: None Apr 19 16:39:21 user devstack@n-api.service[61472]: X-Identity-Status: Confirmed Apr 19 16:39:21 user devstack@n-api.service[61472]: X-Is-Admin-Project: True Apr 19 16:39:21 user devstack@n-api.service[61472]: X-Openstack-Nova-Api-Version: 2.20 Apr 19 16:39:21 user devstack@n-api.service[61472]: X-Project-Domain-Id: default Apr 19 16:39:21 user devstack@n-api.service[61472]: X-Project-Domain-Name: Default Apr 19 16:39:21 user devstack@n-api.service[61472]: X-Project-Id: d29a717b7f334af5a35d9e86c3d4b085 Apr 19 16:39:21 user devstack@n-api.service[61472]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1882422304 Apr 19 16:39:21 user devstack@n-api.service[61472]: X-Role: member,reader Apr 19 16:39:21 user devstack@n-api.service[61472]: X-Roles: member,reader Apr 19 16:39:21 user devstack@n-api.service[61472]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d29a717b7f334af5a35d9e86c3d4b085"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d29a717b7f334af5a35d9e86c3d4b085"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d29a717b7f334af5a35d9e86c3d4b085"}]}] Apr 19 16:39:21 user devstack@n-api.service[61472]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1882422304 Apr 19 16:39:21 user devstack@n-api.service[61472]: X-Tenant-Id: d29a717b7f334af5a35d9e86c3d4b085 Apr 19 16:39:21 user devstack@n-api.service[61472]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1882422304 Apr 19 16:39:21 user devstack@n-api.service[61472]: X-User: tempest-AttachVolumeShelveTestJSON-1882422304-project-member Apr 19 16:39:21 user devstack@n-api.service[61472]: X-User-Domain-Id: default Apr 19 16:39:21 user devstack@n-api.service[61472]: X-User-Domain-Name: Default Apr 19 16:39:21 user devstack@n-api.service[61472]: X-User-Id: 34afcb1cb8d2433b9564e5b62b45fe86 Apr 19 16:39:21 user devstack@n-api.service[61472]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1882422304-project-member Apr 19 16:39:21 user devstack@n-api.service[61472]: method: > Apr 19 16:39:21 user devstack@n-api.service[61472]: exception: Instance 01b50b56-31d2-4143-8585-63713d1bc7e9 could not be found. Apr 19 16:39:21 user devstack@n-api.service[61472]: action_args: {'id': '01b50b56-31d2-4143-8585-63713d1bc7e9'} Apr 19 16:39:21 user devstack@n-api.service[61472]: {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:39:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:39:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:39:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:39:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:39:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:39:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:39:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:39:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:39:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:39:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01b50b56-31d2-4143-8585-63713d1bc7e9 could not be found. Apr 19 16:39:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:39:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:39:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:39:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:39:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:39:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:39:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:39:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:39:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:39:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:39:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 19 16:39:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 19 16:39:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 19 16:39:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 19 16:39:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:39:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:39:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:39:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:39:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01b50b56-31d2-4143-8585-63713d1bc7e9 could not be found. Apr 19 16:39:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:39:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:39:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:39:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:39:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:39:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:39:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:39:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:39:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01b50b56-31d2-4143-8585-63713d1bc7e9 could not be found. Apr 19 16:39:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:39:21 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-becfb4ef-7b3c-4626-a82e-2339cfae3319 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Returning 404 to user: Instance 01b50b56-31d2-4143-8585-63713d1bc7e9 could not be found. {{(pid=61472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:39:21 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-becfb4ef-7b3c-4626-a82e-2339cfae3319 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/01b50b56-31d2-4143-8585-63713d1bc7e9" status: 404 len: 111 microversion: 2.20 time: 0.036669 Apr 19 16:39:21 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 75/231] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 19 16:39:21 2023] DELETE /compute/v2.1/servers/01b50b56-31d2-4143-8585-63713d1bc7e9 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 16:39:21 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-2736cf1c-5b13-4a13-abca-6c7f7321a781 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:39:21 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-2736cf1c-5b13-4a13-abca-6c7f7321a781 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] [instance: 01b50b56-31d2-4143-8585-63713d1bc7e9] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:39:21 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-2736cf1c-5b13-4a13-abca-6c7f7321a781 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:39:21 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-2736cf1c-5b13-4a13-abca-6c7f7321a781 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:39:21 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-2736cf1c-5b13-4a13-abca-6c7f7321a781 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:39:21 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-2736cf1c-5b13-4a13-abca-6c7f7321a781 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:39:21 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-2736cf1c-5b13-4a13-abca-6c7f7321a781 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:39:21 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-2736cf1c-5b13-4a13-abca-6c7f7321a781 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:39:21 user devstack@n-api.service[61473]: INFO nova.api.openstack.wsgi [None req-2736cf1c-5b13-4a13-abca-6c7f7321a781 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] HTTP exception thrown: Instance 01b50b56-31d2-4143-8585-63713d1bc7e9 could not be found. Apr 19 16:39:21 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-2736cf1c-5b13-4a13-abca-6c7f7321a781 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Request method failure captured: Apr 19 16:39:21 user devstack@n-api.service[61473]: request: GET /compute/v2.1/servers/01b50b56-31d2-4143-8585-63713d1bc7e9 HTTP/1.1 Apr 19 16:39:21 user devstack@n-api.service[61473]: Accept: application/json Apr 19 16:39:21 user devstack@n-api.service[61473]: Accept-Encoding: identity Apr 19 16:39:21 user devstack@n-api.service[61473]: Connection: close Apr 19 16:39:21 user devstack@n-api.service[61473]: Content-Length: 0 Apr 19 16:39:21 user devstack@n-api.service[61473]: Content-Type: application/json Apr 19 16:39:21 user devstack@n-api.service[61473]: Host: 10.0.0.210 Apr 19 16:39:21 user devstack@n-api.service[61473]: Openstack-System-Scope: None Apr 19 16:39:21 user devstack@n-api.service[61473]: User-Agent: python-urllib3/1.26.15 Apr 19 16:39:21 user devstack@n-api.service[61473]: X-Auth-Token: gAAAAABkQBfpQ-u-azfabAlvotj0rQjoBYSAwwdbtalXo97-1uWGtb-3J70LWqoYyULHaD5-r8Tw0_rmwdlFubJ2wHduR88gko_stfx0p648gbrxtRIcpHqSgPOdGIA_3JZ8n9JlBb7qsFOzOpr_00QdyDu_86yRrH-UlS-aylJh1eEy92_ONQM Apr 19 16:39:21 user devstack@n-api.service[61473]: X-Domain-Id: None Apr 19 16:39:21 user devstack@n-api.service[61473]: X-Domain-Name: None Apr 19 16:39:21 user devstack@n-api.service[61473]: X-Identity-Status: Confirmed Apr 19 16:39:21 user devstack@n-api.service[61473]: X-Is-Admin-Project: True Apr 19 16:39:21 user devstack@n-api.service[61473]: X-Openstack-Nova-Api-Version: 2.20 Apr 19 16:39:21 user devstack@n-api.service[61473]: X-Project-Domain-Id: default Apr 19 16:39:21 user devstack@n-api.service[61473]: X-Project-Domain-Name: Default Apr 19 16:39:21 user devstack@n-api.service[61473]: X-Project-Id: d29a717b7f334af5a35d9e86c3d4b085 Apr 19 16:39:21 user devstack@n-api.service[61473]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1882422304 Apr 19 16:39:21 user devstack@n-api.service[61473]: X-Role: member,reader Apr 19 16:39:21 user devstack@n-api.service[61473]: X-Roles: member,reader Apr 19 16:39:21 user devstack@n-api.service[61473]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d29a717b7f334af5a35d9e86c3d4b085"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d29a717b7f334af5a35d9e86c3d4b085"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d29a717b7f334af5a35d9e86c3d4b085"}]}] Apr 19 16:39:21 user devstack@n-api.service[61473]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1882422304 Apr 19 16:39:21 user devstack@n-api.service[61473]: X-Tenant-Id: d29a717b7f334af5a35d9e86c3d4b085 Apr 19 16:39:21 user devstack@n-api.service[61473]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1882422304 Apr 19 16:39:21 user devstack@n-api.service[61473]: X-User: tempest-AttachVolumeShelveTestJSON-1882422304-project-member Apr 19 16:39:21 user devstack@n-api.service[61473]: X-User-Domain-Id: default Apr 19 16:39:21 user devstack@n-api.service[61473]: X-User-Domain-Name: Default Apr 19 16:39:21 user devstack@n-api.service[61473]: X-User-Id: 34afcb1cb8d2433b9564e5b62b45fe86 Apr 19 16:39:21 user devstack@n-api.service[61473]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1882422304-project-member Apr 19 16:39:21 user devstack@n-api.service[61473]: method: > Apr 19 16:39:21 user devstack@n-api.service[61473]: exception: Instance 01b50b56-31d2-4143-8585-63713d1bc7e9 could not be found. Apr 19 16:39:21 user devstack@n-api.service[61473]: action_args: {'id': '01b50b56-31d2-4143-8585-63713d1bc7e9'} Apr 19 16:39:21 user devstack@n-api.service[61473]: {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01b50b56-31d2-4143-8585-63713d1bc7e9 could not be found. Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01b50b56-31d2-4143-8585-63713d1bc7e9 could not be found. Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01b50b56-31d2-4143-8585-63713d1bc7e9 could not be found. Apr 19 16:39:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:39:21 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-2736cf1c-5b13-4a13-abca-6c7f7321a781 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] Returning 404 to user: Instance 01b50b56-31d2-4143-8585-63713d1bc7e9 could not be found. {{(pid=61473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:39:21 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-2736cf1c-5b13-4a13-abca-6c7f7321a781 tempest-AttachVolumeShelveTestJSON-1882422304 tempest-AttachVolumeShelveTestJSON-1882422304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/01b50b56-31d2-4143-8585-63713d1bc7e9" status: 404 len: 111 microversion: 2.20 time: 0.030474 Apr 19 16:39:21 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 79/232] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 16:39:21 2023] GET /compute/v2.1/servers/01b50b56-31d2-4143-8585-63713d1bc7e9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 16:39:24 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-40504594-06af-447b-aece-5ec378abb129 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:39:24 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-40504594-06af-447b-aece-5ec378abb129 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] [instance: 11eee783-802b-438a-bc43-a59b6c33ce63] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:39:24 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-40504594-06af-447b-aece-5ec378abb129 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:39:24 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-40504594-06af-447b-aece-5ec378abb129 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:39:24 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-40504594-06af-447b-aece-5ec378abb129 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:39:24 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-40504594-06af-447b-aece-5ec378abb129 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:39:24 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-40504594-06af-447b-aece-5ec378abb129 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:39:24 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-40504594-06af-447b-aece-5ec378abb129 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:39:24 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-40504594-06af-447b-aece-5ec378abb129 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d089267c6a4a1391bb89ae66b49da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a63d3a9c6774bba8f276846597e24ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:39:24 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-40504594-06af-447b-aece-5ec378abb129 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11eee783-802b-438a-bc43-a59b6c33ce63" status: 200 len: 1494 microversion: 2.1 time: 0.239058 Apr 19 16:39:24 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 79/233] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:39:24 2023] GET /compute/v2.1/servers/11eee783-802b-438a-bc43-a59b6c33ce63 => generated 1494 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:39:26 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-78320455-1214-4e99-b4ac-3717cba89788 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:39:26 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-78320455-1214-4e99-b4ac-3717cba89788 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] [instance: a674a13f-daf9-4a94-b8ec-48e0426eacb2] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:39:26 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-78320455-1214-4e99-b4ac-3717cba89788 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:39:26 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-78320455-1214-4e99-b4ac-3717cba89788 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:39:26 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-78320455-1214-4e99-b4ac-3717cba89788 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:39:26 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-78320455-1214-4e99-b4ac-3717cba89788 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:39:26 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-78320455-1214-4e99-b4ac-3717cba89788 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:39:26 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-78320455-1214-4e99-b4ac-3717cba89788 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:39:27 user devstack@n-api.service[61472]: DEBUG nova.policy [None req-78320455-1214-4e99-b4ac-3717cba89788 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2563be52f624ceab060942e8bfcedef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ceccc36de46f780e55a02f25782f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61472) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:39:27 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-78320455-1214-4e99-b4ac-3717cba89788 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a674a13f-daf9-4a94-b8ec-48e0426eacb2" status: 200 len: 1544 microversion: 2.1 time: 0.259692 Apr 19 16:39:27 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 76/234] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:39:26 2023] GET /compute/v2.1/servers/a674a13f-daf9-4a94-b8ec-48e0426eacb2 => generated 1544 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:39:31 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_api:SELECT=4 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:39:31 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell1:SELECT=4 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:39:31 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-bbd1d462-3fa7-4052-a18c-39878502af68 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Action: 'create', calling method: .version_select at 0x7fd49711ff40>, body: {"keypair": {"name": "tempest-keypair-1274492496", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDq4ouDWpal0CFTCYQKWteyrodTq9uPxjl7DIiujTIWBqPeyleB0oUdjxYbpCJwcUC939wyISvWJpZvN2eymMYbjnmVcdyPau+feuyWtzRW+dLuhtYooFmrovelpP8F4yw=="}} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:39:31 user devstack@n-api.service[61473]: DEBUG nova.quota [None req-bbd1d462-3fa7-4052-a18c-39878502af68 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Getting quotas for project b5e6dbe3c46740f3b6d7a0618e076583. Resources: {'key_pairs'} {{(pid=61473) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 16:39:31 user devstack@n-api.service[61473]: DEBUG nova.quota [None req-bbd1d462-3fa7-4052-a18c-39878502af68 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Getting quotas for user ce3934da35244b148d5fa8c56152a1f0 and project b5e6dbe3c46740f3b6d7a0618e076583. Resources: {'key_pairs'} {{(pid=61473) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 16:39:31 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-bbd1d462-3fa7-4052-a18c-39878502af68 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.158852 Apr 19 16:39:31 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 80/235] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 16:39:31 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:39:34 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-cdfbac22-d8b4-4153-aed4-ac646fdd1c19 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-932636146", "imageRef": "ab56c4b1-0117-43b0-84b6-28d06a23f182", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "a052dcab-b2be-42a7-aed2-c03db95d21b0"}], "security_groups": [{"name": "tempest-securitygroup--1230947205"}], "key_name": "tempest-keypair-1274492496", "user_data": "}} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:39:34 user devstack@n-api.service[61471]: DEBUG nova.network.neutron [None req-cdfbac22-d8b4-4153-aed4-ac646fdd1c19 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] validate_networks() for [('a052dcab-b2be-42a7-aed2-c03db95d21b0', None, None, None, None, None)] {{(pid=61471) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 16:39:34 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell1:SELECT=10 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:39:34 user devstack@n-api.service[61471]: DEBUG nova.virt.hardware [None req-cdfbac22-d8b4-4153-aed4-ac646fdd1c19 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Flavor limits 0:0:0 {{(pid=61471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 16:39:34 user devstack@n-api.service[61471]: DEBUG nova.virt.hardware [None req-cdfbac22-d8b4-4153-aed4-ac646fdd1c19 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Image limits 0:0:0 {{(pid=61471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 16:39:34 user devstack@n-api.service[61471]: DEBUG nova.virt.hardware [None req-cdfbac22-d8b4-4153-aed4-ac646fdd1c19 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Flavor pref 0:0:0 {{(pid=61471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 16:39:34 user devstack@n-api.service[61471]: DEBUG nova.virt.hardware [None req-cdfbac22-d8b4-4153-aed4-ac646fdd1c19 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Image pref 0:0:0 {{(pid=61471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 16:39:34 user devstack@n-api.service[61471]: DEBUG nova.virt.hardware [None req-cdfbac22-d8b4-4153-aed4-ac646fdd1c19 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 16:39:34 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-cdfbac22-d8b4-4153-aed4-ac646fdd1c19 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:39:34 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-cdfbac22-d8b4-4153-aed4-ac646fdd1c19 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:39:34 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-cdfbac22-d8b4-4153-aed4-ac646fdd1c19 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:39:34 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-cdfbac22-d8b4-4153-aed4-ac646fdd1c19 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:39:34 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-cdfbac22-d8b4-4153-aed4-ac646fdd1c19 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:39:34 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-cdfbac22-d8b4-4153-aed4-ac646fdd1c19 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:39:34 user devstack@n-api.service[61471]: DEBUG nova.quota [None req-cdfbac22-d8b4-4153-aed4-ac646fdd1c19 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Getting quotas for project b5e6dbe3c46740f3b6d7a0618e076583. Resources: {'instances', 'ram', 'cores'} {{(pid=61471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 16:39:35 user devstack@n-api.service[61471]: DEBUG nova.quota [None req-cdfbac22-d8b4-4153-aed4-ac646fdd1c19 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Getting quotas for user ce3934da35244b148d5fa8c56152a1f0 and project b5e6dbe3c46740f3b6d7a0618e076583. Resources: {'instances', 'ram', 'cores'} {{(pid=61471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 16:39:35 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-cdfbac22-d8b4-4153-aed4-ac646fdd1c19 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Going to run 1 instances... {{(pid=61471) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 16:39:35 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-cdfbac22-d8b4-4153-aed4-ac646fdd1c19 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] [instance: 4a07dc78-c9a6-4ebc-bb9f-35f95a18e246] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ab56c4b1-0117-43b0-84b6-28d06a23f182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61471) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 16:39:35 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-cdfbac22-d8b4-4153-aed4-ac646fdd1c19 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.777604 Apr 19 16:39:35 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 80/236] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 16:39:34 2023] POST /compute/v2.1/servers => generated 400 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 16:39:35 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-067ea887-00ff-4922-a61f-9f3983bc4b6f tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:39:35 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-067ea887-00ff-4922-a61f-9f3983bc4b6f tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] [instance: 4a07dc78-c9a6-4ebc-bb9f-35f95a18e246] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:39:35 user devstack@n-api.service[61472]: DEBUG nova.policy [None req-067ea887-00ff-4922-a61f-9f3983bc4b6f tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3934da35244b148d5fa8c56152a1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e6dbe3c46740f3b6d7a0618e076583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61472) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:39:35 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-067ea887-00ff-4922-a61f-9f3983bc4b6f tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a07dc78-c9a6-4ebc-bb9f-35f95a18e246" status: 200 len: 1231 microversion: 2.1 time: 0.092036 Apr 19 16:39:35 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 77/237] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:39:35 2023] GET /compute/v2.1/servers/4a07dc78-c9a6-4ebc-bb9f-35f95a18e246 => generated 1231 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:39:37 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-bc908b1c-5445-417f-846f-e1d72b08887d tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:39:37 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-bc908b1c-5445-417f-846f-e1d72b08887d tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] [instance: edd2688e-940e-4ab3-b27c-b6d4aab3efc5] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:39:37 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-bc908b1c-5445-417f-846f-e1d72b08887d tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:39:37 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-bc908b1c-5445-417f-846f-e1d72b08887d tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:39:37 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-bc908b1c-5445-417f-846f-e1d72b08887d tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:39:37 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-bc908b1c-5445-417f-846f-e1d72b08887d tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:39:37 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-bc908b1c-5445-417f-846f-e1d72b08887d tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:39:37 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-bc908b1c-5445-417f-846f-e1d72b08887d tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:39:38 user devstack@n-api.service[61473]: DEBUG nova.policy [None req-bc908b1c-5445-417f-846f-e1d72b08887d tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023314f8cf79430b83c5184d9a54be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78962d13860a4df3a8aa100e2afaca6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61473) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:39:38 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-bc908b1c-5445-417f-846f-e1d72b08887d tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] 10.0.0.210 "GET /compute/v2.1/servers/edd2688e-940e-4ab3-b27c-b6d4aab3efc5" status: 200 len: 1659 microversion: 2.1 time: 0.262919 Apr 19 16:39:38 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 81/238] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:39:37 2023] GET /compute/v2.1/servers/edd2688e-940e-4ab3-b27c-b6d4aab3efc5 => generated 1659 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:39:38 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [req-843298a4-0902-4bf6-9070-6ba2599cc591 req-b601f4d3-14d4-4639-b22d-4f3be2338ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a07dc78-c9a6-4ebc-bb9f-35f95a18e246", "tag": "f166e883-98a3-48d8-bbdb-a4e1ea17c132"}]} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:39:38 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-843298a4-0902-4bf6-9070-6ba2599cc591 req-b601f4d3-14d4-4639-b22d-4f3be2338ab2 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:39:38 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-843298a4-0902-4bf6-9070-6ba2599cc591 req-b601f4d3-14d4-4639-b22d-4f3be2338ab2 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:39:38 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-843298a4-0902-4bf6-9070-6ba2599cc591 req-b601f4d3-14d4-4639-b22d-4f3be2338ab2 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:39:38 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-843298a4-0902-4bf6-9070-6ba2599cc591 req-b601f4d3-14d4-4639-b22d-4f3be2338ab2 service nova] Creating event network-changed:f166e883-98a3-48d8-bbdb-a4e1ea17c132 for instance 4a07dc78-c9a6-4ebc-bb9f-35f95a18e246 on user Apr 19 16:39:38 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [req-843298a4-0902-4bf6-9070-6ba2599cc591 req-b601f4d3-14d4-4639-b22d-4f3be2338ab2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030656 Apr 19 16:39:38 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 81/239] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:39:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:39:40 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [req-a24e71c9-ab11-43a0-9462-8eafe1e874ca req-5e0bd65f-9745-4af1-86e7-665e55e6c680 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a07dc78-c9a6-4ebc-bb9f-35f95a18e246", "name": "network-vif-plugged", "status": "completed", "tag": "f166e883-98a3-48d8-bbdb-a4e1ea17c132"}]} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:39:40 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell1:SELECT=8 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:39:40 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-a24e71c9-ab11-43a0-9462-8eafe1e874ca req-5e0bd65f-9745-4af1-86e7-665e55e6c680 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:39:40 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-a24e71c9-ab11-43a0-9462-8eafe1e874ca req-5e0bd65f-9745-4af1-86e7-665e55e6c680 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:39:40 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-a24e71c9-ab11-43a0-9462-8eafe1e874ca req-5e0bd65f-9745-4af1-86e7-665e55e6c680 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:39:40 user devstack@n-api.service[61472]: INFO nova.api.openstack.compute.server_external_events [req-a24e71c9-ab11-43a0-9462-8eafe1e874ca req-5e0bd65f-9745-4af1-86e7-665e55e6c680 service nova] Creating event network-vif-plugged:f166e883-98a3-48d8-bbdb-a4e1ea17c132 for instance 4a07dc78-c9a6-4ebc-bb9f-35f95a18e246 on user Apr 19 16:39:40 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [req-a24e71c9-ab11-43a0-9462-8eafe1e874ca req-5e0bd65f-9745-4af1-86e7-665e55e6c680 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032751 Apr 19 16:39:40 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 78/240] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:39:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:39:42 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-708c2d3f-d8e5-4b04-ba52-902a2284a4af req-2d7c311a-8020-4c46-a4b7-fd4efe782892 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a07dc78-c9a6-4ebc-bb9f-35f95a18e246", "name": "network-vif-plugged", "status": "completed", "tag": "f166e883-98a3-48d8-bbdb-a4e1ea17c132"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:39:42 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell0:SELECT=4 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:39:42 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-708c2d3f-d8e5-4b04-ba52-902a2284a4af req-2d7c311a-8020-4c46-a4b7-fd4efe782892 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:39:42 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-708c2d3f-d8e5-4b04-ba52-902a2284a4af req-2d7c311a-8020-4c46-a4b7-fd4efe782892 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:39:42 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-708c2d3f-d8e5-4b04-ba52-902a2284a4af req-2d7c311a-8020-4c46-a4b7-fd4efe782892 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:39:42 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-708c2d3f-d8e5-4b04-ba52-902a2284a4af req-2d7c311a-8020-4c46-a4b7-fd4efe782892 service nova] Creating event network-vif-plugged:f166e883-98a3-48d8-bbdb-a4e1ea17c132 for instance 4a07dc78-c9a6-4ebc-bb9f-35f95a18e246 on user Apr 19 16:39:42 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-708c2d3f-d8e5-4b04-ba52-902a2284a4af req-2d7c311a-8020-4c46-a4b7-fd4efe782892 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035338 Apr 19 16:39:42 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 82/241] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:39:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:39:43 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-ce4ca7a9-9aed-4c8c-a976-2c4b2922e668 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Action: 'create', calling method: .version_select at 0x7fd4971a4e50>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-252591740", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhbFGgNSHhu9BfwlmBp8T9JgHif4kPHBdulJ6MRNnHyJqhJN7Kpua2eYIXEqJEm+66kqQoKB+IycpN/ibSKPDJ83gwZ5RN9V34reET1KtWMOFfFHQuTVrZkT5w+4IOEvg=="}} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:39:43 user devstack@n-api.service[61471]: DEBUG nova.quota [None req-ce4ca7a9-9aed-4c8c-a976-2c4b2922e668 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Getting quotas for project 6c9c03f81c174bc89b90e1379b0e358e. Resources: {'key_pairs'} {{(pid=61471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 16:39:43 user devstack@n-api.service[61471]: DEBUG nova.quota [None req-ce4ca7a9-9aed-4c8c-a976-2c4b2922e668 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Getting quotas for user 9a8acfb1eb6149dc962e935451099438 and project 6c9c03f81c174bc89b90e1379b0e358e. Resources: {'key_pairs'} {{(pid=61471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 16:39:43 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-ce4ca7a9-9aed-4c8c-a976-2c4b2922e668 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.258248 Apr 19 16:39:43 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 82/242] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 16:39:43 2023] POST /compute/v2.1/os-keypairs => generated 404 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:39:45 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-ec68e16b-6afa-4e80-b819-7f99456b4bfc tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-666974315", "imageRef": "ab56c4b1-0117-43b0-84b6-28d06a23f182", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-252591740", "security_groups": [{"name": "tempest-secgroup-smoke-148565759"}], "networks": [{"uuid": "d810b664-abbf-488c-a10f-ef05b946dfce"}]}} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:39:45 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell0:SELECT=2 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:39:45 user devstack@n-api.service[61472]: DEBUG nova.network.neutron [None req-ec68e16b-6afa-4e80-b819-7f99456b4bfc tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] validate_networks() for [('d810b664-abbf-488c-a10f-ef05b946dfce', None, None, None, None, None)] {{(pid=61472) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 16:39:45 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-ec68e16b-6afa-4e80-b819-7f99456b4bfc tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Flavor limits 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 16:39:45 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-ec68e16b-6afa-4e80-b819-7f99456b4bfc tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Image limits 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 16:39:45 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-ec68e16b-6afa-4e80-b819-7f99456b4bfc tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Flavor pref 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 16:39:45 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-ec68e16b-6afa-4e80-b819-7f99456b4bfc tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Image pref 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 16:39:45 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-ec68e16b-6afa-4e80-b819-7f99456b4bfc tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 16:39:45 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-ec68e16b-6afa-4e80-b819-7f99456b4bfc tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:39:45 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-ec68e16b-6afa-4e80-b819-7f99456b4bfc tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:39:45 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-ec68e16b-6afa-4e80-b819-7f99456b4bfc tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:39:45 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-ec68e16b-6afa-4e80-b819-7f99456b4bfc tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:39:45 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-ec68e16b-6afa-4e80-b819-7f99456b4bfc tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:39:45 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-ec68e16b-6afa-4e80-b819-7f99456b4bfc tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:39:45 user devstack@n-api.service[61472]: DEBUG nova.quota [None req-ec68e16b-6afa-4e80-b819-7f99456b4bfc tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Getting quotas for project 6c9c03f81c174bc89b90e1379b0e358e. Resources: {'instances', 'ram', 'cores'} {{(pid=61472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 16:39:45 user devstack@n-api.service[61472]: DEBUG nova.quota [None req-ec68e16b-6afa-4e80-b819-7f99456b4bfc tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Getting quotas for user 9a8acfb1eb6149dc962e935451099438 and project 6c9c03f81c174bc89b90e1379b0e358e. Resources: {'instances', 'ram', 'cores'} {{(pid=61472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 16:39:45 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-ec68e16b-6afa-4e80-b819-7f99456b4bfc tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Going to run 1 instances... {{(pid=61472) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 16:39:45 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-ec68e16b-6afa-4e80-b819-7f99456b4bfc tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] [instance: 6b41b6c3-b067-4ae8-9fe2-cbeea18664f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ab56c4b1-0117-43b0-84b6-28d06a23f182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 16:39:45 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-ec68e16b-6afa-4e80-b819-7f99456b4bfc tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.609448 Apr 19 16:39:45 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 79/243] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 16:39:45 2023] POST /compute/v2.1/servers => generated 403 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 16:39:45 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-960252f0-77f7-44fe-89d3-dd4946ef81c4 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:39:45 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-960252f0-77f7-44fe-89d3-dd4946ef81c4 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] [instance: 6b41b6c3-b067-4ae8-9fe2-cbeea18664f5] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:39:45 user devstack@n-api.service[61473]: DEBUG nova.policy [None req-960252f0-77f7-44fe-89d3-dd4946ef81c4 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8acfb1eb6149dc962e935451099438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c03f81c174bc89b90e1379b0e358e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61473) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:39:45 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-960252f0-77f7-44fe-89d3-dd4946ef81c4 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b41b6c3-b067-4ae8-9fe2-cbeea18664f5" status: 200 len: 1255 microversion: 2.1 time: 0.073016 Apr 19 16:39:45 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 83/244] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:39:45 2023] GET /compute/v2.1/servers/6b41b6c3-b067-4ae8-9fe2-cbeea18664f5 => generated 1255 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 16:39:48 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell0:SELECT=2 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:39:48 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell1:SELECT=4 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:39:48 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [req-ac32305b-5c87-4b23-aa49-d48546a76606 req-af1dd762-8912-408d-9e28-50e65481c2bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b41b6c3-b067-4ae8-9fe2-cbeea18664f5", "tag": "aa14ebe4-9d19-434f-9440-a5e1afe183a1"}]} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:39:48 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-ac32305b-5c87-4b23-aa49-d48546a76606 req-af1dd762-8912-408d-9e28-50e65481c2bc service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:39:48 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-ac32305b-5c87-4b23-aa49-d48546a76606 req-af1dd762-8912-408d-9e28-50e65481c2bc service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:39:48 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-ac32305b-5c87-4b23-aa49-d48546a76606 req-af1dd762-8912-408d-9e28-50e65481c2bc service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:39:48 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-ac32305b-5c87-4b23-aa49-d48546a76606 req-af1dd762-8912-408d-9e28-50e65481c2bc service nova] Creating event network-changed:aa14ebe4-9d19-434f-9440-a5e1afe183a1 for instance 6b41b6c3-b067-4ae8-9fe2-cbeea18664f5 on user Apr 19 16:39:48 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [req-ac32305b-5c87-4b23-aa49-d48546a76606 req-af1dd762-8912-408d-9e28-50e65481c2bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035036 Apr 19 16:39:48 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 83/245] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:39:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:39:49 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-6d8af20d-0f10-4391-9605-1bd9a0b335a1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-749561576", "imageRef": "ab56c4b1-0117-43b0-84b6-28d06a23f182", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "bdc7f4b4-1167-484c-ab08-77c4f58bf2f6"}]}} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:39:49 user devstack@n-api.service[61472]: DEBUG nova.network.neutron [None req-6d8af20d-0f10-4391-9605-1bd9a0b335a1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] validate_networks() for [('bdc7f4b4-1167-484c-ab08-77c4f58bf2f6', None, None, None, None, None)] {{(pid=61472) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 16:39:49 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-6d8af20d-0f10-4391-9605-1bd9a0b335a1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Flavor limits 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 16:39:49 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-6d8af20d-0f10-4391-9605-1bd9a0b335a1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Image limits 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 16:39:49 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-6d8af20d-0f10-4391-9605-1bd9a0b335a1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Flavor pref 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 16:39:49 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-6d8af20d-0f10-4391-9605-1bd9a0b335a1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Image pref 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 16:39:49 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-6d8af20d-0f10-4391-9605-1bd9a0b335a1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 16:39:49 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-6d8af20d-0f10-4391-9605-1bd9a0b335a1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:39:49 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-6d8af20d-0f10-4391-9605-1bd9a0b335a1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:39:49 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-6d8af20d-0f10-4391-9605-1bd9a0b335a1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:39:49 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-6d8af20d-0f10-4391-9605-1bd9a0b335a1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:39:49 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-6d8af20d-0f10-4391-9605-1bd9a0b335a1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:39:49 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-6d8af20d-0f10-4391-9605-1bd9a0b335a1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:39:49 user devstack@n-api.service[61472]: DEBUG nova.quota [None req-6d8af20d-0f10-4391-9605-1bd9a0b335a1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Getting quotas for project e58ee4833fd147e2a494be5d7634a2fa. Resources: {'instances', 'ram', 'cores'} {{(pid=61472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 16:39:49 user devstack@n-api.service[61472]: DEBUG nova.quota [None req-6d8af20d-0f10-4391-9605-1bd9a0b335a1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Getting quotas for user 63f2a02626ca4957823de39c9a31d1b8 and project e58ee4833fd147e2a494be5d7634a2fa. Resources: {'instances', 'ram', 'cores'} {{(pid=61472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 16:39:49 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-6d8af20d-0f10-4391-9605-1bd9a0b335a1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Going to run 1 instances... {{(pid=61472) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 16:39:49 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-6d8af20d-0f10-4391-9605-1bd9a0b335a1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] [instance: 4babffb0-4b9b-4238-be84-0c101346051a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 16:39:49 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-6d8af20d-0f10-4391-9605-1bd9a0b335a1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.557286 Apr 19 16:39:49 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 80/246] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 19 16:39:49 2023] POST /compute/v2.1/servers => generated 378 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 19 16:39:49 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-38719d13-c7e8-4fd7-a227-d66fa003850c tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:39:49 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-38719d13-c7e8-4fd7-a227-d66fa003850c tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] [instance: 4babffb0-4b9b-4238-be84-0c101346051a] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:39:49 user devstack@n-api.service[61473]: DEBUG nova.policy [None req-38719d13-c7e8-4fd7-a227-d66fa003850c tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f2a02626ca4957823de39c9a31d1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ee4833fd147e2a494be5d7634a2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61473) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:39:49 user devstack@n-api.service[61473]: DEBUG nova.policy [None req-38719d13-c7e8-4fd7-a227-d66fa003850c tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63f2a02626ca4957823de39c9a31d1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ee4833fd147e2a494be5d7634a2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61473) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:39:49 user devstack@n-api.service[61473]: DEBUG nova.policy [None req-38719d13-c7e8-4fd7-a227-d66fa003850c tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63f2a02626ca4957823de39c9a31d1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ee4833fd147e2a494be5d7634a2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61473) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:39:49 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-38719d13-c7e8-4fd7-a227-d66fa003850c tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4babffb0-4b9b-4238-be84-0c101346051a" status: 200 len: 1394 microversion: 2.87 time: 0.073892 Apr 19 16:39:49 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 84/247] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 16:39:49 2023] GET /compute/v2.1/servers/4babffb0-4b9b-4238-be84-0c101346051a => generated 1394 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 16:39:50 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [req-24e9f5e3-c736-4bc6-a30a-a7908a0ce0ad req-32960581-64d0-4126-b6aa-2c592287135b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b41b6c3-b067-4ae8-9fe2-cbeea18664f5", "name": "network-vif-plugged", "status": "completed", "tag": "aa14ebe4-9d19-434f-9440-a5e1afe183a1"}]} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:39:50 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=4 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:39:50 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-24e9f5e3-c736-4bc6-a30a-a7908a0ce0ad req-32960581-64d0-4126-b6aa-2c592287135b service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:39:50 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-24e9f5e3-c736-4bc6-a30a-a7908a0ce0ad req-32960581-64d0-4126-b6aa-2c592287135b service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:39:50 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-24e9f5e3-c736-4bc6-a30a-a7908a0ce0ad req-32960581-64d0-4126-b6aa-2c592287135b service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:39:50 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-24e9f5e3-c736-4bc6-a30a-a7908a0ce0ad req-32960581-64d0-4126-b6aa-2c592287135b service nova] Creating event network-vif-plugged:aa14ebe4-9d19-434f-9440-a5e1afe183a1 for instance 6b41b6c3-b067-4ae8-9fe2-cbeea18664f5 on user Apr 19 16:39:50 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [req-24e9f5e3-c736-4bc6-a30a-a7908a0ce0ad req-32960581-64d0-4126-b6aa-2c592287135b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093416 Apr 19 16:39:50 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 84/248] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:39:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:39:52 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [req-a5d7b1c8-0407-4c81-bf37-516fe1a05de3 req-9c78cbee-053b-430e-83d9-2781af7d0581 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4babffb0-4b9b-4238-be84-0c101346051a", "tag": "828ac3a5-727b-48ff-b928-8cbd08aa9511"}]} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:39:52 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:39:52 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-a5d7b1c8-0407-4c81-bf37-516fe1a05de3 req-9c78cbee-053b-430e-83d9-2781af7d0581 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:39:52 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-a5d7b1c8-0407-4c81-bf37-516fe1a05de3 req-9c78cbee-053b-430e-83d9-2781af7d0581 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:39:52 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-a5d7b1c8-0407-4c81-bf37-516fe1a05de3 req-9c78cbee-053b-430e-83d9-2781af7d0581 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:39:52 user devstack@n-api.service[61472]: INFO nova.api.openstack.compute.server_external_events [req-a5d7b1c8-0407-4c81-bf37-516fe1a05de3 req-9c78cbee-053b-430e-83d9-2781af7d0581 service nova] Creating event network-changed:828ac3a5-727b-48ff-b928-8cbd08aa9511 for instance 4babffb0-4b9b-4238-be84-0c101346051a on user Apr 19 16:39:52 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [req-a5d7b1c8-0407-4c81-bf37-516fe1a05de3 req-9c78cbee-053b-430e-83d9-2781af7d0581 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030972 Apr 19 16:39:52 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 81/249] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:39:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:39:52 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-7732e000-31c3-47d6-9f0a-a53794f18111 req-55a66753-e99b-4fb8-a8af-e7719da88a5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b41b6c3-b067-4ae8-9fe2-cbeea18664f5", "name": "network-vif-plugged", "status": "completed", "tag": "aa14ebe4-9d19-434f-9440-a5e1afe183a1"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:39:52 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell1:SELECT=8 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:39:52 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-7732e000-31c3-47d6-9f0a-a53794f18111 req-55a66753-e99b-4fb8-a8af-e7719da88a5a service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:39:52 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-7732e000-31c3-47d6-9f0a-a53794f18111 req-55a66753-e99b-4fb8-a8af-e7719da88a5a service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:39:52 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-7732e000-31c3-47d6-9f0a-a53794f18111 req-55a66753-e99b-4fb8-a8af-e7719da88a5a service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:39:52 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-7732e000-31c3-47d6-9f0a-a53794f18111 req-55a66753-e99b-4fb8-a8af-e7719da88a5a service nova] Creating event network-vif-plugged:aa14ebe4-9d19-434f-9440-a5e1afe183a1 for instance 6b41b6c3-b067-4ae8-9fe2-cbeea18664f5 on user Apr 19 16:39:52 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-7732e000-31c3-47d6-9f0a-a53794f18111 req-55a66753-e99b-4fb8-a8af-e7719da88a5a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043743 Apr 19 16:39:52 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 85/250] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:39:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:39:58 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell0:SELECT=10 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:39:58 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [req-6707277d-4aa5-4c2f-ad55-0ac60ed112b3 req-f40a73f5-c8b0-4a3e-b242-268239b10ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4babffb0-4b9b-4238-be84-0c101346051a", "name": "network-vif-deleted", "tag": "828ac3a5-727b-48ff-b928-8cbd08aa9511"}]} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:39:58 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-6707277d-4aa5-4c2f-ad55-0ac60ed112b3 req-f40a73f5-c8b0-4a3e-b242-268239b10ca2 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:39:58 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-6707277d-4aa5-4c2f-ad55-0ac60ed112b3 req-f40a73f5-c8b0-4a3e-b242-268239b10ca2 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:39:58 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-6707277d-4aa5-4c2f-ad55-0ac60ed112b3 req-f40a73f5-c8b0-4a3e-b242-268239b10ca2 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:39:58 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.compute.server_external_events [req-6707277d-4aa5-4c2f-ad55-0ac60ed112b3 req-f40a73f5-c8b0-4a3e-b242-268239b10ca2 service nova] Unable to find a host for instance 4babffb0-4b9b-4238-be84-0c101346051a. Dropping event network-vif-deleted {{(pid=61471) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 19 16:39:58 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [req-6707277d-4aa5-4c2f-ad55-0ac60ed112b3 req-f40a73f5-c8b0-4a3e-b242-268239b10ca2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.032766 Apr 19 16:39:58 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 85/251] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:39:58 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 19 16:40:25 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell0:SELECT=4 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:40:25 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell0:SELECT=12 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:40:25 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell1:SELECT=8 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:40:25 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_api:SELECT=1 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:40:25 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-7a082039-5f1c-40f8-96ee-c5a6e1893bac tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:40:25 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-7a082039-5f1c-40f8-96ee-c5a6e1893bac tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] [instance: 11eee783-802b-438a-bc43-a59b6c33ce63] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:40:25 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-7a082039-5f1c-40f8-96ee-c5a6e1893bac tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:40:25 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-7a082039-5f1c-40f8-96ee-c5a6e1893bac tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:40:25 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-7a082039-5f1c-40f8-96ee-c5a6e1893bac tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:40:25 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-7a082039-5f1c-40f8-96ee-c5a6e1893bac tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:40:25 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-7a082039-5f1c-40f8-96ee-c5a6e1893bac tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:40:25 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-7a082039-5f1c-40f8-96ee-c5a6e1893bac tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:40:25 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell0:SELECT=4 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:40:25 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:40:25 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell1:SELECT=2 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:40:25 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-c6590c81-8c67-43fe-9814-969a478717a7 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:40:25 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-c6590c81-8c67-43fe-9814-969a478717a7 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] [instance: 4a07dc78-c9a6-4ebc-bb9f-35f95a18e246] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:40:25 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-c6590c81-8c67-43fe-9814-969a478717a7 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:40:25 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-c6590c81-8c67-43fe-9814-969a478717a7 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:40:25 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-c6590c81-8c67-43fe-9814-969a478717a7 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:40:25 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-c6590c81-8c67-43fe-9814-969a478717a7 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:40:25 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-c6590c81-8c67-43fe-9814-969a478717a7 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:40:25 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-c6590c81-8c67-43fe-9814-969a478717a7 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:40:25 user devstack@n-api.service[61472]: DEBUG nova.policy [None req-7a082039-5f1c-40f8-96ee-c5a6e1893bac tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d089267c6a4a1391bb89ae66b49da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a63d3a9c6774bba8f276846597e24ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61472) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:40:25 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-7a082039-5f1c-40f8-96ee-c5a6e1893bac tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11eee783-802b-438a-bc43-a59b6c33ce63" status: 200 len: 1494 microversion: 2.1 time: 0.261336 Apr 19 16:40:25 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 82/252] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:40:25 2023] GET /compute/v2.1/servers/11eee783-802b-438a-bc43-a59b6c33ce63 => generated 1494 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:40:25 user devstack@n-api.service[61473]: DEBUG nova.policy [None req-c6590c81-8c67-43fe-9814-969a478717a7 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3934da35244b148d5fa8c56152a1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e6dbe3c46740f3b6d7a0618e076583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61473) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:40:25 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-c6590c81-8c67-43fe-9814-969a478717a7 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a07dc78-c9a6-4ebc-bb9f-35f95a18e246" status: 200 len: 1537 microversion: 2.1 time: 0.253024 Apr 19 16:40:25 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 86/253] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:40:25 2023] GET /compute/v2.1/servers/4a07dc78-c9a6-4ebc-bb9f-35f95a18e246 => generated 1537 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:40:27 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-8d922432-f9b8-4357-9c4b-6af6d82808eb tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:40:27 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-8d922432-f9b8-4357-9c4b-6af6d82808eb tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] [instance: a674a13f-daf9-4a94-b8ec-48e0426eacb2] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:40:27 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_api:SELECT=3 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:40:27 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell1:SELECT=6 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:40:27 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-8d922432-f9b8-4357-9c4b-6af6d82808eb tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:40:27 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-8d922432-f9b8-4357-9c4b-6af6d82808eb tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:40:27 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-8d922432-f9b8-4357-9c4b-6af6d82808eb tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:40:27 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-8d922432-f9b8-4357-9c4b-6af6d82808eb tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:40:27 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-8d922432-f9b8-4357-9c4b-6af6d82808eb tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:40:27 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-8d922432-f9b8-4357-9c4b-6af6d82808eb tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:40:27 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-8d922432-f9b8-4357-9c4b-6af6d82808eb tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a674a13f-daf9-4a94-b8ec-48e0426eacb2/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.184389 Apr 19 16:40:27 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 86/254] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 16:40:27 2023] GET /compute/v2.1/servers/a674a13f-daf9-4a94-b8ec-48e0426eacb2/os-interface => generated 282 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:40:28 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [req-f9653b7c-6b39-40b2-86b6-e1994b638e45 req-e77e6d34-1e7c-45e5-85f1-4a8ab559d2f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a674a13f-daf9-4a94-b8ec-48e0426eacb2", "tag": "b59f650d-f906-41fc-a3bd-17631861ada4"}]} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:40:28 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-f9653b7c-6b39-40b2-86b6-e1994b638e45 req-e77e6d34-1e7c-45e5-85f1-4a8ab559d2f3 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:40:28 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-f9653b7c-6b39-40b2-86b6-e1994b638e45 req-e77e6d34-1e7c-45e5-85f1-4a8ab559d2f3 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:40:28 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-f9653b7c-6b39-40b2-86b6-e1994b638e45 req-e77e6d34-1e7c-45e5-85f1-4a8ab559d2f3 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:40:28 user devstack@n-api.service[61472]: INFO nova.api.openstack.compute.server_external_events [req-f9653b7c-6b39-40b2-86b6-e1994b638e45 req-e77e6d34-1e7c-45e5-85f1-4a8ab559d2f3 service nova] Creating event network-changed:b59f650d-f906-41fc-a3bd-17631861ada4 for instance a674a13f-daf9-4a94-b8ec-48e0426eacb2 on user Apr 19 16:40:28 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [req-f9653b7c-6b39-40b2-86b6-e1994b638e45 req-e77e6d34-1e7c-45e5-85f1-4a8ab559d2f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029670 Apr 19 16:40:28 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 83/255] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:40:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:40:28 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-7ec35863-48ad-499b-a998-eec9a215263e tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:40:28 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-7ec35863-48ad-499b-a998-eec9a215263e tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] [instance: a674a13f-daf9-4a94-b8ec-48e0426eacb2] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:40:28 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-7ec35863-48ad-499b-a998-eec9a215263e tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:40:28 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-7ec35863-48ad-499b-a998-eec9a215263e tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:40:28 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-7ec35863-48ad-499b-a998-eec9a215263e tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:40:28 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-7ec35863-48ad-499b-a998-eec9a215263e tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:40:28 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-7ec35863-48ad-499b-a998-eec9a215263e tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:40:28 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-7ec35863-48ad-499b-a998-eec9a215263e tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:40:28 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-7ec35863-48ad-499b-a998-eec9a215263e tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a674a13f-daf9-4a94-b8ec-48e0426eacb2/ips" status: 200 len: 108 microversion: 2.1 time: 0.035156 Apr 19 16:40:28 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 87/256] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 19 16:40:28 2023] GET /compute/v2.1/servers/a674a13f-daf9-4a94-b8ec-48e0426eacb2/ips => generated 108 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:40:29 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-42ec61ae-02d0-4c69-9f90-a0206e7e9a1d tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:40:29 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-42ec61ae-02d0-4c69-9f90-a0206e7e9a1d tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] [instance: a674a13f-daf9-4a94-b8ec-48e0426eacb2] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:40:29 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-42ec61ae-02d0-4c69-9f90-a0206e7e9a1d tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:40:29 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-42ec61ae-02d0-4c69-9f90-a0206e7e9a1d tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:40:29 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-42ec61ae-02d0-4c69-9f90-a0206e7e9a1d tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:40:29 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-42ec61ae-02d0-4c69-9f90-a0206e7e9a1d tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:40:29 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-42ec61ae-02d0-4c69-9f90-a0206e7e9a1d tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:40:29 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-42ec61ae-02d0-4c69-9f90-a0206e7e9a1d tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:40:29 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-42ec61ae-02d0-4c69-9f90-a0206e7e9a1d tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] [instance: a674a13f-daf9-4a94-b8ec-48e0426eacb2] Going to try to terminate instance {{(pid=61471) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 16:40:29 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-42ec61ae-02d0-4c69-9f90-a0206e7e9a1d tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a674a13f-daf9-4a94-b8ec-48e0426eacb2" status: 204 len: 0 microversion: 2.1 time: 0.117174 Apr 19 16:40:29 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 87/257] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 16:40:29 2023] DELETE /compute/v2.1/servers/a674a13f-daf9-4a94-b8ec-48e0426eacb2 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 16:40:29 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-249eef03-6983-488c-9b06-760785cce8df tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:40:29 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-249eef03-6983-488c-9b06-760785cce8df tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] [instance: a674a13f-daf9-4a94-b8ec-48e0426eacb2] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:40:29 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-249eef03-6983-488c-9b06-760785cce8df tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:40:29 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-249eef03-6983-488c-9b06-760785cce8df tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:40:29 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-249eef03-6983-488c-9b06-760785cce8df tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:40:29 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-249eef03-6983-488c-9b06-760785cce8df tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:40:29 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-249eef03-6983-488c-9b06-760785cce8df tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:40:29 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-249eef03-6983-488c-9b06-760785cce8df tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:40:29 user devstack@n-api.service[61472]: DEBUG nova.policy [None req-249eef03-6983-488c-9b06-760785cce8df tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2563be52f624ceab060942e8bfcedef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ceccc36de46f780e55a02f25782f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61472) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:40:29 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-249eef03-6983-488c-9b06-760785cce8df tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a674a13f-daf9-4a94-b8ec-48e0426eacb2" status: 200 len: 1669 microversion: 2.1 time: 0.232817 Apr 19 16:40:29 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 84/258] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:40:29 2023] GET /compute/v2.1/servers/a674a13f-daf9-4a94-b8ec-48e0426eacb2 => generated 1669 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:40:30 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-01d9cf24-e110-4ae3-adb6-bbdfd05b7f27 req-641843d8-6669-4551-a991-5ce0d8655500 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a674a13f-daf9-4a94-b8ec-48e0426eacb2", "name": "network-vif-unplugged", "status": "completed", "tag": "b59f650d-f906-41fc-a3bd-17631861ada4"}, {"server_uuid": "a674a13f-daf9-4a94-b8ec-48e0426eacb2", "name": "network-vif-plugged", "status": "completed", "tag": "b59f650d-f906-41fc-a3bd-17631861ada4"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:40:30 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-01d9cf24-e110-4ae3-adb6-bbdfd05b7f27 req-641843d8-6669-4551-a991-5ce0d8655500 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:40:30 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-01d9cf24-e110-4ae3-adb6-bbdfd05b7f27 req-641843d8-6669-4551-a991-5ce0d8655500 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:40:30 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-01d9cf24-e110-4ae3-adb6-bbdfd05b7f27 req-641843d8-6669-4551-a991-5ce0d8655500 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:40:30 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-01d9cf24-e110-4ae3-adb6-bbdfd05b7f27 req-641843d8-6669-4551-a991-5ce0d8655500 service nova] Creating event network-vif-unplugged:b59f650d-f906-41fc-a3bd-17631861ada4 for instance a674a13f-daf9-4a94-b8ec-48e0426eacb2 on user Apr 19 16:40:30 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-01d9cf24-e110-4ae3-adb6-bbdfd05b7f27 req-641843d8-6669-4551-a991-5ce0d8655500 service nova] Creating event network-vif-plugged:b59f650d-f906-41fc-a3bd-17631861ada4 for instance a674a13f-daf9-4a94-b8ec-48e0426eacb2 on user Apr 19 16:40:30 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-01d9cf24-e110-4ae3-adb6-bbdfd05b7f27 req-641843d8-6669-4551-a991-5ce0d8655500 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.029648 Apr 19 16:40:30 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 88/259] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:40:30 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:40:31 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [req-ab63b3f2-9ee4-4dc3-b24d-497ce55e9e8b req-9f3419ef-fcfe-4b02-a02b-9e4a7fa3248a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a674a13f-daf9-4a94-b8ec-48e0426eacb2", "name": "network-vif-deleted", "tag": "b59f650d-f906-41fc-a3bd-17631861ada4"}]} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:40:31 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-ab63b3f2-9ee4-4dc3-b24d-497ce55e9e8b req-9f3419ef-fcfe-4b02-a02b-9e4a7fa3248a service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:40:31 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-ab63b3f2-9ee4-4dc3-b24d-497ce55e9e8b req-9f3419ef-fcfe-4b02-a02b-9e4a7fa3248a service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:40:31 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-ab63b3f2-9ee4-4dc3-b24d-497ce55e9e8b req-9f3419ef-fcfe-4b02-a02b-9e4a7fa3248a service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:40:31 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-ab63b3f2-9ee4-4dc3-b24d-497ce55e9e8b req-9f3419ef-fcfe-4b02-a02b-9e4a7fa3248a service nova] Creating event network-vif-deleted:b59f650d-f906-41fc-a3bd-17631861ada4 for instance a674a13f-daf9-4a94-b8ec-48e0426eacb2 on user Apr 19 16:40:31 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [req-ab63b3f2-9ee4-4dc3-b24d-497ce55e9e8b req-9f3419ef-fcfe-4b02-a02b-9e4a7fa3248a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039957 Apr 19 16:40:31 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 88/260] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:40:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:40:35 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-5df4e55f-57f9-4f5c-9b44-86dc559b9b41 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:40:35 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-5df4e55f-57f9-4f5c-9b44-86dc559b9b41 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] [instance: 6b41b6c3-b067-4ae8-9fe2-cbeea18664f5] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:40:35 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-5df4e55f-57f9-4f5c-9b44-86dc559b9b41 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:40:35 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-5df4e55f-57f9-4f5c-9b44-86dc559b9b41 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:40:35 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-5df4e55f-57f9-4f5c-9b44-86dc559b9b41 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:40:35 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-5df4e55f-57f9-4f5c-9b44-86dc559b9b41 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:40:35 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-5df4e55f-57f9-4f5c-9b44-86dc559b9b41 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:40:35 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-5df4e55f-57f9-4f5c-9b44-86dc559b9b41 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:40:36 user devstack@n-api.service[61472]: DEBUG nova.policy [None req-5df4e55f-57f9-4f5c-9b44-86dc559b9b41 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8acfb1eb6149dc962e935451099438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c03f81c174bc89b90e1379b0e358e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61472) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:40:36 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-5df4e55f-57f9-4f5c-9b44-86dc559b9b41 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b41b6c3-b067-4ae8-9fe2-cbeea18664f5" status: 200 len: 1565 microversion: 2.1 time: 0.224325 Apr 19 16:40:36 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 85/261] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:40:35 2023] GET /compute/v2.1/servers/6b41b6c3-b067-4ae8-9fe2-cbeea18664f5 => generated 1565 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 16:40:38 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-17dfaec4-a28a-4606-9ac7-04cef94e8fe9 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:40:38 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-17dfaec4-a28a-4606-9ac7-04cef94e8fe9 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] [instance: edd2688e-940e-4ab3-b27c-b6d4aab3efc5] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:40:38 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-17dfaec4-a28a-4606-9ac7-04cef94e8fe9 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:40:38 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-17dfaec4-a28a-4606-9ac7-04cef94e8fe9 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:40:38 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-17dfaec4-a28a-4606-9ac7-04cef94e8fe9 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:40:38 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-17dfaec4-a28a-4606-9ac7-04cef94e8fe9 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:40:38 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-17dfaec4-a28a-4606-9ac7-04cef94e8fe9 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:40:38 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-17dfaec4-a28a-4606-9ac7-04cef94e8fe9 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:40:38 user devstack@n-api.service[61473]: DEBUG nova.policy [None req-17dfaec4-a28a-4606-9ac7-04cef94e8fe9 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023314f8cf79430b83c5184d9a54be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78962d13860a4df3a8aa100e2afaca6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61473) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:40:38 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-17dfaec4-a28a-4606-9ac7-04cef94e8fe9 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] 10.0.0.210 "GET /compute/v2.1/servers/edd2688e-940e-4ab3-b27c-b6d4aab3efc5" status: 200 len: 1659 microversion: 2.1 time: 0.215926 Apr 19 16:40:38 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 89/262] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:40:38 2023] GET /compute/v2.1/servers/edd2688e-940e-4ab3-b27c-b6d4aab3efc5 => generated 1659 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:40:38 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-fcffb648-0691-4ab2-a973-99786e68a2dc tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:40:38 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-fcffb648-0691-4ab2-a973-99786e68a2dc tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] [instance: edd2688e-940e-4ab3-b27c-b6d4aab3efc5] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:40:38 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-fcffb648-0691-4ab2-a973-99786e68a2dc tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:40:38 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-fcffb648-0691-4ab2-a973-99786e68a2dc tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:40:38 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-fcffb648-0691-4ab2-a973-99786e68a2dc tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:40:38 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-fcffb648-0691-4ab2-a973-99786e68a2dc tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:40:38 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-fcffb648-0691-4ab2-a973-99786e68a2dc tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:40:38 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-fcffb648-0691-4ab2-a973-99786e68a2dc tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:40:38 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-fcffb648-0691-4ab2-a973-99786e68a2dc tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023314f8cf79430b83c5184d9a54be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78962d13860a4df3a8aa100e2afaca6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:40:38 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-fcffb648-0691-4ab2-a973-99786e68a2dc tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] 10.0.0.210 "GET /compute/v2.1/servers/edd2688e-940e-4ab3-b27c-b6d4aab3efc5" status: 200 len: 1659 microversion: 2.1 time: 0.208534 Apr 19 16:40:38 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 89/263] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:40:38 2023] GET /compute/v2.1/servers/edd2688e-940e-4ab3-b27c-b6d4aab3efc5 => generated 1659 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:40:38 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-9d5e65c2-0d9f-4c8f-9c28-acf5fb105714 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:40:38 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-9d5e65c2-0d9f-4c8f-9c28-acf5fb105714 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] [instance: edd2688e-940e-4ab3-b27c-b6d4aab3efc5] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:40:38 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-9d5e65c2-0d9f-4c8f-9c28-acf5fb105714 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:40:38 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-9d5e65c2-0d9f-4c8f-9c28-acf5fb105714 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:40:38 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-9d5e65c2-0d9f-4c8f-9c28-acf5fb105714 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:40:38 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-9d5e65c2-0d9f-4c8f-9c28-acf5fb105714 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:40:38 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-9d5e65c2-0d9f-4c8f-9c28-acf5fb105714 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:40:38 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-9d5e65c2-0d9f-4c8f-9c28-acf5fb105714 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:40:38 user devstack@n-api.service[61472]: DEBUG nova.policy [None req-9d5e65c2-0d9f-4c8f-9c28-acf5fb105714 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023314f8cf79430b83c5184d9a54be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78962d13860a4df3a8aa100e2afaca6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61472) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:40:38 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-9d5e65c2-0d9f-4c8f-9c28-acf5fb105714 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] 10.0.0.210 "GET /compute/v2.1/servers/edd2688e-940e-4ab3-b27c-b6d4aab3efc5" status: 200 len: 1659 microversion: 2.1 time: 0.227477 Apr 19 16:40:38 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 86/264] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:40:38 2023] GET /compute/v2.1/servers/edd2688e-940e-4ab3-b27c-b6d4aab3efc5 => generated 1659 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:40:40 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-ebdd14e3-5acb-4ee9-9de3-d92c39bc0ab0 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:40:40 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-ebdd14e3-5acb-4ee9-9de3-d92c39bc0ab0 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] [instance: 4babffb0-4b9b-4238-be84-0c101346051a] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:40:40 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-ebdd14e3-5acb-4ee9-9de3-d92c39bc0ab0 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:40:40 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-ebdd14e3-5acb-4ee9-9de3-d92c39bc0ab0 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:40:40 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-ebdd14e3-5acb-4ee9-9de3-d92c39bc0ab0 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:40:40 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-ebdd14e3-5acb-4ee9-9de3-d92c39bc0ab0 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:40:40 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-ebdd14e3-5acb-4ee9-9de3-d92c39bc0ab0 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:40:40 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-ebdd14e3-5acb-4ee9-9de3-d92c39bc0ab0 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:40:40 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-ebdd14e3-5acb-4ee9-9de3-d92c39bc0ab0 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:40:40 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-ebdd14e3-5acb-4ee9-9de3-d92c39bc0ab0 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:40:40 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-ebdd14e3-5acb-4ee9-9de3-d92c39bc0ab0 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:40:40 user devstack@n-api.service[61473]: DEBUG nova.objects.instance [None req-ebdd14e3-5acb-4ee9-9de3-d92c39bc0ab0 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lazy-loading 'fault' on Instance uuid 4babffb0-4b9b-4238-be84-0c101346051a {{(pid=61473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 19 16:40:40 user devstack@n-api.service[61473]: DEBUG nova.policy [None req-ebdd14e3-5acb-4ee9-9de3-d92c39bc0ab0 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f2a02626ca4957823de39c9a31d1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ee4833fd147e2a494be5d7634a2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61473) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:40:40 user devstack@n-api.service[61473]: DEBUG nova.policy [None req-ebdd14e3-5acb-4ee9-9de3-d92c39bc0ab0 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63f2a02626ca4957823de39c9a31d1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ee4833fd147e2a494be5d7634a2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61473) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:40:40 user devstack@n-api.service[61473]: DEBUG nova.policy [None req-ebdd14e3-5acb-4ee9-9de3-d92c39bc0ab0 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63f2a02626ca4957823de39c9a31d1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ee4833fd147e2a494be5d7634a2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61473) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:40:40 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-ebdd14e3-5acb-4ee9-9de3-d92c39bc0ab0 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4babffb0-4b9b-4238-be84-0c101346051a" status: 200 len: 1649 microversion: 2.87 time: 0.153257 Apr 19 16:40:40 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 90/265] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 16:40:40 2023] GET /compute/v2.1/servers/4babffb0-4b9b-4238-be84-0c101346051a => generated 1649 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 16:40:40 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-f4a5ee8c-3fc5-43d3-b82b-46bdeb6f98a1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:40:40 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-f4a5ee8c-3fc5-43d3-b82b-46bdeb6f98a1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] [instance: 4babffb0-4b9b-4238-be84-0c101346051a] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:40:40 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-f4a5ee8c-3fc5-43d3-b82b-46bdeb6f98a1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:40:40 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-f4a5ee8c-3fc5-43d3-b82b-46bdeb6f98a1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:40:40 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-f4a5ee8c-3fc5-43d3-b82b-46bdeb6f98a1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:40:40 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-f4a5ee8c-3fc5-43d3-b82b-46bdeb6f98a1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:40:40 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-f4a5ee8c-3fc5-43d3-b82b-46bdeb6f98a1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:40:40 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-f4a5ee8c-3fc5-43d3-b82b-46bdeb6f98a1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:40:40 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-f4a5ee8c-3fc5-43d3-b82b-46bdeb6f98a1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] [instance: 4babffb0-4b9b-4238-be84-0c101346051a] Going to try to terminate instance {{(pid=61471) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 16:40:40 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-f4a5ee8c-3fc5-43d3-b82b-46bdeb6f98a1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] [instance: 4babffb0-4b9b-4238-be84-0c101346051a] Doing local delete in cell 529680e7-3be5-45cb-be5e-d097b6f534fd(cell1) {{(pid=61471) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 19 16:40:40 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-f4a5ee8c-3fc5-43d3-b82b-46bdeb6f98a1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:40:40 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-f4a5ee8c-3fc5-43d3-b82b-46bdeb6f98a1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:40:40 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-f4a5ee8c-3fc5-43d3-b82b-46bdeb6f98a1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:40:40 user devstack@n-api.service[61471]: WARNING nova.compute.api [None req-f4a5ee8c-3fc5-43d3-b82b-46bdeb6f98a1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] [instance: 4babffb0-4b9b-4238-be84-0c101346051a] instance's host None is down, deleting from database Apr 19 16:40:40 user devstack@n-api.service[61471]: DEBUG nova.network.neutron [None req-f4a5ee8c-3fc5-43d3-b82b-46bdeb6f98a1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] [instance: 4babffb0-4b9b-4238-be84-0c101346051a] deallocate_for_instance() {{(pid=61471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 19 16:40:40 user devstack@n-api.service[61471]: DEBUG nova.network.neutron [None req-f4a5ee8c-3fc5-43d3-b82b-46bdeb6f98a1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] [instance: 4babffb0-4b9b-4238-be84-0c101346051a] Instance cache missing network info. {{(pid=61471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 19 16:40:40 user devstack@n-api.service[61471]: DEBUG nova.network.neutron [None req-f4a5ee8c-3fc5-43d3-b82b-46bdeb6f98a1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] [instance: 4babffb0-4b9b-4238-be84-0c101346051a] Updating instance_info_cache with network_info: [] {{(pid=61471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 19 16:40:40 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-f4a5ee8c-3fc5-43d3-b82b-46bdeb6f98a1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] [instance: 4babffb0-4b9b-4238-be84-0c101346051a] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61471) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 19 16:40:40 user devstack@n-api.service[61471]: WARNING nova.compute.api [None req-f4a5ee8c-3fc5-43d3-b82b-46bdeb6f98a1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] [instance: 4babffb0-4b9b-4238-be84-0c101346051a] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 19 16:40:40 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-f4a5ee8c-3fc5-43d3-b82b-46bdeb6f98a1 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4babffb0-4b9b-4238-be84-0c101346051a" status: 204 len: 0 microversion: 2.87 time: 0.613043 Apr 19 16:40:40 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 90/266] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 19 16:40:40 2023] DELETE /compute/v2.1/servers/4babffb0-4b9b-4238-be84-0c101346051a => generated 0 bytes in 616 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 19 16:40:40 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-499375bb-09ad-4be1-870a-e31dac7b0fe0 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:40:40 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-499375bb-09ad-4be1-870a-e31dac7b0fe0 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] [instance: 4babffb0-4b9b-4238-be84-0c101346051a] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:40:40 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-499375bb-09ad-4be1-870a-e31dac7b0fe0 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:40:40 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-499375bb-09ad-4be1-870a-e31dac7b0fe0 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:40:40 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-499375bb-09ad-4be1-870a-e31dac7b0fe0 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:40:40 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-499375bb-09ad-4be1-870a-e31dac7b0fe0 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:40:40 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-499375bb-09ad-4be1-870a-e31dac7b0fe0 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:40:40 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-499375bb-09ad-4be1-870a-e31dac7b0fe0 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:40:40 user devstack@n-api.service[61472]: INFO nova.api.openstack.wsgi [None req-499375bb-09ad-4be1-870a-e31dac7b0fe0 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] HTTP exception thrown: Instance 4babffb0-4b9b-4238-be84-0c101346051a could not be found. Apr 19 16:40:40 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-499375bb-09ad-4be1-870a-e31dac7b0fe0 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Request method failure captured: Apr 19 16:40:40 user devstack@n-api.service[61472]: request: GET /compute/v2.1/servers/4babffb0-4b9b-4238-be84-0c101346051a HTTP/1.1 Apr 19 16:40:40 user devstack@n-api.service[61472]: Accept: application/json Apr 19 16:40:40 user devstack@n-api.service[61472]: Accept-Encoding: identity Apr 19 16:40:40 user devstack@n-api.service[61472]: Connection: close Apr 19 16:40:40 user devstack@n-api.service[61472]: Content-Length: 0 Apr 19 16:40:40 user devstack@n-api.service[61472]: Content-Type: application/json Apr 19 16:40:40 user devstack@n-api.service[61472]: Host: 10.0.0.210 Apr 19 16:40:40 user devstack@n-api.service[61472]: Openstack-System-Scope: None Apr 19 16:40:40 user devstack@n-api.service[61472]: User-Agent: python-urllib3/1.26.15 Apr 19 16:40:40 user devstack@n-api.service[61472]: X-Auth-Token: gAAAAABkQBijykh3S2adH6umevG9TAoFxyN59y4R4BBewsH_kL5fmZak3LoVbATytpojLreFD5t3R4GbFybNCRMdj8zC0Vm3JiC5xHMewyKnRzsZImcv1C_pNgiZvAvFgLtqKepdjPT0GfgbgohTtEJgnPvWu7GRPBx2c9KLd4GIKwjjadzvR7M Apr 19 16:40:40 user devstack@n-api.service[61472]: X-Domain-Id: None Apr 19 16:40:40 user devstack@n-api.service[61472]: X-Domain-Name: None Apr 19 16:40:40 user devstack@n-api.service[61472]: X-Identity-Status: Confirmed Apr 19 16:40:40 user devstack@n-api.service[61472]: X-Is-Admin-Project: True Apr 19 16:40:40 user devstack@n-api.service[61472]: X-Openstack-Nova-Api-Version: 2.87 Apr 19 16:40:40 user devstack@n-api.service[61472]: X-Project-Domain-Id: default Apr 19 16:40:40 user devstack@n-api.service[61472]: X-Project-Domain-Name: Default Apr 19 16:40:40 user devstack@n-api.service[61472]: X-Project-Id: e58ee4833fd147e2a494be5d7634a2fa Apr 19 16:40:40 user devstack@n-api.service[61472]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-847899299 Apr 19 16:40:40 user devstack@n-api.service[61472]: X-Role: member,reader Apr 19 16:40:40 user devstack@n-api.service[61472]: X-Roles: member,reader Apr 19 16:40:40 user devstack@n-api.service[61472]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e58ee4833fd147e2a494be5d7634a2fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e58ee4833fd147e2a494be5d7634a2fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e58ee4833fd147e2a494be5d7634a2fa"}]}] Apr 19 16:40:40 user devstack@n-api.service[61472]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-847899299 Apr 19 16:40:40 user devstack@n-api.service[61472]: X-Tenant-Id: e58ee4833fd147e2a494be5d7634a2fa Apr 19 16:40:40 user devstack@n-api.service[61472]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-847899299 Apr 19 16:40:40 user devstack@n-api.service[61472]: X-User: tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member Apr 19 16:40:40 user devstack@n-api.service[61472]: X-User-Domain-Id: default Apr 19 16:40:40 user devstack@n-api.service[61472]: X-User-Domain-Name: Default Apr 19 16:40:40 user devstack@n-api.service[61472]: X-User-Id: 63f2a02626ca4957823de39c9a31d1b8 Apr 19 16:40:40 user devstack@n-api.service[61472]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member Apr 19 16:40:40 user devstack@n-api.service[61472]: method: > Apr 19 16:40:40 user devstack@n-api.service[61472]: exception: Instance 4babffb0-4b9b-4238-be84-0c101346051a could not be found. Apr 19 16:40:40 user devstack@n-api.service[61472]: action_args: {'id': '4babffb0-4b9b-4238-be84-0c101346051a'} Apr 19 16:40:40 user devstack@n-api.service[61472]: {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:40:40 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:40:40 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:40:40 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:40:40 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:40:40 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:40:40 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:40:40 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:40:40 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:40:40 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:40:40 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4babffb0-4b9b-4238-be84-0c101346051a could not be found. Apr 19 16:40:40 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:40:40 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:40:40 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:40:40 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:40:40 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:40:40 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:40:40 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:40:40 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:40:40 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:40:40 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:40:40 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 16:40:40 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 16:40:40 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:40:40 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:40:40 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:40:40 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:40:40 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4babffb0-4b9b-4238-be84-0c101346051a could not be found. Apr 19 16:40:40 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:40:40 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:40:40 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:40:40 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:40:40 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:40:40 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:40:40 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:40:40 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:40:40 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4babffb0-4b9b-4238-be84-0c101346051a could not be found. Apr 19 16:40:40 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:40:40 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-499375bb-09ad-4be1-870a-e31dac7b0fe0 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Returning 404 to user: Instance 4babffb0-4b9b-4238-be84-0c101346051a could not be found. {{(pid=61472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:40:40 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-499375bb-09ad-4be1-870a-e31dac7b0fe0 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4babffb0-4b9b-4238-be84-0c101346051a" status: 404 len: 111 microversion: 2.87 time: 0.036866 Apr 19 16:40:40 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 87/267] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 16:40:40 2023] GET /compute/v2.1/servers/4babffb0-4b9b-4238-be84-0c101346051a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 16:40:40 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-9e8ea83a-650d-4862-81b7-ca54fdeff71b tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-990435827", "imageRef": "ab56c4b1-0117-43b0-84b6-28d06a23f182", "flavorRef": "42", "networks": [{"uuid": "bdc7f4b4-1167-484c-ab08-77c4f58bf2f6"}]}} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:40:41 user devstack@n-api.service[61473]: DEBUG nova.network.neutron [None req-9e8ea83a-650d-4862-81b7-ca54fdeff71b tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] validate_networks() for [('bdc7f4b4-1167-484c-ab08-77c4f58bf2f6', None, None, None, None, None)] {{(pid=61473) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 16:40:41 user devstack@n-api.service[61473]: DEBUG nova.virt.hardware [None req-9e8ea83a-650d-4862-81b7-ca54fdeff71b tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Flavor limits 0:0:0 {{(pid=61473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 16:40:41 user devstack@n-api.service[61473]: DEBUG nova.virt.hardware [None req-9e8ea83a-650d-4862-81b7-ca54fdeff71b tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Image limits 0:0:0 {{(pid=61473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 16:40:41 user devstack@n-api.service[61473]: DEBUG nova.virt.hardware [None req-9e8ea83a-650d-4862-81b7-ca54fdeff71b tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Flavor pref 0:0:0 {{(pid=61473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 16:40:41 user devstack@n-api.service[61473]: DEBUG nova.virt.hardware [None req-9e8ea83a-650d-4862-81b7-ca54fdeff71b tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Image pref 0:0:0 {{(pid=61473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 16:40:41 user devstack@n-api.service[61473]: DEBUG nova.virt.hardware [None req-9e8ea83a-650d-4862-81b7-ca54fdeff71b tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 16:40:41 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-9e8ea83a-650d-4862-81b7-ca54fdeff71b tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:40:41 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-9e8ea83a-650d-4862-81b7-ca54fdeff71b tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:40:41 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-9e8ea83a-650d-4862-81b7-ca54fdeff71b tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:40:41 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-9e8ea83a-650d-4862-81b7-ca54fdeff71b tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:40:41 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-9e8ea83a-650d-4862-81b7-ca54fdeff71b tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:40:41 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-9e8ea83a-650d-4862-81b7-ca54fdeff71b tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:40:41 user devstack@n-api.service[61473]: DEBUG nova.quota [None req-9e8ea83a-650d-4862-81b7-ca54fdeff71b tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Getting quotas for project e58ee4833fd147e2a494be5d7634a2fa. Resources: {'instances', 'ram', 'cores'} {{(pid=61473) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 16:40:41 user devstack@n-api.service[61473]: DEBUG nova.quota [None req-9e8ea83a-650d-4862-81b7-ca54fdeff71b tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Getting quotas for user 63f2a02626ca4957823de39c9a31d1b8 and project e58ee4833fd147e2a494be5d7634a2fa. Resources: {'instances', 'ram', 'cores'} {{(pid=61473) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 16:40:41 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-9e8ea83a-650d-4862-81b7-ca54fdeff71b tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Going to run 1 instances... {{(pid=61473) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 16:40:41 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-9e8ea83a-650d-4862-81b7-ca54fdeff71b tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] [instance: 4bca7be9-c7ba-4c5a-9860-bf516f174865] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ab56c4b1-0117-43b0-84b6-28d06a23f182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61473) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 16:40:41 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-9e8ea83a-650d-4862-81b7-ca54fdeff71b tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.642467 Apr 19 16:40:41 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 91/268] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 19 16:40:40 2023] POST /compute/v2.1/servers => generated 378 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Apr 19 16:40:41 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-1deae7ec-5b4e-48cb-bdd6-ad131d006f7a tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:40:41 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-1deae7ec-5b4e-48cb-bdd6-ad131d006f7a tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] [instance: 4bca7be9-c7ba-4c5a-9860-bf516f174865] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:40:41 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-1deae7ec-5b4e-48cb-bdd6-ad131d006f7a tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f2a02626ca4957823de39c9a31d1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ee4833fd147e2a494be5d7634a2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:40:41 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-1deae7ec-5b4e-48cb-bdd6-ad131d006f7a tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63f2a02626ca4957823de39c9a31d1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ee4833fd147e2a494be5d7634a2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:40:41 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-1deae7ec-5b4e-48cb-bdd6-ad131d006f7a tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63f2a02626ca4957823de39c9a31d1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ee4833fd147e2a494be5d7634a2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:40:41 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-1deae7ec-5b4e-48cb-bdd6-ad131d006f7a tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4bca7be9-c7ba-4c5a-9860-bf516f174865" status: 200 len: 1394 microversion: 2.87 time: 0.073441 Apr 19 16:40:41 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 91/269] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 16:40:41 2023] GET /compute/v2.1/servers/4bca7be9-c7ba-4c5a-9860-bf516f174865 => generated 1394 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 16:40:43 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [req-8ed069db-10c3-4ca3-abe7-22a34aea3adf req-19a8b6a2-b79e-4206-83e8-4276cdc34f58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bca7be9-c7ba-4c5a-9860-bf516f174865", "tag": "3b89e9db-a95a-4407-b2ed-681d9e5854e6"}]} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:40:43 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-8ed069db-10c3-4ca3-abe7-22a34aea3adf req-19a8b6a2-b79e-4206-83e8-4276cdc34f58 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:40:43 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-8ed069db-10c3-4ca3-abe7-22a34aea3adf req-19a8b6a2-b79e-4206-83e8-4276cdc34f58 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:40:43 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-8ed069db-10c3-4ca3-abe7-22a34aea3adf req-19a8b6a2-b79e-4206-83e8-4276cdc34f58 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:40:43 user devstack@n-api.service[61472]: INFO nova.api.openstack.compute.server_external_events [req-8ed069db-10c3-4ca3-abe7-22a34aea3adf req-19a8b6a2-b79e-4206-83e8-4276cdc34f58 service nova] Creating event network-changed:3b89e9db-a95a-4407-b2ed-681d9e5854e6 for instance 4bca7be9-c7ba-4c5a-9860-bf516f174865 on user Apr 19 16:40:43 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [req-8ed069db-10c3-4ca3-abe7-22a34aea3adf req-19a8b6a2-b79e-4206-83e8-4276cdc34f58 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030401 Apr 19 16:40:43 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 88/270] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:40:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:40:45 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-16fdbc2d-d7ee-4bef-b456-6ad96c450762 req-b1202862-0c89-4ba5-9fb3-cba50a39967e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bca7be9-c7ba-4c5a-9860-bf516f174865", "name": "network-vif-plugged", "status": "completed", "tag": "3b89e9db-a95a-4407-b2ed-681d9e5854e6"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:40:45 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-16fdbc2d-d7ee-4bef-b456-6ad96c450762 req-b1202862-0c89-4ba5-9fb3-cba50a39967e service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:40:45 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-16fdbc2d-d7ee-4bef-b456-6ad96c450762 req-b1202862-0c89-4ba5-9fb3-cba50a39967e service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:40:45 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-16fdbc2d-d7ee-4bef-b456-6ad96c450762 req-b1202862-0c89-4ba5-9fb3-cba50a39967e service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:40:45 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-16fdbc2d-d7ee-4bef-b456-6ad96c450762 req-b1202862-0c89-4ba5-9fb3-cba50a39967e service nova] Creating event network-vif-plugged:3b89e9db-a95a-4407-b2ed-681d9e5854e6 for instance 4bca7be9-c7ba-4c5a-9860-bf516f174865 on user Apr 19 16:40:45 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-16fdbc2d-d7ee-4bef-b456-6ad96c450762 req-b1202862-0c89-4ba5-9fb3-cba50a39967e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032456 Apr 19 16:40:45 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 92/271] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:40:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:40:47 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [req-ab502196-fa0c-4a25-8be4-856d8559a8a8 req-62d3de11-4fa2-40a0-a5e3-0ff7895df869 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bca7be9-c7ba-4c5a-9860-bf516f174865", "name": "network-vif-plugged", "status": "completed", "tag": "3b89e9db-a95a-4407-b2ed-681d9e5854e6"}]} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:40:47 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-ab502196-fa0c-4a25-8be4-856d8559a8a8 req-62d3de11-4fa2-40a0-a5e3-0ff7895df869 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:40:47 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-ab502196-fa0c-4a25-8be4-856d8559a8a8 req-62d3de11-4fa2-40a0-a5e3-0ff7895df869 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:40:47 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-ab502196-fa0c-4a25-8be4-856d8559a8a8 req-62d3de11-4fa2-40a0-a5e3-0ff7895df869 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:40:47 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-ab502196-fa0c-4a25-8be4-856d8559a8a8 req-62d3de11-4fa2-40a0-a5e3-0ff7895df869 service nova] Creating event network-vif-plugged:3b89e9db-a95a-4407-b2ed-681d9e5854e6 for instance 4bca7be9-c7ba-4c5a-9860-bf516f174865 on user Apr 19 16:40:47 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [req-ab502196-fa0c-4a25-8be4-856d8559a8a8 req-62d3de11-4fa2-40a0-a5e3-0ff7895df869 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039137 Apr 19 16:40:47 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 92/272] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:40:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:41:19 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_api:SELECT=14 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:41:19 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell1:SELECT=30 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:41:19 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-16397ecb-3f86-4fde-bf38-4b9d1be299f7 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:41:19 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-16397ecb-3f86-4fde-bf38-4b9d1be299f7 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] [instance: a674a13f-daf9-4a94-b8ec-48e0426eacb2] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:41:19 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-16397ecb-3f86-4fde-bf38-4b9d1be299f7 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:41:19 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-16397ecb-3f86-4fde-bf38-4b9d1be299f7 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:41:19 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-16397ecb-3f86-4fde-bf38-4b9d1be299f7 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:41:19 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-16397ecb-3f86-4fde-bf38-4b9d1be299f7 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:41:19 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-16397ecb-3f86-4fde-bf38-4b9d1be299f7 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:41:19 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-16397ecb-3f86-4fde-bf38-4b9d1be299f7 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:41:19 user devstack@n-api.service[61472]: INFO nova.api.openstack.wsgi [None req-16397ecb-3f86-4fde-bf38-4b9d1be299f7 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] HTTP exception thrown: Instance a674a13f-daf9-4a94-b8ec-48e0426eacb2 could not be found. Apr 19 16:41:19 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-16397ecb-3f86-4fde-bf38-4b9d1be299f7 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Request method failure captured: Apr 19 16:41:19 user devstack@n-api.service[61472]: request: GET /compute/v2.1/servers/a674a13f-daf9-4a94-b8ec-48e0426eacb2 HTTP/1.1 Apr 19 16:41:19 user devstack@n-api.service[61472]: Accept: application/json Apr 19 16:41:19 user devstack@n-api.service[61472]: Accept-Encoding: identity Apr 19 16:41:19 user devstack@n-api.service[61472]: Connection: close Apr 19 16:41:19 user devstack@n-api.service[61472]: Content-Length: 0 Apr 19 16:41:19 user devstack@n-api.service[61472]: Content-Type: application/json Apr 19 16:41:19 user devstack@n-api.service[61472]: Host: 10.0.0.210 Apr 19 16:41:19 user devstack@n-api.service[61472]: Openstack-System-Scope: None Apr 19 16:41:19 user devstack@n-api.service[61472]: User-Agent: python-urllib3/1.26.15 Apr 19 16:41:19 user devstack@n-api.service[61472]: X-Auth-Token: gAAAAABkQBe1KSHokT8PQH3k3vnjIt97t532dWuRz8Pml0FOlGyiPoJ_q_-ld3S6cAAgROvvvhUgmEwfCyYUzAgb5BImPOX9fwVjK1KI0GLz312Q5Z2IlqMSmB5SJFoVIfRtPQ9K8GxAdUo5TO_60RdH4gGaVZDRdA94Vol93DCBoXTfp3X86mQ Apr 19 16:41:19 user devstack@n-api.service[61472]: X-Domain-Id: None Apr 19 16:41:19 user devstack@n-api.service[61472]: X-Domain-Name: None Apr 19 16:41:19 user devstack@n-api.service[61472]: X-Identity-Status: Confirmed Apr 19 16:41:19 user devstack@n-api.service[61472]: X-Is-Admin-Project: True Apr 19 16:41:19 user devstack@n-api.service[61472]: X-Project-Domain-Id: default Apr 19 16:41:19 user devstack@n-api.service[61472]: X-Project-Domain-Name: Default Apr 19 16:41:19 user devstack@n-api.service[61472]: X-Project-Id: 821ceccc36de46f780e55a02f25782f4 Apr 19 16:41:19 user devstack@n-api.service[61472]: X-Project-Name: tempest-AttachVolumeNegativeTest-2083894839 Apr 19 16:41:19 user devstack@n-api.service[61472]: X-Role: member,reader Apr 19 16:41:19 user devstack@n-api.service[61472]: X-Roles: member,reader Apr 19 16:41:19 user devstack@n-api.service[61472]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/821ceccc36de46f780e55a02f25782f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/821ceccc36de46f780e55a02f25782f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/821ceccc36de46f780e55a02f25782f4"}]}] Apr 19 16:41:19 user devstack@n-api.service[61472]: X-Tenant: tempest-AttachVolumeNegativeTest-2083894839 Apr 19 16:41:19 user devstack@n-api.service[61472]: X-Tenant-Id: 821ceccc36de46f780e55a02f25782f4 Apr 19 16:41:19 user devstack@n-api.service[61472]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2083894839 Apr 19 16:41:19 user devstack@n-api.service[61472]: X-User: tempest-AttachVolumeNegativeTest-2083894839-project-member Apr 19 16:41:19 user devstack@n-api.service[61472]: X-User-Domain-Id: default Apr 19 16:41:19 user devstack@n-api.service[61472]: X-User-Domain-Name: Default Apr 19 16:41:19 user devstack@n-api.service[61472]: X-User-Id: c2563be52f624ceab060942e8bfcedef Apr 19 16:41:19 user devstack@n-api.service[61472]: X-User-Name: tempest-AttachVolumeNegativeTest-2083894839-project-member Apr 19 16:41:19 user devstack@n-api.service[61472]: method: > Apr 19 16:41:19 user devstack@n-api.service[61472]: exception: Instance a674a13f-daf9-4a94-b8ec-48e0426eacb2 could not be found. Apr 19 16:41:19 user devstack@n-api.service[61472]: action_args: {'id': 'a674a13f-daf9-4a94-b8ec-48e0426eacb2'} Apr 19 16:41:19 user devstack@n-api.service[61472]: {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:41:19 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:41:19 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:41:19 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:41:19 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:41:19 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:41:19 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:41:19 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:41:19 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:41:19 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:41:19 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a674a13f-daf9-4a94-b8ec-48e0426eacb2 could not be found. Apr 19 16:41:19 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:41:19 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:41:19 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:41:19 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:41:19 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:41:19 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:41:19 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:41:19 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:41:19 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:41:19 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:41:19 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 16:41:19 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 16:41:19 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:41:19 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:41:19 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:41:19 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:41:19 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a674a13f-daf9-4a94-b8ec-48e0426eacb2 could not be found. Apr 19 16:41:19 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:41:19 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:41:19 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:41:19 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:41:19 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:41:19 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:41:19 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:41:19 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:41:19 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a674a13f-daf9-4a94-b8ec-48e0426eacb2 could not be found. Apr 19 16:41:19 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:41:19 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-16397ecb-3f86-4fde-bf38-4b9d1be299f7 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Returning 404 to user: Instance a674a13f-daf9-4a94-b8ec-48e0426eacb2 could not be found. {{(pid=61472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:41:19 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-16397ecb-3f86-4fde-bf38-4b9d1be299f7 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a674a13f-daf9-4a94-b8ec-48e0426eacb2" status: 404 len: 111 microversion: 2.1 time: 0.049868 Apr 19 16:41:19 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 89/273] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:41:19 2023] GET /compute/v2.1/servers/a674a13f-daf9-4a94-b8ec-48e0426eacb2 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 16:41:19 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-abcdae6f-65c8-4f9f-af69-9d181e723a5b tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Calling method '.version_select at 0x7fd49711fe20>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:41:19 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell0:SELECT=2 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:41:19 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell0:SELECT=6 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:41:19 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:41:19 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell1:SELECT=30 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:41:19 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-abcdae6f-65c8-4f9f-af69-9d181e723a5b tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-367895079" status: 202 len: 0 microversion: 2.1 time: 0.035382 Apr 19 16:41:19 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 93/274] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 19 16:41:19 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-367895079 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 16:41:20 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell0:SELECT=2 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:41:20 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=2 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:41:20 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=19,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:41:20 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-236945e5-aaf5-4e2d-b2b8-5bc48b8cbec1 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:41:20 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-236945e5-aaf5-4e2d-b2b8-5bc48b8cbec1 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] [instance: a674a13f-daf9-4a94-b8ec-48e0426eacb2] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:41:20 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-236945e5-aaf5-4e2d-b2b8-5bc48b8cbec1 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:41:20 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-236945e5-aaf5-4e2d-b2b8-5bc48b8cbec1 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:41:20 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-236945e5-aaf5-4e2d-b2b8-5bc48b8cbec1 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:41:20 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-236945e5-aaf5-4e2d-b2b8-5bc48b8cbec1 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:41:20 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-236945e5-aaf5-4e2d-b2b8-5bc48b8cbec1 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:41:20 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-236945e5-aaf5-4e2d-b2b8-5bc48b8cbec1 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:41:20 user devstack@n-api.service[61471]: INFO nova.api.openstack.wsgi [None req-236945e5-aaf5-4e2d-b2b8-5bc48b8cbec1 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] HTTP exception thrown: Instance a674a13f-daf9-4a94-b8ec-48e0426eacb2 could not be found. Apr 19 16:41:20 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-236945e5-aaf5-4e2d-b2b8-5bc48b8cbec1 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Request method failure captured: Apr 19 16:41:20 user devstack@n-api.service[61471]: request: DELETE /compute/v2.1/servers/a674a13f-daf9-4a94-b8ec-48e0426eacb2 HTTP/1.1 Apr 19 16:41:20 user devstack@n-api.service[61471]: Accept: application/json Apr 19 16:41:20 user devstack@n-api.service[61471]: Accept-Encoding: identity Apr 19 16:41:20 user devstack@n-api.service[61471]: Connection: close Apr 19 16:41:20 user devstack@n-api.service[61471]: Content-Length: 0 Apr 19 16:41:20 user devstack@n-api.service[61471]: Content-Type: application/json Apr 19 16:41:20 user devstack@n-api.service[61471]: Host: 10.0.0.210 Apr 19 16:41:20 user devstack@n-api.service[61471]: Openstack-System-Scope: None Apr 19 16:41:20 user devstack@n-api.service[61471]: User-Agent: python-urllib3/1.26.15 Apr 19 16:41:20 user devstack@n-api.service[61471]: X-Auth-Token: gAAAAABkQBe1KSHokT8PQH3k3vnjIt97t532dWuRz8Pml0FOlGyiPoJ_q_-ld3S6cAAgROvvvhUgmEwfCyYUzAgb5BImPOX9fwVjK1KI0GLz312Q5Z2IlqMSmB5SJFoVIfRtPQ9K8GxAdUo5TO_60RdH4gGaVZDRdA94Vol93DCBoXTfp3X86mQ Apr 19 16:41:20 user devstack@n-api.service[61471]: X-Domain-Id: None Apr 19 16:41:20 user devstack@n-api.service[61471]: X-Domain-Name: None Apr 19 16:41:20 user devstack@n-api.service[61471]: X-Identity-Status: Confirmed Apr 19 16:41:20 user devstack@n-api.service[61471]: X-Is-Admin-Project: True Apr 19 16:41:20 user devstack@n-api.service[61471]: X-Project-Domain-Id: default Apr 19 16:41:20 user devstack@n-api.service[61471]: X-Project-Domain-Name: Default Apr 19 16:41:20 user devstack@n-api.service[61471]: X-Project-Id: 821ceccc36de46f780e55a02f25782f4 Apr 19 16:41:20 user devstack@n-api.service[61471]: X-Project-Name: tempest-AttachVolumeNegativeTest-2083894839 Apr 19 16:41:20 user devstack@n-api.service[61471]: X-Role: member,reader Apr 19 16:41:20 user devstack@n-api.service[61471]: X-Roles: member,reader Apr 19 16:41:20 user devstack@n-api.service[61471]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/821ceccc36de46f780e55a02f25782f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/821ceccc36de46f780e55a02f25782f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/821ceccc36de46f780e55a02f25782f4"}]}] Apr 19 16:41:20 user devstack@n-api.service[61471]: X-Tenant: tempest-AttachVolumeNegativeTest-2083894839 Apr 19 16:41:20 user devstack@n-api.service[61471]: X-Tenant-Id: 821ceccc36de46f780e55a02f25782f4 Apr 19 16:41:20 user devstack@n-api.service[61471]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2083894839 Apr 19 16:41:20 user devstack@n-api.service[61471]: X-User: tempest-AttachVolumeNegativeTest-2083894839-project-member Apr 19 16:41:20 user devstack@n-api.service[61471]: X-User-Domain-Id: default Apr 19 16:41:20 user devstack@n-api.service[61471]: X-User-Domain-Name: Default Apr 19 16:41:20 user devstack@n-api.service[61471]: X-User-Id: c2563be52f624ceab060942e8bfcedef Apr 19 16:41:20 user devstack@n-api.service[61471]: X-User-Name: tempest-AttachVolumeNegativeTest-2083894839-project-member Apr 19 16:41:20 user devstack@n-api.service[61471]: method: > Apr 19 16:41:20 user devstack@n-api.service[61471]: exception: Instance a674a13f-daf9-4a94-b8ec-48e0426eacb2 could not be found. Apr 19 16:41:20 user devstack@n-api.service[61471]: action_args: {'id': 'a674a13f-daf9-4a94-b8ec-48e0426eacb2'} Apr 19 16:41:20 user devstack@n-api.service[61471]: {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:41:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:41:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:41:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:41:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:41:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:41:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:41:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:41:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:41:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:41:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a674a13f-daf9-4a94-b8ec-48e0426eacb2 could not be found. Apr 19 16:41:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:41:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:41:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:41:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:41:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:41:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:41:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:41:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:41:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:41:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:41:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 19 16:41:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 19 16:41:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 19 16:41:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 19 16:41:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:41:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:41:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:41:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:41:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a674a13f-daf9-4a94-b8ec-48e0426eacb2 could not be found. Apr 19 16:41:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:41:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:41:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:41:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:41:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:41:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:41:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:41:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:41:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a674a13f-daf9-4a94-b8ec-48e0426eacb2 could not be found. Apr 19 16:41:20 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:41:20 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-236945e5-aaf5-4e2d-b2b8-5bc48b8cbec1 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Returning 404 to user: Instance a674a13f-daf9-4a94-b8ec-48e0426eacb2 could not be found. {{(pid=61471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:41:20 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-236945e5-aaf5-4e2d-b2b8-5bc48b8cbec1 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a674a13f-daf9-4a94-b8ec-48e0426eacb2" status: 404 len: 111 microversion: 2.1 time: 0.044436 Apr 19 16:41:20 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 93/275] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 16:41:20 2023] DELETE /compute/v2.1/servers/a674a13f-daf9-4a94-b8ec-48e0426eacb2 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 16:41:20 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-2168e70d-fe8b-4742-bcd2-063c8d8b2af2 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:41:20 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-2168e70d-fe8b-4742-bcd2-063c8d8b2af2 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] [instance: a674a13f-daf9-4a94-b8ec-48e0426eacb2] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:41:20 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-2168e70d-fe8b-4742-bcd2-063c8d8b2af2 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:41:20 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-2168e70d-fe8b-4742-bcd2-063c8d8b2af2 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:41:20 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-2168e70d-fe8b-4742-bcd2-063c8d8b2af2 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:41:20 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-2168e70d-fe8b-4742-bcd2-063c8d8b2af2 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:41:20 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-2168e70d-fe8b-4742-bcd2-063c8d8b2af2 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:41:20 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-2168e70d-fe8b-4742-bcd2-063c8d8b2af2 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:41:20 user devstack@n-api.service[61472]: INFO nova.api.openstack.wsgi [None req-2168e70d-fe8b-4742-bcd2-063c8d8b2af2 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] HTTP exception thrown: Instance a674a13f-daf9-4a94-b8ec-48e0426eacb2 could not be found. Apr 19 16:41:20 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-2168e70d-fe8b-4742-bcd2-063c8d8b2af2 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Request method failure captured: Apr 19 16:41:20 user devstack@n-api.service[61472]: request: GET /compute/v2.1/servers/a674a13f-daf9-4a94-b8ec-48e0426eacb2 HTTP/1.1 Apr 19 16:41:20 user devstack@n-api.service[61472]: Accept: application/json Apr 19 16:41:20 user devstack@n-api.service[61472]: Accept-Encoding: identity Apr 19 16:41:20 user devstack@n-api.service[61472]: Connection: close Apr 19 16:41:20 user devstack@n-api.service[61472]: Content-Length: 0 Apr 19 16:41:20 user devstack@n-api.service[61472]: Content-Type: application/json Apr 19 16:41:20 user devstack@n-api.service[61472]: Host: 10.0.0.210 Apr 19 16:41:20 user devstack@n-api.service[61472]: Openstack-System-Scope: None Apr 19 16:41:20 user devstack@n-api.service[61472]: User-Agent: python-urllib3/1.26.15 Apr 19 16:41:20 user devstack@n-api.service[61472]: X-Auth-Token: gAAAAABkQBe1KSHokT8PQH3k3vnjIt97t532dWuRz8Pml0FOlGyiPoJ_q_-ld3S6cAAgROvvvhUgmEwfCyYUzAgb5BImPOX9fwVjK1KI0GLz312Q5Z2IlqMSmB5SJFoVIfRtPQ9K8GxAdUo5TO_60RdH4gGaVZDRdA94Vol93DCBoXTfp3X86mQ Apr 19 16:41:20 user devstack@n-api.service[61472]: X-Domain-Id: None Apr 19 16:41:20 user devstack@n-api.service[61472]: X-Domain-Name: None Apr 19 16:41:20 user devstack@n-api.service[61472]: X-Identity-Status: Confirmed Apr 19 16:41:20 user devstack@n-api.service[61472]: X-Is-Admin-Project: True Apr 19 16:41:20 user devstack@n-api.service[61472]: X-Project-Domain-Id: default Apr 19 16:41:20 user devstack@n-api.service[61472]: X-Project-Domain-Name: Default Apr 19 16:41:20 user devstack@n-api.service[61472]: X-Project-Id: 821ceccc36de46f780e55a02f25782f4 Apr 19 16:41:20 user devstack@n-api.service[61472]: X-Project-Name: tempest-AttachVolumeNegativeTest-2083894839 Apr 19 16:41:20 user devstack@n-api.service[61472]: X-Role: member,reader Apr 19 16:41:20 user devstack@n-api.service[61472]: X-Roles: member,reader Apr 19 16:41:20 user devstack@n-api.service[61472]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/821ceccc36de46f780e55a02f25782f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/821ceccc36de46f780e55a02f25782f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/821ceccc36de46f780e55a02f25782f4"}]}] Apr 19 16:41:20 user devstack@n-api.service[61472]: X-Tenant: tempest-AttachVolumeNegativeTest-2083894839 Apr 19 16:41:20 user devstack@n-api.service[61472]: X-Tenant-Id: 821ceccc36de46f780e55a02f25782f4 Apr 19 16:41:20 user devstack@n-api.service[61472]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2083894839 Apr 19 16:41:20 user devstack@n-api.service[61472]: X-User: tempest-AttachVolumeNegativeTest-2083894839-project-member Apr 19 16:41:20 user devstack@n-api.service[61472]: X-User-Domain-Id: default Apr 19 16:41:20 user devstack@n-api.service[61472]: X-User-Domain-Name: Default Apr 19 16:41:20 user devstack@n-api.service[61472]: X-User-Id: c2563be52f624ceab060942e8bfcedef Apr 19 16:41:20 user devstack@n-api.service[61472]: X-User-Name: tempest-AttachVolumeNegativeTest-2083894839-project-member Apr 19 16:41:20 user devstack@n-api.service[61472]: method: > Apr 19 16:41:20 user devstack@n-api.service[61472]: exception: Instance a674a13f-daf9-4a94-b8ec-48e0426eacb2 could not be found. Apr 19 16:41:20 user devstack@n-api.service[61472]: action_args: {'id': 'a674a13f-daf9-4a94-b8ec-48e0426eacb2'} Apr 19 16:41:20 user devstack@n-api.service[61472]: {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:41:20 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:41:20 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:41:20 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:41:20 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:41:20 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:41:20 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:41:20 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:41:20 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:41:20 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:41:20 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a674a13f-daf9-4a94-b8ec-48e0426eacb2 could not be found. Apr 19 16:41:20 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:41:20 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:41:20 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:41:20 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:41:20 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:41:20 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:41:20 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:41:20 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:41:20 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:41:20 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:41:20 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 16:41:20 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 16:41:20 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:41:20 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:41:20 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:41:20 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:41:20 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a674a13f-daf9-4a94-b8ec-48e0426eacb2 could not be found. Apr 19 16:41:20 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:41:20 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:41:20 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:41:20 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:41:20 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:41:20 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:41:20 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:41:20 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:41:20 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a674a13f-daf9-4a94-b8ec-48e0426eacb2 could not be found. Apr 19 16:41:20 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:41:20 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-2168e70d-fe8b-4742-bcd2-063c8d8b2af2 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Returning 404 to user: Instance a674a13f-daf9-4a94-b8ec-48e0426eacb2 could not be found. {{(pid=61472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:41:20 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-2168e70d-fe8b-4742-bcd2-063c8d8b2af2 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a674a13f-daf9-4a94-b8ec-48e0426eacb2" status: 404 len: 111 microversion: 2.1 time: 0.045036 Apr 19 16:41:20 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 90/276] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:41:20 2023] GET /compute/v2.1/servers/a674a13f-daf9-4a94-b8ec-48e0426eacb2 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 16:41:21 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-5c368789-d3e0-4ecf-93ed-cd901f43eb9f tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:41:21 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-5c368789-d3e0-4ecf-93ed-cd901f43eb9f tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] [instance: 795900b6-2c41-403e-9023-2ee74e755f5e] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:41:21 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-5c368789-d3e0-4ecf-93ed-cd901f43eb9f tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:41:21 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-5c368789-d3e0-4ecf-93ed-cd901f43eb9f tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:41:21 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-5c368789-d3e0-4ecf-93ed-cd901f43eb9f tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:41:21 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-5c368789-d3e0-4ecf-93ed-cd901f43eb9f tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:41:21 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-5c368789-d3e0-4ecf-93ed-cd901f43eb9f tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:41:21 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-5c368789-d3e0-4ecf-93ed-cd901f43eb9f tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:41:21 user devstack@n-api.service[61473]: INFO nova.api.openstack.wsgi [None req-5c368789-d3e0-4ecf-93ed-cd901f43eb9f tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] HTTP exception thrown: Instance 795900b6-2c41-403e-9023-2ee74e755f5e could not be found. Apr 19 16:41:21 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-5c368789-d3e0-4ecf-93ed-cd901f43eb9f tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Request method failure captured: Apr 19 16:41:21 user devstack@n-api.service[61473]: request: DELETE /compute/v2.1/servers/795900b6-2c41-403e-9023-2ee74e755f5e HTTP/1.1 Apr 19 16:41:21 user devstack@n-api.service[61473]: Accept: application/json Apr 19 16:41:21 user devstack@n-api.service[61473]: Accept-Encoding: identity Apr 19 16:41:21 user devstack@n-api.service[61473]: Connection: close Apr 19 16:41:21 user devstack@n-api.service[61473]: Content-Length: 0 Apr 19 16:41:21 user devstack@n-api.service[61473]: Content-Type: application/json Apr 19 16:41:21 user devstack@n-api.service[61473]: Host: 10.0.0.210 Apr 19 16:41:21 user devstack@n-api.service[61473]: Openstack-System-Scope: None Apr 19 16:41:21 user devstack@n-api.service[61473]: User-Agent: python-urllib3/1.26.15 Apr 19 16:41:21 user devstack@n-api.service[61473]: X-Auth-Token: gAAAAABkQBe1KSHokT8PQH3k3vnjIt97t532dWuRz8Pml0FOlGyiPoJ_q_-ld3S6cAAgROvvvhUgmEwfCyYUzAgb5BImPOX9fwVjK1KI0GLz312Q5Z2IlqMSmB5SJFoVIfRtPQ9K8GxAdUo5TO_60RdH4gGaVZDRdA94Vol93DCBoXTfp3X86mQ Apr 19 16:41:21 user devstack@n-api.service[61473]: X-Domain-Id: None Apr 19 16:41:21 user devstack@n-api.service[61473]: X-Domain-Name: None Apr 19 16:41:21 user devstack@n-api.service[61473]: X-Identity-Status: Confirmed Apr 19 16:41:21 user devstack@n-api.service[61473]: X-Is-Admin-Project: True Apr 19 16:41:21 user devstack@n-api.service[61473]: X-Project-Domain-Id: default Apr 19 16:41:21 user devstack@n-api.service[61473]: X-Project-Domain-Name: Default Apr 19 16:41:21 user devstack@n-api.service[61473]: X-Project-Id: 821ceccc36de46f780e55a02f25782f4 Apr 19 16:41:21 user devstack@n-api.service[61473]: X-Project-Name: tempest-AttachVolumeNegativeTest-2083894839 Apr 19 16:41:21 user devstack@n-api.service[61473]: X-Role: member,reader Apr 19 16:41:21 user devstack@n-api.service[61473]: X-Roles: member,reader Apr 19 16:41:21 user devstack@n-api.service[61473]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/821ceccc36de46f780e55a02f25782f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/821ceccc36de46f780e55a02f25782f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/821ceccc36de46f780e55a02f25782f4"}]}] Apr 19 16:41:21 user devstack@n-api.service[61473]: X-Tenant: tempest-AttachVolumeNegativeTest-2083894839 Apr 19 16:41:21 user devstack@n-api.service[61473]: X-Tenant-Id: 821ceccc36de46f780e55a02f25782f4 Apr 19 16:41:21 user devstack@n-api.service[61473]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2083894839 Apr 19 16:41:21 user devstack@n-api.service[61473]: X-User: tempest-AttachVolumeNegativeTest-2083894839-project-member Apr 19 16:41:21 user devstack@n-api.service[61473]: X-User-Domain-Id: default Apr 19 16:41:21 user devstack@n-api.service[61473]: X-User-Domain-Name: Default Apr 19 16:41:21 user devstack@n-api.service[61473]: X-User-Id: c2563be52f624ceab060942e8bfcedef Apr 19 16:41:21 user devstack@n-api.service[61473]: X-User-Name: tempest-AttachVolumeNegativeTest-2083894839-project-member Apr 19 16:41:21 user devstack@n-api.service[61473]: method: > Apr 19 16:41:21 user devstack@n-api.service[61473]: exception: Instance 795900b6-2c41-403e-9023-2ee74e755f5e could not be found. Apr 19 16:41:21 user devstack@n-api.service[61473]: action_args: {'id': '795900b6-2c41-403e-9023-2ee74e755f5e'} Apr 19 16:41:21 user devstack@n-api.service[61473]: {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 795900b6-2c41-403e-9023-2ee74e755f5e could not be found. Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 795900b6-2c41-403e-9023-2ee74e755f5e could not be found. Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 795900b6-2c41-403e-9023-2ee74e755f5e could not be found. Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:41:21 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-5c368789-d3e0-4ecf-93ed-cd901f43eb9f tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Returning 404 to user: Instance 795900b6-2c41-403e-9023-2ee74e755f5e could not be found. {{(pid=61473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:41:21 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-5c368789-d3e0-4ecf-93ed-cd901f43eb9f tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/795900b6-2c41-403e-9023-2ee74e755f5e" status: 404 len: 111 microversion: 2.1 time: 0.030853 Apr 19 16:41:21 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 94/277] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 16:41:21 2023] DELETE /compute/v2.1/servers/795900b6-2c41-403e-9023-2ee74e755f5e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 19 16:41:21 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-c70a0d22-7f04-4d11-8d76-e6be47bc70a5 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:41:21 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-c70a0d22-7f04-4d11-8d76-e6be47bc70a5 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] [instance: 795900b6-2c41-403e-9023-2ee74e755f5e] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:41:21 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-c70a0d22-7f04-4d11-8d76-e6be47bc70a5 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:41:21 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-c70a0d22-7f04-4d11-8d76-e6be47bc70a5 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:41:21 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-c70a0d22-7f04-4d11-8d76-e6be47bc70a5 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:41:21 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-c70a0d22-7f04-4d11-8d76-e6be47bc70a5 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:41:21 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-c70a0d22-7f04-4d11-8d76-e6be47bc70a5 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:41:21 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-c70a0d22-7f04-4d11-8d76-e6be47bc70a5 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:41:21 user devstack@n-api.service[61471]: INFO nova.api.openstack.wsgi [None req-c70a0d22-7f04-4d11-8d76-e6be47bc70a5 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] HTTP exception thrown: Instance 795900b6-2c41-403e-9023-2ee74e755f5e could not be found. Apr 19 16:41:21 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-c70a0d22-7f04-4d11-8d76-e6be47bc70a5 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Request method failure captured: Apr 19 16:41:21 user devstack@n-api.service[61471]: request: GET /compute/v2.1/servers/795900b6-2c41-403e-9023-2ee74e755f5e HTTP/1.1 Apr 19 16:41:21 user devstack@n-api.service[61471]: Accept: application/json Apr 19 16:41:21 user devstack@n-api.service[61471]: Accept-Encoding: identity Apr 19 16:41:21 user devstack@n-api.service[61471]: Connection: close Apr 19 16:41:21 user devstack@n-api.service[61471]: Content-Length: 0 Apr 19 16:41:21 user devstack@n-api.service[61471]: Content-Type: application/json Apr 19 16:41:21 user devstack@n-api.service[61471]: Host: 10.0.0.210 Apr 19 16:41:21 user devstack@n-api.service[61471]: Openstack-System-Scope: None Apr 19 16:41:21 user devstack@n-api.service[61471]: User-Agent: python-urllib3/1.26.15 Apr 19 16:41:21 user devstack@n-api.service[61471]: X-Auth-Token: gAAAAABkQBe1KSHokT8PQH3k3vnjIt97t532dWuRz8Pml0FOlGyiPoJ_q_-ld3S6cAAgROvvvhUgmEwfCyYUzAgb5BImPOX9fwVjK1KI0GLz312Q5Z2IlqMSmB5SJFoVIfRtPQ9K8GxAdUo5TO_60RdH4gGaVZDRdA94Vol93DCBoXTfp3X86mQ Apr 19 16:41:21 user devstack@n-api.service[61471]: X-Domain-Id: None Apr 19 16:41:21 user devstack@n-api.service[61471]: X-Domain-Name: None Apr 19 16:41:21 user devstack@n-api.service[61471]: X-Identity-Status: Confirmed Apr 19 16:41:21 user devstack@n-api.service[61471]: X-Is-Admin-Project: True Apr 19 16:41:21 user devstack@n-api.service[61471]: X-Project-Domain-Id: default Apr 19 16:41:21 user devstack@n-api.service[61471]: X-Project-Domain-Name: Default Apr 19 16:41:21 user devstack@n-api.service[61471]: X-Project-Id: 821ceccc36de46f780e55a02f25782f4 Apr 19 16:41:21 user devstack@n-api.service[61471]: X-Project-Name: tempest-AttachVolumeNegativeTest-2083894839 Apr 19 16:41:21 user devstack@n-api.service[61471]: X-Role: member,reader Apr 19 16:41:21 user devstack@n-api.service[61471]: X-Roles: member,reader Apr 19 16:41:21 user devstack@n-api.service[61471]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/821ceccc36de46f780e55a02f25782f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/821ceccc36de46f780e55a02f25782f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/821ceccc36de46f780e55a02f25782f4"}]}] Apr 19 16:41:21 user devstack@n-api.service[61471]: X-Tenant: tempest-AttachVolumeNegativeTest-2083894839 Apr 19 16:41:21 user devstack@n-api.service[61471]: X-Tenant-Id: 821ceccc36de46f780e55a02f25782f4 Apr 19 16:41:21 user devstack@n-api.service[61471]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2083894839 Apr 19 16:41:21 user devstack@n-api.service[61471]: X-User: tempest-AttachVolumeNegativeTest-2083894839-project-member Apr 19 16:41:21 user devstack@n-api.service[61471]: X-User-Domain-Id: default Apr 19 16:41:21 user devstack@n-api.service[61471]: X-User-Domain-Name: Default Apr 19 16:41:21 user devstack@n-api.service[61471]: X-User-Id: c2563be52f624ceab060942e8bfcedef Apr 19 16:41:21 user devstack@n-api.service[61471]: X-User-Name: tempest-AttachVolumeNegativeTest-2083894839-project-member Apr 19 16:41:21 user devstack@n-api.service[61471]: method: > Apr 19 16:41:21 user devstack@n-api.service[61471]: exception: Instance 795900b6-2c41-403e-9023-2ee74e755f5e could not be found. Apr 19 16:41:21 user devstack@n-api.service[61471]: action_args: {'id': '795900b6-2c41-403e-9023-2ee74e755f5e'} Apr 19 16:41:21 user devstack@n-api.service[61471]: {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:41:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:41:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:41:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:41:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:41:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:41:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:41:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:41:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:41:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:41:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 795900b6-2c41-403e-9023-2ee74e755f5e could not be found. Apr 19 16:41:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:41:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:41:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:41:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:41:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:41:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:41:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:41:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:41:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:41:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:41:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 16:41:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 16:41:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:41:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:41:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:41:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:41:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 795900b6-2c41-403e-9023-2ee74e755f5e could not be found. Apr 19 16:41:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:41:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:41:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:41:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:41:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:41:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:41:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:41:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:41:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 795900b6-2c41-403e-9023-2ee74e755f5e could not be found. Apr 19 16:41:21 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:41:21 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-c70a0d22-7f04-4d11-8d76-e6be47bc70a5 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Returning 404 to user: Instance 795900b6-2c41-403e-9023-2ee74e755f5e could not be found. {{(pid=61471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:41:21 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-c70a0d22-7f04-4d11-8d76-e6be47bc70a5 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] 10.0.0.210 "GET /compute/v2.1/servers/795900b6-2c41-403e-9023-2ee74e755f5e" status: 404 len: 111 microversion: 2.1 time: 0.030366 Apr 19 16:41:21 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 94/278] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:41:21 2023] GET /compute/v2.1/servers/795900b6-2c41-403e-9023-2ee74e755f5e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 16:41:21 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-f07bd017-bf8b-4cf2-bb5b-397e162be63d tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:41:21 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-f07bd017-bf8b-4cf2-bb5b-397e162be63d tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] [instance: fbf430be-25fa-4e08-8d5b-08c95b10172a] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:41:21 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-f07bd017-bf8b-4cf2-bb5b-397e162be63d tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:41:21 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-f07bd017-bf8b-4cf2-bb5b-397e162be63d tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:41:21 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-f07bd017-bf8b-4cf2-bb5b-397e162be63d tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:41:21 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-f07bd017-bf8b-4cf2-bb5b-397e162be63d tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:41:21 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-f07bd017-bf8b-4cf2-bb5b-397e162be63d tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:41:21 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-f07bd017-bf8b-4cf2-bb5b-397e162be63d tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:41:21 user devstack@n-api.service[61472]: INFO nova.api.openstack.wsgi [None req-f07bd017-bf8b-4cf2-bb5b-397e162be63d tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] HTTP exception thrown: Instance fbf430be-25fa-4e08-8d5b-08c95b10172a could not be found. Apr 19 16:41:21 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-f07bd017-bf8b-4cf2-bb5b-397e162be63d tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Request method failure captured: Apr 19 16:41:21 user devstack@n-api.service[61472]: request: DELETE /compute/v2.1/servers/fbf430be-25fa-4e08-8d5b-08c95b10172a HTTP/1.1 Apr 19 16:41:21 user devstack@n-api.service[61472]: Accept: application/json Apr 19 16:41:21 user devstack@n-api.service[61472]: Accept-Encoding: identity Apr 19 16:41:21 user devstack@n-api.service[61472]: Connection: close Apr 19 16:41:21 user devstack@n-api.service[61472]: Content-Length: 0 Apr 19 16:41:21 user devstack@n-api.service[61472]: Content-Type: application/json Apr 19 16:41:21 user devstack@n-api.service[61472]: Host: 10.0.0.210 Apr 19 16:41:21 user devstack@n-api.service[61472]: Openstack-System-Scope: None Apr 19 16:41:21 user devstack@n-api.service[61472]: User-Agent: python-urllib3/1.26.15 Apr 19 16:41:21 user devstack@n-api.service[61472]: X-Auth-Token: gAAAAABkQBe1KSHokT8PQH3k3vnjIt97t532dWuRz8Pml0FOlGyiPoJ_q_-ld3S6cAAgROvvvhUgmEwfCyYUzAgb5BImPOX9fwVjK1KI0GLz312Q5Z2IlqMSmB5SJFoVIfRtPQ9K8GxAdUo5TO_60RdH4gGaVZDRdA94Vol93DCBoXTfp3X86mQ Apr 19 16:41:21 user devstack@n-api.service[61472]: X-Domain-Id: None Apr 19 16:41:21 user devstack@n-api.service[61472]: X-Domain-Name: None Apr 19 16:41:21 user devstack@n-api.service[61472]: X-Identity-Status: Confirmed Apr 19 16:41:21 user devstack@n-api.service[61472]: X-Is-Admin-Project: True Apr 19 16:41:21 user devstack@n-api.service[61472]: X-Project-Domain-Id: default Apr 19 16:41:21 user devstack@n-api.service[61472]: X-Project-Domain-Name: Default Apr 19 16:41:21 user devstack@n-api.service[61472]: X-Project-Id: 821ceccc36de46f780e55a02f25782f4 Apr 19 16:41:21 user devstack@n-api.service[61472]: X-Project-Name: tempest-AttachVolumeNegativeTest-2083894839 Apr 19 16:41:21 user devstack@n-api.service[61472]: X-Role: member,reader Apr 19 16:41:21 user devstack@n-api.service[61472]: X-Roles: member,reader Apr 19 16:41:21 user devstack@n-api.service[61472]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/821ceccc36de46f780e55a02f25782f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/821ceccc36de46f780e55a02f25782f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/821ceccc36de46f780e55a02f25782f4"}]}] Apr 19 16:41:21 user devstack@n-api.service[61472]: X-Tenant: tempest-AttachVolumeNegativeTest-2083894839 Apr 19 16:41:21 user devstack@n-api.service[61472]: X-Tenant-Id: 821ceccc36de46f780e55a02f25782f4 Apr 19 16:41:21 user devstack@n-api.service[61472]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2083894839 Apr 19 16:41:21 user devstack@n-api.service[61472]: X-User: tempest-AttachVolumeNegativeTest-2083894839-project-member Apr 19 16:41:21 user devstack@n-api.service[61472]: X-User-Domain-Id: default Apr 19 16:41:21 user devstack@n-api.service[61472]: X-User-Domain-Name: Default Apr 19 16:41:21 user devstack@n-api.service[61472]: X-User-Id: c2563be52f624ceab060942e8bfcedef Apr 19 16:41:21 user devstack@n-api.service[61472]: X-User-Name: tempest-AttachVolumeNegativeTest-2083894839-project-member Apr 19 16:41:21 user devstack@n-api.service[61472]: method: > Apr 19 16:41:21 user devstack@n-api.service[61472]: exception: Instance fbf430be-25fa-4e08-8d5b-08c95b10172a could not be found. Apr 19 16:41:21 user devstack@n-api.service[61472]: action_args: {'id': 'fbf430be-25fa-4e08-8d5b-08c95b10172a'} Apr 19 16:41:21 user devstack@n-api.service[61472]: {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:41:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:41:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:41:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:41:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:41:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:41:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:41:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:41:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:41:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:41:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbf430be-25fa-4e08-8d5b-08c95b10172a could not be found. Apr 19 16:41:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:41:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:41:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:41:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:41:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:41:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:41:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:41:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:41:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:41:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:41:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 19 16:41:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 19 16:41:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 19 16:41:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 19 16:41:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:41:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:41:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:41:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:41:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbf430be-25fa-4e08-8d5b-08c95b10172a could not be found. Apr 19 16:41:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:41:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:41:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:41:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:41:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:41:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:41:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:41:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:41:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbf430be-25fa-4e08-8d5b-08c95b10172a could not be found. Apr 19 16:41:21 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:41:21 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-f07bd017-bf8b-4cf2-bb5b-397e162be63d tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Returning 404 to user: Instance fbf430be-25fa-4e08-8d5b-08c95b10172a could not be found. {{(pid=61472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:41:21 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-f07bd017-bf8b-4cf2-bb5b-397e162be63d tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fbf430be-25fa-4e08-8d5b-08c95b10172a" status: 404 len: 111 microversion: 2.1 time: 0.029265 Apr 19 16:41:21 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 91/279] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 16:41:21 2023] DELETE /compute/v2.1/servers/fbf430be-25fa-4e08-8d5b-08c95b10172a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 16:41:21 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-74a9f080-91ab-4265-bf7a-aba50e6229e9 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:41:21 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-74a9f080-91ab-4265-bf7a-aba50e6229e9 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] [instance: fbf430be-25fa-4e08-8d5b-08c95b10172a] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:41:21 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-74a9f080-91ab-4265-bf7a-aba50e6229e9 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:41:21 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-74a9f080-91ab-4265-bf7a-aba50e6229e9 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:41:21 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-74a9f080-91ab-4265-bf7a-aba50e6229e9 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:41:21 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-74a9f080-91ab-4265-bf7a-aba50e6229e9 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:41:21 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-74a9f080-91ab-4265-bf7a-aba50e6229e9 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:41:21 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-74a9f080-91ab-4265-bf7a-aba50e6229e9 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:41:21 user devstack@n-api.service[61473]: INFO nova.api.openstack.wsgi [None req-74a9f080-91ab-4265-bf7a-aba50e6229e9 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] HTTP exception thrown: Instance fbf430be-25fa-4e08-8d5b-08c95b10172a could not be found. Apr 19 16:41:21 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-74a9f080-91ab-4265-bf7a-aba50e6229e9 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Request method failure captured: Apr 19 16:41:21 user devstack@n-api.service[61473]: request: GET /compute/v2.1/servers/fbf430be-25fa-4e08-8d5b-08c95b10172a HTTP/1.1 Apr 19 16:41:21 user devstack@n-api.service[61473]: Accept: application/json Apr 19 16:41:21 user devstack@n-api.service[61473]: Accept-Encoding: identity Apr 19 16:41:21 user devstack@n-api.service[61473]: Connection: close Apr 19 16:41:21 user devstack@n-api.service[61473]: Content-Length: 0 Apr 19 16:41:21 user devstack@n-api.service[61473]: Content-Type: application/json Apr 19 16:41:21 user devstack@n-api.service[61473]: Host: 10.0.0.210 Apr 19 16:41:21 user devstack@n-api.service[61473]: Openstack-System-Scope: None Apr 19 16:41:21 user devstack@n-api.service[61473]: User-Agent: python-urllib3/1.26.15 Apr 19 16:41:21 user devstack@n-api.service[61473]: X-Auth-Token: gAAAAABkQBe1KSHokT8PQH3k3vnjIt97t532dWuRz8Pml0FOlGyiPoJ_q_-ld3S6cAAgROvvvhUgmEwfCyYUzAgb5BImPOX9fwVjK1KI0GLz312Q5Z2IlqMSmB5SJFoVIfRtPQ9K8GxAdUo5TO_60RdH4gGaVZDRdA94Vol93DCBoXTfp3X86mQ Apr 19 16:41:21 user devstack@n-api.service[61473]: X-Domain-Id: None Apr 19 16:41:21 user devstack@n-api.service[61473]: X-Domain-Name: None Apr 19 16:41:21 user devstack@n-api.service[61473]: X-Identity-Status: Confirmed Apr 19 16:41:21 user devstack@n-api.service[61473]: X-Is-Admin-Project: True Apr 19 16:41:21 user devstack@n-api.service[61473]: X-Project-Domain-Id: default Apr 19 16:41:21 user devstack@n-api.service[61473]: X-Project-Domain-Name: Default Apr 19 16:41:21 user devstack@n-api.service[61473]: X-Project-Id: 821ceccc36de46f780e55a02f25782f4 Apr 19 16:41:21 user devstack@n-api.service[61473]: X-Project-Name: tempest-AttachVolumeNegativeTest-2083894839 Apr 19 16:41:21 user devstack@n-api.service[61473]: X-Role: member,reader Apr 19 16:41:21 user devstack@n-api.service[61473]: X-Roles: member,reader Apr 19 16:41:21 user devstack@n-api.service[61473]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/821ceccc36de46f780e55a02f25782f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/821ceccc36de46f780e55a02f25782f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/821ceccc36de46f780e55a02f25782f4"}]}] Apr 19 16:41:21 user devstack@n-api.service[61473]: X-Tenant: tempest-AttachVolumeNegativeTest-2083894839 Apr 19 16:41:21 user devstack@n-api.service[61473]: X-Tenant-Id: 821ceccc36de46f780e55a02f25782f4 Apr 19 16:41:21 user devstack@n-api.service[61473]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2083894839 Apr 19 16:41:21 user devstack@n-api.service[61473]: X-User: tempest-AttachVolumeNegativeTest-2083894839-project-member Apr 19 16:41:21 user devstack@n-api.service[61473]: X-User-Domain-Id: default Apr 19 16:41:21 user devstack@n-api.service[61473]: X-User-Domain-Name: Default Apr 19 16:41:21 user devstack@n-api.service[61473]: X-User-Id: c2563be52f624ceab060942e8bfcedef Apr 19 16:41:21 user devstack@n-api.service[61473]: X-User-Name: tempest-AttachVolumeNegativeTest-2083894839-project-member Apr 19 16:41:21 user devstack@n-api.service[61473]: method: > Apr 19 16:41:21 user devstack@n-api.service[61473]: exception: Instance fbf430be-25fa-4e08-8d5b-08c95b10172a could not be found. Apr 19 16:41:21 user devstack@n-api.service[61473]: action_args: {'id': 'fbf430be-25fa-4e08-8d5b-08c95b10172a'} Apr 19 16:41:21 user devstack@n-api.service[61473]: {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbf430be-25fa-4e08-8d5b-08c95b10172a could not be found. Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbf430be-25fa-4e08-8d5b-08c95b10172a could not be found. Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbf430be-25fa-4e08-8d5b-08c95b10172a could not be found. Apr 19 16:41:21 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:41:21 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-74a9f080-91ab-4265-bf7a-aba50e6229e9 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] Returning 404 to user: Instance fbf430be-25fa-4e08-8d5b-08c95b10172a could not be found. {{(pid=61473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:41:21 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-74a9f080-91ab-4265-bf7a-aba50e6229e9 tempest-AttachVolumeNegativeTest-2083894839 tempest-AttachVolumeNegativeTest-2083894839-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fbf430be-25fa-4e08-8d5b-08c95b10172a" status: 404 len: 111 microversion: 2.1 time: 0.031144 Apr 19 16:41:21 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 95/280] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:41:21 2023] GET /compute/v2.1/servers/fbf430be-25fa-4e08-8d5b-08c95b10172a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 16:41:25 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-a3e9ce56-33af-4e23-9084-a068e9357fa7 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:41:25 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-a3e9ce56-33af-4e23-9084-a068e9357fa7 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] [instance: 4a07dc78-c9a6-4ebc-bb9f-35f95a18e246] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:41:25 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-a3e9ce56-33af-4e23-9084-a068e9357fa7 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:41:25 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-a3e9ce56-33af-4e23-9084-a068e9357fa7 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:41:25 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-a3e9ce56-33af-4e23-9084-a068e9357fa7 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:41:25 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-a3e9ce56-33af-4e23-9084-a068e9357fa7 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:41:25 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-a3e9ce56-33af-4e23-9084-a068e9357fa7 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:41:25 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-a3e9ce56-33af-4e23-9084-a068e9357fa7 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:41:25 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-a3e9ce56-33af-4e23-9084-a068e9357fa7 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a07dc78-c9a6-4ebc-bb9f-35f95a18e246/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.229103 Apr 19 16:41:25 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 95/281] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 16:41:25 2023] GET /compute/v2.1/servers/4a07dc78-c9a6-4ebc-bb9f-35f95a18e246/os-interface => generated 282 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:41:26 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-15373db6-003c-4d7e-b235-906b9a897570 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:41:26 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-15373db6-003c-4d7e-b235-906b9a897570 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] [instance: 11eee783-802b-438a-bc43-a59b6c33ce63] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:41:26 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-15373db6-003c-4d7e-b235-906b9a897570 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:41:26 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-15373db6-003c-4d7e-b235-906b9a897570 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:41:26 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-15373db6-003c-4d7e-b235-906b9a897570 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:41:26 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-15373db6-003c-4d7e-b235-906b9a897570 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:41:26 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-15373db6-003c-4d7e-b235-906b9a897570 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:41:26 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-15373db6-003c-4d7e-b235-906b9a897570 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:41:26 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-389f11d8-9a6d-45d2-b24f-c292267651f9 req-5cf9a3c3-e9a9-4383-84f3-b32463ab5d94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a07dc78-c9a6-4ebc-bb9f-35f95a18e246", "tag": "f166e883-98a3-48d8-bbdb-a4e1ea17c132"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:41:26 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-389f11d8-9a6d-45d2-b24f-c292267651f9 req-5cf9a3c3-e9a9-4383-84f3-b32463ab5d94 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:41:26 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-389f11d8-9a6d-45d2-b24f-c292267651f9 req-5cf9a3c3-e9a9-4383-84f3-b32463ab5d94 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:41:26 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-389f11d8-9a6d-45d2-b24f-c292267651f9 req-5cf9a3c3-e9a9-4383-84f3-b32463ab5d94 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:41:26 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-389f11d8-9a6d-45d2-b24f-c292267651f9 req-5cf9a3c3-e9a9-4383-84f3-b32463ab5d94 service nova] Creating event network-changed:f166e883-98a3-48d8-bbdb-a4e1ea17c132 for instance 4a07dc78-c9a6-4ebc-bb9f-35f95a18e246 on user Apr 19 16:41:26 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-389f11d8-9a6d-45d2-b24f-c292267651f9 req-5cf9a3c3-e9a9-4383-84f3-b32463ab5d94 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033606 Apr 19 16:41:26 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 96/282] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:41:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:41:26 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-6eea1331-1619-4727-a5e6-9fe602a9401b tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:41:26 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-6eea1331-1619-4727-a5e6-9fe602a9401b tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] [instance: 4a07dc78-c9a6-4ebc-bb9f-35f95a18e246] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:41:26 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-6eea1331-1619-4727-a5e6-9fe602a9401b tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:41:26 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-6eea1331-1619-4727-a5e6-9fe602a9401b tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:41:26 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-6eea1331-1619-4727-a5e6-9fe602a9401b tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:41:26 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-6eea1331-1619-4727-a5e6-9fe602a9401b tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:41:26 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-6eea1331-1619-4727-a5e6-9fe602a9401b tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:41:26 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-6eea1331-1619-4727-a5e6-9fe602a9401b tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:41:26 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-6eea1331-1619-4727-a5e6-9fe602a9401b tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a07dc78-c9a6-4ebc-bb9f-35f95a18e246/ips" status: 200 len: 104 microversion: 2.1 time: 0.050621 Apr 19 16:41:26 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 96/283] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 19 16:41:26 2023] GET /compute/v2.1/servers/4a07dc78-c9a6-4ebc-bb9f-35f95a18e246/ips => generated 104 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:41:26 user devstack@n-api.service[61472]: DEBUG nova.policy [None req-15373db6-003c-4d7e-b235-906b9a897570 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d089267c6a4a1391bb89ae66b49da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a63d3a9c6774bba8f276846597e24ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61472) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:41:26 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-15373db6-003c-4d7e-b235-906b9a897570 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11eee783-802b-438a-bc43-a59b6c33ce63" status: 200 len: 1494 microversion: 2.1 time: 0.262376 Apr 19 16:41:26 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 92/284] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:41:26 2023] GET /compute/v2.1/servers/11eee783-802b-438a-bc43-a59b6c33ce63 => generated 1494 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:41:28 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-d3152658-3de1-4a86-86cf-fe262cd0ba1d tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:41:28 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-d3152658-3de1-4a86-86cf-fe262cd0ba1d tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] [instance: 4a07dc78-c9a6-4ebc-bb9f-35f95a18e246] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:41:28 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-d3152658-3de1-4a86-86cf-fe262cd0ba1d tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:41:28 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-d3152658-3de1-4a86-86cf-fe262cd0ba1d tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:41:28 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-d3152658-3de1-4a86-86cf-fe262cd0ba1d tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:41:28 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-d3152658-3de1-4a86-86cf-fe262cd0ba1d tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:41:28 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-d3152658-3de1-4a86-86cf-fe262cd0ba1d tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:41:28 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-d3152658-3de1-4a86-86cf-fe262cd0ba1d tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:41:28 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-d3152658-3de1-4a86-86cf-fe262cd0ba1d tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] [instance: 4a07dc78-c9a6-4ebc-bb9f-35f95a18e246] Going to try to terminate instance {{(pid=61473) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 16:41:28 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-d3152658-3de1-4a86-86cf-fe262cd0ba1d tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4a07dc78-c9a6-4ebc-bb9f-35f95a18e246" status: 204 len: 0 microversion: 2.1 time: 0.119379 Apr 19 16:41:28 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 97/285] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 16:41:28 2023] DELETE /compute/v2.1/servers/4a07dc78-c9a6-4ebc-bb9f-35f95a18e246 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 16:41:28 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-f5966c59-d769-43d8-b6a1-ba2224d6bd34 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:41:28 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-f5966c59-d769-43d8-b6a1-ba2224d6bd34 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] [instance: 4a07dc78-c9a6-4ebc-bb9f-35f95a18e246] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:41:28 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-f5966c59-d769-43d8-b6a1-ba2224d6bd34 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:41:28 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-f5966c59-d769-43d8-b6a1-ba2224d6bd34 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:41:28 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-f5966c59-d769-43d8-b6a1-ba2224d6bd34 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:41:28 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-f5966c59-d769-43d8-b6a1-ba2224d6bd34 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:41:28 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-f5966c59-d769-43d8-b6a1-ba2224d6bd34 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:41:28 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-f5966c59-d769-43d8-b6a1-ba2224d6bd34 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:41:28 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [req-0c7a20ef-e095-4505-91b4-ae9a4e21baba req-1b5fc8f0-f1e0-469d-958d-e9eb37f422b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a07dc78-c9a6-4ebc-bb9f-35f95a18e246", "name": "network-vif-unplugged", "status": "completed", "tag": "f166e883-98a3-48d8-bbdb-a4e1ea17c132"}]} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:41:28 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-0c7a20ef-e095-4505-91b4-ae9a4e21baba req-1b5fc8f0-f1e0-469d-958d-e9eb37f422b4 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:41:28 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-0c7a20ef-e095-4505-91b4-ae9a4e21baba req-1b5fc8f0-f1e0-469d-958d-e9eb37f422b4 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:41:28 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-0c7a20ef-e095-4505-91b4-ae9a4e21baba req-1b5fc8f0-f1e0-469d-958d-e9eb37f422b4 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:41:28 user devstack@n-api.service[61472]: INFO nova.api.openstack.compute.server_external_events [req-0c7a20ef-e095-4505-91b4-ae9a4e21baba req-1b5fc8f0-f1e0-469d-958d-e9eb37f422b4 service nova] Creating event network-vif-unplugged:f166e883-98a3-48d8-bbdb-a4e1ea17c132 for instance 4a07dc78-c9a6-4ebc-bb9f-35f95a18e246 on user Apr 19 16:41:28 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [req-0c7a20ef-e095-4505-91b4-ae9a4e21baba req-1b5fc8f0-f1e0-469d-958d-e9eb37f422b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035721 Apr 19 16:41:28 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 93/286] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:41:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:41:28 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-f5966c59-d769-43d8-b6a1-ba2224d6bd34 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3934da35244b148d5fa8c56152a1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e6dbe3c46740f3b6d7a0618e076583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:41:28 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-f5966c59-d769-43d8-b6a1-ba2224d6bd34 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a07dc78-c9a6-4ebc-bb9f-35f95a18e246" status: 200 len: 1662 microversion: 2.1 time: 0.303797 Apr 19 16:41:28 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 97/287] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:41:28 2023] GET /compute/v2.1/servers/4a07dc78-c9a6-4ebc-bb9f-35f95a18e246 => generated 1662 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:41:30 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-e9c5279a-6dd0-49b1-8194-91bec3463673 req-a8db267b-adbc-429b-970b-00f2e007cc20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a07dc78-c9a6-4ebc-bb9f-35f95a18e246", "name": "network-vif-deleted", "tag": "f166e883-98a3-48d8-bbdb-a4e1ea17c132"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:41:30 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-e9c5279a-6dd0-49b1-8194-91bec3463673 req-a8db267b-adbc-429b-970b-00f2e007cc20 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:41:30 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-e9c5279a-6dd0-49b1-8194-91bec3463673 req-a8db267b-adbc-429b-970b-00f2e007cc20 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:41:30 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-e9c5279a-6dd0-49b1-8194-91bec3463673 req-a8db267b-adbc-429b-970b-00f2e007cc20 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:41:30 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-e9c5279a-6dd0-49b1-8194-91bec3463673 req-a8db267b-adbc-429b-970b-00f2e007cc20 service nova] Creating event network-vif-deleted:f166e883-98a3-48d8-bbdb-a4e1ea17c132 for instance 4a07dc78-c9a6-4ebc-bb9f-35f95a18e246 on user Apr 19 16:41:30 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-e9c5279a-6dd0-49b1-8194-91bec3463673 req-a8db267b-adbc-429b-970b-00f2e007cc20 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030306 Apr 19 16:41:30 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 98/288] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:41:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:41:30 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [req-cb32c073-3208-46b4-9c02-22659b4f287d req-58cac55f-0354-4c8c-a567-d002769a156f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a07dc78-c9a6-4ebc-bb9f-35f95a18e246", "name": "network-vif-plugged", "status": "completed", "tag": "f166e883-98a3-48d8-bbdb-a4e1ea17c132"}]} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:41:30 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-cb32c073-3208-46b4-9c02-22659b4f287d req-58cac55f-0354-4c8c-a567-d002769a156f service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:41:30 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-cb32c073-3208-46b4-9c02-22659b4f287d req-58cac55f-0354-4c8c-a567-d002769a156f service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:41:30 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-cb32c073-3208-46b4-9c02-22659b4f287d req-58cac55f-0354-4c8c-a567-d002769a156f service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:41:30 user devstack@n-api.service[61472]: INFO nova.api.openstack.compute.server_external_events [req-cb32c073-3208-46b4-9c02-22659b4f287d req-58cac55f-0354-4c8c-a567-d002769a156f service nova] Creating event network-vif-plugged:f166e883-98a3-48d8-bbdb-a4e1ea17c132 for instance 4a07dc78-c9a6-4ebc-bb9f-35f95a18e246 on user Apr 19 16:41:30 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [req-cb32c073-3208-46b4-9c02-22659b4f287d req-58cac55f-0354-4c8c-a567-d002769a156f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034373 Apr 19 16:41:30 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 94/289] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:41:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:41:31 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-d7eb4cb2-017d-4e5b-9de1-ba368b45af93 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:41:31 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-d7eb4cb2-017d-4e5b-9de1-ba368b45af93 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] [instance: 4bca7be9-c7ba-4c5a-9860-bf516f174865] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:41:31 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-d7eb4cb2-017d-4e5b-9de1-ba368b45af93 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:41:31 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-d7eb4cb2-017d-4e5b-9de1-ba368b45af93 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:41:31 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-d7eb4cb2-017d-4e5b-9de1-ba368b45af93 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:41:31 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-d7eb4cb2-017d-4e5b-9de1-ba368b45af93 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:41:31 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-d7eb4cb2-017d-4e5b-9de1-ba368b45af93 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:41:31 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-d7eb4cb2-017d-4e5b-9de1-ba368b45af93 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:41:32 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-d7eb4cb2-017d-4e5b-9de1-ba368b45af93 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f2a02626ca4957823de39c9a31d1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ee4833fd147e2a494be5d7634a2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:41:32 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-d7eb4cb2-017d-4e5b-9de1-ba368b45af93 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63f2a02626ca4957823de39c9a31d1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ee4833fd147e2a494be5d7634a2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:41:32 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-d7eb4cb2-017d-4e5b-9de1-ba368b45af93 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63f2a02626ca4957823de39c9a31d1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ee4833fd147e2a494be5d7634a2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:41:32 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-d7eb4cb2-017d-4e5b-9de1-ba368b45af93 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4bca7be9-c7ba-4c5a-9860-bf516f174865" status: 200 len: 1690 microversion: 2.87 time: 0.291995 Apr 19 16:41:32 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 98/290] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 16:41:31 2023] GET /compute/v2.1/servers/4bca7be9-c7ba-4c5a-9860-bf516f174865 => generated 1690 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 16:41:32 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-79221ec6-74a7-440d-a1f7-8209496e89ef tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-332646708", "imageRef": "ab56c4b1-0117-43b0-84b6-28d06a23f182", "flavorRef": "42", "networks": [{"uuid": "186f3087-0e97-4363-8160-540b93be3de6"}]}} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:41:32 user devstack@n-api.service[61473]: DEBUG nova.network.neutron [None req-79221ec6-74a7-440d-a1f7-8209496e89ef tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] validate_networks() for [('186f3087-0e97-4363-8160-540b93be3de6', None, None, None, None, None)] {{(pid=61473) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 16:41:33 user devstack@n-api.service[61473]: DEBUG nova.virt.hardware [None req-79221ec6-74a7-440d-a1f7-8209496e89ef tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Flavor limits 0:0:0 {{(pid=61473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 16:41:33 user devstack@n-api.service[61473]: DEBUG nova.virt.hardware [None req-79221ec6-74a7-440d-a1f7-8209496e89ef tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Image limits 0:0:0 {{(pid=61473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 16:41:33 user devstack@n-api.service[61473]: DEBUG nova.virt.hardware [None req-79221ec6-74a7-440d-a1f7-8209496e89ef tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Flavor pref 0:0:0 {{(pid=61473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 16:41:33 user devstack@n-api.service[61473]: DEBUG nova.virt.hardware [None req-79221ec6-74a7-440d-a1f7-8209496e89ef tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Image pref 0:0:0 {{(pid=61473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 16:41:33 user devstack@n-api.service[61473]: DEBUG nova.virt.hardware [None req-79221ec6-74a7-440d-a1f7-8209496e89ef tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 16:41:33 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-79221ec6-74a7-440d-a1f7-8209496e89ef tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:41:33 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-79221ec6-74a7-440d-a1f7-8209496e89ef tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:41:33 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-79221ec6-74a7-440d-a1f7-8209496e89ef tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:41:33 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-79221ec6-74a7-440d-a1f7-8209496e89ef tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:41:33 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-79221ec6-74a7-440d-a1f7-8209496e89ef tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:41:33 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-79221ec6-74a7-440d-a1f7-8209496e89ef tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:41:33 user devstack@n-api.service[61473]: DEBUG nova.quota [None req-79221ec6-74a7-440d-a1f7-8209496e89ef tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Getting quotas for project 69b8ca1133fa467f8009125a3fc11583. Resources: {'instances', 'ram', 'cores'} {{(pid=61473) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 16:41:33 user devstack@n-api.service[61473]: DEBUG nova.quota [None req-79221ec6-74a7-440d-a1f7-8209496e89ef tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Getting quotas for user ccab14a59c694c948e9942de0928e095 and project 69b8ca1133fa467f8009125a3fc11583. Resources: {'instances', 'ram', 'cores'} {{(pid=61473) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 16:41:33 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-79221ec6-74a7-440d-a1f7-8209496e89ef tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Going to run 1 instances... {{(pid=61473) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 16:41:33 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-79221ec6-74a7-440d-a1f7-8209496e89ef tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] [instance: adacc1e4-5ebd-4feb-8dcf-84689765bf54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ab56c4b1-0117-43b0-84b6-28d06a23f182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61473) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 16:41:33 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-79221ec6-74a7-440d-a1f7-8209496e89ef tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.972040 Apr 19 16:41:33 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 99/291] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 16:41:32 2023] POST /compute/v2.1/servers => generated 378 bytes in 974 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 16:41:33 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-5c9542b0-0474-4e3a-9f9e-e37b3d3c2d1a tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:41:33 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-5c9542b0-0474-4e3a-9f9e-e37b3d3c2d1a tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] [instance: adacc1e4-5ebd-4feb-8dcf-84689765bf54] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:41:33 user devstack@n-api.service[61472]: DEBUG nova.policy [None req-5c9542b0-0474-4e3a-9f9e-e37b3d3c2d1a tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccab14a59c694c948e9942de0928e095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b8ca1133fa467f8009125a3fc11583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61472) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:41:33 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-5c9542b0-0474-4e3a-9f9e-e37b3d3c2d1a tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] 10.0.0.210 "GET /compute/v2.1/servers/adacc1e4-5ebd-4feb-8dcf-84689765bf54" status: 200 len: 1207 microversion: 2.1 time: 0.065901 Apr 19 16:41:33 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 95/292] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:41:33 2023] GET /compute/v2.1/servers/adacc1e4-5ebd-4feb-8dcf-84689765bf54 => generated 1207 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:41:35 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [req-54ea1e12-ca63-4dbc-8293-469e9ce3548c req-c7247124-40bc-4fda-85a8-89a7e41c566a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adacc1e4-5ebd-4feb-8dcf-84689765bf54", "tag": "107129df-e278-4a6b-9d01-ca0d891d2b0a"}]} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:41:35 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-54ea1e12-ca63-4dbc-8293-469e9ce3548c req-c7247124-40bc-4fda-85a8-89a7e41c566a service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:41:35 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-54ea1e12-ca63-4dbc-8293-469e9ce3548c req-c7247124-40bc-4fda-85a8-89a7e41c566a service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:41:35 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-54ea1e12-ca63-4dbc-8293-469e9ce3548c req-c7247124-40bc-4fda-85a8-89a7e41c566a service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:41:35 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-54ea1e12-ca63-4dbc-8293-469e9ce3548c req-c7247124-40bc-4fda-85a8-89a7e41c566a service nova] Creating event network-changed:107129df-e278-4a6b-9d01-ca0d891d2b0a for instance adacc1e4-5ebd-4feb-8dcf-84689765bf54 on user Apr 19 16:41:35 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [req-54ea1e12-ca63-4dbc-8293-469e9ce3548c req-c7247124-40bc-4fda-85a8-89a7e41c566a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029492 Apr 19 16:41:35 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 99/293] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:41:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:41:36 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-48c8296c-f225-4857-8749-a79a80a43908 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:41:36 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-48c8296c-f225-4857-8749-a79a80a43908 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] [instance: 6b41b6c3-b067-4ae8-9fe2-cbeea18664f5] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:41:36 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-48c8296c-f225-4857-8749-a79a80a43908 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:41:36 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-48c8296c-f225-4857-8749-a79a80a43908 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:41:36 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-48c8296c-f225-4857-8749-a79a80a43908 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:41:36 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-48c8296c-f225-4857-8749-a79a80a43908 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:41:36 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-48c8296c-f225-4857-8749-a79a80a43908 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:41:36 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-48c8296c-f225-4857-8749-a79a80a43908 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:41:36 user devstack@n-api.service[61473]: DEBUG nova.policy [None req-48c8296c-f225-4857-8749-a79a80a43908 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8acfb1eb6149dc962e935451099438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c03f81c174bc89b90e1379b0e358e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61473) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:41:36 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-48c8296c-f225-4857-8749-a79a80a43908 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b41b6c3-b067-4ae8-9fe2-cbeea18664f5" status: 200 len: 1565 microversion: 2.1 time: 0.211491 Apr 19 16:41:36 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 100/294] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:41:36 2023] GET /compute/v2.1/servers/6b41b6c3-b067-4ae8-9fe2-cbeea18664f5 => generated 1565 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:41:37 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-01b81a49-0011-4070-9dd6-540246a1c216 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:41:37 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-01b81a49-0011-4070-9dd6-540246a1c216 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] [instance: 6b41b6c3-b067-4ae8-9fe2-cbeea18664f5] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:41:37 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-01b81a49-0011-4070-9dd6-540246a1c216 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:41:37 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-01b81a49-0011-4070-9dd6-540246a1c216 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:41:37 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-01b81a49-0011-4070-9dd6-540246a1c216 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:41:37 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-01b81a49-0011-4070-9dd6-540246a1c216 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:41:37 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-01b81a49-0011-4070-9dd6-540246a1c216 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:41:37 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-01b81a49-0011-4070-9dd6-540246a1c216 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:41:37 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [req-a5c6a342-17a6-4309-9372-d5310e6f65db req-6dac7fb4-94a4-4406-ad11-e17a0c36a45a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adacc1e4-5ebd-4feb-8dcf-84689765bf54", "name": "network-vif-plugged", "status": "completed", "tag": "107129df-e278-4a6b-9d01-ca0d891d2b0a"}]} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:41:37 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-01b81a49-0011-4070-9dd6-540246a1c216 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] [instance: 6b41b6c3-b067-4ae8-9fe2-cbeea18664f5] Going to try to terminate instance {{(pid=61472) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 16:41:37 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-a5c6a342-17a6-4309-9372-d5310e6f65db req-6dac7fb4-94a4-4406-ad11-e17a0c36a45a service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:41:37 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-a5c6a342-17a6-4309-9372-d5310e6f65db req-6dac7fb4-94a4-4406-ad11-e17a0c36a45a service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:41:37 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-a5c6a342-17a6-4309-9372-d5310e6f65db req-6dac7fb4-94a4-4406-ad11-e17a0c36a45a service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:41:37 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-a5c6a342-17a6-4309-9372-d5310e6f65db req-6dac7fb4-94a4-4406-ad11-e17a0c36a45a service nova] Creating event network-vif-plugged:107129df-e278-4a6b-9d01-ca0d891d2b0a for instance adacc1e4-5ebd-4feb-8dcf-84689765bf54 on user Apr 19 16:41:37 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [req-a5c6a342-17a6-4309-9372-d5310e6f65db req-6dac7fb4-94a4-4406-ad11-e17a0c36a45a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029893 Apr 19 16:41:37 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 100/295] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:41:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:41:38 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-01b81a49-0011-4070-9dd6-540246a1c216 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6b41b6c3-b067-4ae8-9fe2-cbeea18664f5" status: 204 len: 0 microversion: 2.1 time: 0.122729 Apr 19 16:41:38 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 96/296] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 16:41:37 2023] DELETE /compute/v2.1/servers/6b41b6c3-b067-4ae8-9fe2-cbeea18664f5 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 16:41:38 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-593a2e39-420c-465b-8db6-5fd2365cdd6e tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:41:38 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-593a2e39-420c-465b-8db6-5fd2365cdd6e tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] [instance: 6b41b6c3-b067-4ae8-9fe2-cbeea18664f5] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:41:38 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-593a2e39-420c-465b-8db6-5fd2365cdd6e tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:41:38 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-593a2e39-420c-465b-8db6-5fd2365cdd6e tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:41:38 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-593a2e39-420c-465b-8db6-5fd2365cdd6e tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:41:38 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-593a2e39-420c-465b-8db6-5fd2365cdd6e tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:41:38 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-593a2e39-420c-465b-8db6-5fd2365cdd6e tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:41:38 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-593a2e39-420c-465b-8db6-5fd2365cdd6e tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:41:38 user devstack@n-api.service[61473]: DEBUG nova.policy [None req-593a2e39-420c-465b-8db6-5fd2365cdd6e tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8acfb1eb6149dc962e935451099438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c03f81c174bc89b90e1379b0e358e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61473) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:41:38 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-593a2e39-420c-465b-8db6-5fd2365cdd6e tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b41b6c3-b067-4ae8-9fe2-cbeea18664f5" status: 200 len: 1571 microversion: 2.1 time: 0.261741 Apr 19 16:41:38 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 101/297] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:41:38 2023] GET /compute/v2.1/servers/6b41b6c3-b067-4ae8-9fe2-cbeea18664f5 => generated 1571 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:41:38 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [req-8c462e2e-d00d-4fda-9e16-e65f5dd9c1e1 req-97f3f55f-da0e-4899-855d-6d76314f38fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b41b6c3-b067-4ae8-9fe2-cbeea18664f5", "name": "network-vif-unplugged", "status": "completed", "tag": "aa14ebe4-9d19-434f-9440-a5e1afe183a1"}]} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:41:38 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-8c462e2e-d00d-4fda-9e16-e65f5dd9c1e1 req-97f3f55f-da0e-4899-855d-6d76314f38fe service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:41:38 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-8c462e2e-d00d-4fda-9e16-e65f5dd9c1e1 req-97f3f55f-da0e-4899-855d-6d76314f38fe service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:41:38 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-8c462e2e-d00d-4fda-9e16-e65f5dd9c1e1 req-97f3f55f-da0e-4899-855d-6d76314f38fe service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:41:38 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-8c462e2e-d00d-4fda-9e16-e65f5dd9c1e1 req-97f3f55f-da0e-4899-855d-6d76314f38fe service nova] Creating event network-vif-unplugged:aa14ebe4-9d19-434f-9440-a5e1afe183a1 for instance 6b41b6c3-b067-4ae8-9fe2-cbeea18664f5 on user Apr 19 16:41:38 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [req-8c462e2e-d00d-4fda-9e16-e65f5dd9c1e1 req-97f3f55f-da0e-4899-855d-6d76314f38fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029345 Apr 19 16:41:38 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 101/298] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:41:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:41:39 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [req-5e34f596-68c9-4036-bfe5-bd72326477fe req-a00b5f40-cf92-4bc9-bd21-1ed1db342c1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b41b6c3-b067-4ae8-9fe2-cbeea18664f5", "name": "network-vif-deleted", "tag": "aa14ebe4-9d19-434f-9440-a5e1afe183a1"}]} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:41:39 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-5e34f596-68c9-4036-bfe5-bd72326477fe req-a00b5f40-cf92-4bc9-bd21-1ed1db342c1e service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:41:39 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-5e34f596-68c9-4036-bfe5-bd72326477fe req-a00b5f40-cf92-4bc9-bd21-1ed1db342c1e service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:41:39 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-5e34f596-68c9-4036-bfe5-bd72326477fe req-a00b5f40-cf92-4bc9-bd21-1ed1db342c1e service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:41:39 user devstack@n-api.service[61472]: INFO nova.api.openstack.compute.server_external_events [req-5e34f596-68c9-4036-bfe5-bd72326477fe req-a00b5f40-cf92-4bc9-bd21-1ed1db342c1e service nova] Creating event network-vif-deleted:aa14ebe4-9d19-434f-9440-a5e1afe183a1 for instance 6b41b6c3-b067-4ae8-9fe2-cbeea18664f5 on user Apr 19 16:41:39 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [req-5e34f596-68c9-4036-bfe5-bd72326477fe req-a00b5f40-cf92-4bc9-bd21-1ed1db342c1e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053111 Apr 19 16:41:39 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 97/299] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:41:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:41:39 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-d90a9364-9cb9-465c-ab19-f3e6c936fd33 req-433891fa-fb14-47ca-a922-be8d3fcc6e7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adacc1e4-5ebd-4feb-8dcf-84689765bf54", "name": "network-vif-plugged", "status": "completed", "tag": "107129df-e278-4a6b-9d01-ca0d891d2b0a"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:41:39 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-d90a9364-9cb9-465c-ab19-f3e6c936fd33 req-433891fa-fb14-47ca-a922-be8d3fcc6e7e service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:41:39 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-d90a9364-9cb9-465c-ab19-f3e6c936fd33 req-433891fa-fb14-47ca-a922-be8d3fcc6e7e service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:41:39 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-d90a9364-9cb9-465c-ab19-f3e6c936fd33 req-433891fa-fb14-47ca-a922-be8d3fcc6e7e service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:41:39 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-d90a9364-9cb9-465c-ab19-f3e6c936fd33 req-433891fa-fb14-47ca-a922-be8d3fcc6e7e service nova] Creating event network-vif-plugged:107129df-e278-4a6b-9d01-ca0d891d2b0a for instance adacc1e4-5ebd-4feb-8dcf-84689765bf54 on user Apr 19 16:41:40 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-d90a9364-9cb9-465c-ab19-f3e6c936fd33 req-433891fa-fb14-47ca-a922-be8d3fcc6e7e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030697 Apr 19 16:41:40 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 102/300] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:41:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:41:40 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-dbe681d0-cff9-4dfb-8788-eb1150c84dc1 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:41:40 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-dbe681d0-cff9-4dfb-8788-eb1150c84dc1 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] [instance: edd2688e-940e-4ab3-b27c-b6d4aab3efc5] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:41:40 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-dbe681d0-cff9-4dfb-8788-eb1150c84dc1 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:41:40 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-dbe681d0-cff9-4dfb-8788-eb1150c84dc1 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:41:40 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-dbe681d0-cff9-4dfb-8788-eb1150c84dc1 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:41:40 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-dbe681d0-cff9-4dfb-8788-eb1150c84dc1 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:41:40 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-dbe681d0-cff9-4dfb-8788-eb1150c84dc1 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:41:40 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-dbe681d0-cff9-4dfb-8788-eb1150c84dc1 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:41:40 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [req-4bece8cd-301a-48e5-9827-e528764bde72 req-b1401e06-587a-4447-bc09-8035dae2c577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b41b6c3-b067-4ae8-9fe2-cbeea18664f5", "name": "network-vif-plugged", "status": "completed", "tag": "aa14ebe4-9d19-434f-9440-a5e1afe183a1"}]} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:41:40 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-4bece8cd-301a-48e5-9827-e528764bde72 req-b1401e06-587a-4447-bc09-8035dae2c577 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:41:40 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-4bece8cd-301a-48e5-9827-e528764bde72 req-b1401e06-587a-4447-bc09-8035dae2c577 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:41:40 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-4bece8cd-301a-48e5-9827-e528764bde72 req-b1401e06-587a-4447-bc09-8035dae2c577 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:41:40 user devstack@n-api.service[61472]: INFO nova.api.openstack.compute.server_external_events [req-4bece8cd-301a-48e5-9827-e528764bde72 req-b1401e06-587a-4447-bc09-8035dae2c577 service nova] Creating event network-vif-plugged:aa14ebe4-9d19-434f-9440-a5e1afe183a1 for instance 6b41b6c3-b067-4ae8-9fe2-cbeea18664f5 on user Apr 19 16:41:40 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [req-4bece8cd-301a-48e5-9827-e528764bde72 req-b1401e06-587a-4447-bc09-8035dae2c577 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031538 Apr 19 16:41:40 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 98/301] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:41:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:41:40 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-dbe681d0-cff9-4dfb-8788-eb1150c84dc1 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023314f8cf79430b83c5184d9a54be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78962d13860a4df3a8aa100e2afaca6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:41:40 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-dbe681d0-cff9-4dfb-8788-eb1150c84dc1 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] 10.0.0.210 "GET /compute/v2.1/servers/edd2688e-940e-4ab3-b27c-b6d4aab3efc5" status: 200 len: 1659 microversion: 2.1 time: 0.259410 Apr 19 16:41:40 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 102/302] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:41:40 2023] GET /compute/v2.1/servers/edd2688e-940e-4ab3-b27c-b6d4aab3efc5 => generated 1659 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:42:18 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell0:SELECT=2 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:42:18 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell0:SELECT=6 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:42:18 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:42:18 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:42:18 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-0fb03b61-e71f-4da7-a138-372bb007313c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:42:18 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-0fb03b61-e71f-4da7-a138-372bb007313c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] [instance: 4a07dc78-c9a6-4ebc-bb9f-35f95a18e246] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:42:18 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-0fb03b61-e71f-4da7-a138-372bb007313c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:42:18 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-0fb03b61-e71f-4da7-a138-372bb007313c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:42:18 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-0fb03b61-e71f-4da7-a138-372bb007313c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:42:18 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-0fb03b61-e71f-4da7-a138-372bb007313c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:42:18 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-0fb03b61-e71f-4da7-a138-372bb007313c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:42:18 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-0fb03b61-e71f-4da7-a138-372bb007313c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:42:18 user devstack@n-api.service[61473]: INFO nova.api.openstack.wsgi [None req-0fb03b61-e71f-4da7-a138-372bb007313c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] HTTP exception thrown: Instance 4a07dc78-c9a6-4ebc-bb9f-35f95a18e246 could not be found. Apr 19 16:42:18 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-0fb03b61-e71f-4da7-a138-372bb007313c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Request method failure captured: Apr 19 16:42:18 user devstack@n-api.service[61473]: request: GET /compute/v2.1/servers/4a07dc78-c9a6-4ebc-bb9f-35f95a18e246 HTTP/1.1 Apr 19 16:42:18 user devstack@n-api.service[61473]: Accept: application/json Apr 19 16:42:18 user devstack@n-api.service[61473]: Accept-Encoding: identity Apr 19 16:42:18 user devstack@n-api.service[61473]: Connection: close Apr 19 16:42:18 user devstack@n-api.service[61473]: Content-Length: 0 Apr 19 16:42:18 user devstack@n-api.service[61473]: Content-Type: application/json Apr 19 16:42:18 user devstack@n-api.service[61473]: Host: 10.0.0.210 Apr 19 16:42:18 user devstack@n-api.service[61473]: Openstack-System-Scope: None Apr 19 16:42:18 user devstack@n-api.service[61473]: User-Agent: python-urllib3/1.26.15 Apr 19 16:42:18 user devstack@n-api.service[61473]: X-Auth-Token: gAAAAABkQBlDbykaiytEqM6n7azX05ezt87urFSIm2ijRuhoI5U43XuhEECWvLvB6QQEmCwFG3X1VWTVQ5rbsfRlViRz5jOx6aGCSmV9wbSuJSepzPDJPe4E6QZQXbarJ6eQ6J-5LNt-9A82PF6l1yXXDhIlRcYybDExHkVoYjJYXalAWYgU29A Apr 19 16:42:18 user devstack@n-api.service[61473]: X-Domain-Id: None Apr 19 16:42:18 user devstack@n-api.service[61473]: X-Domain-Name: None Apr 19 16:42:18 user devstack@n-api.service[61473]: X-Identity-Status: Confirmed Apr 19 16:42:18 user devstack@n-api.service[61473]: X-Is-Admin-Project: True Apr 19 16:42:18 user devstack@n-api.service[61473]: X-Project-Domain-Id: default Apr 19 16:42:18 user devstack@n-api.service[61473]: X-Project-Domain-Name: Default Apr 19 16:42:18 user devstack@n-api.service[61473]: X-Project-Id: b5e6dbe3c46740f3b6d7a0618e076583 Apr 19 16:42:18 user devstack@n-api.service[61473]: X-Project-Name: tempest-AttachVolumeTestJSON-1317079953 Apr 19 16:42:18 user devstack@n-api.service[61473]: X-Role: member,reader Apr 19 16:42:18 user devstack@n-api.service[61473]: X-Roles: member,reader Apr 19 16:42:18 user devstack@n-api.service[61473]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b5e6dbe3c46740f3b6d7a0618e076583"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b5e6dbe3c46740f3b6d7a0618e076583"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b5e6dbe3c46740f3b6d7a0618e076583"}]}] Apr 19 16:42:18 user devstack@n-api.service[61473]: X-Tenant: tempest-AttachVolumeTestJSON-1317079953 Apr 19 16:42:18 user devstack@n-api.service[61473]: X-Tenant-Id: b5e6dbe3c46740f3b6d7a0618e076583 Apr 19 16:42:18 user devstack@n-api.service[61473]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1317079953 Apr 19 16:42:18 user devstack@n-api.service[61473]: X-User: tempest-AttachVolumeTestJSON-1317079953-project-member Apr 19 16:42:18 user devstack@n-api.service[61473]: X-User-Domain-Id: default Apr 19 16:42:18 user devstack@n-api.service[61473]: X-User-Domain-Name: Default Apr 19 16:42:18 user devstack@n-api.service[61473]: X-User-Id: ce3934da35244b148d5fa8c56152a1f0 Apr 19 16:42:18 user devstack@n-api.service[61473]: X-User-Name: tempest-AttachVolumeTestJSON-1317079953-project-member Apr 19 16:42:18 user devstack@n-api.service[61473]: method: > Apr 19 16:42:18 user devstack@n-api.service[61473]: exception: Instance 4a07dc78-c9a6-4ebc-bb9f-35f95a18e246 could not be found. Apr 19 16:42:18 user devstack@n-api.service[61473]: action_args: {'id': '4a07dc78-c9a6-4ebc-bb9f-35f95a18e246'} Apr 19 16:42:18 user devstack@n-api.service[61473]: {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:42:18 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:42:18 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:42:18 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:42:18 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:42:18 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:42:18 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:42:18 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:42:18 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:42:18 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:42:18 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a07dc78-c9a6-4ebc-bb9f-35f95a18e246 could not be found. Apr 19 16:42:18 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:42:18 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:42:18 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:42:18 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:42:18 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:42:18 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:42:18 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:42:18 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:42:18 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:42:18 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:42:18 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 16:42:18 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 16:42:18 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:42:18 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:42:18 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:42:18 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:42:18 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a07dc78-c9a6-4ebc-bb9f-35f95a18e246 could not be found. Apr 19 16:42:18 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:42:18 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:42:18 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:42:18 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:42:18 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:42:18 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:42:18 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:42:18 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:42:18 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a07dc78-c9a6-4ebc-bb9f-35f95a18e246 could not be found. Apr 19 16:42:18 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:42:18 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-0fb03b61-e71f-4da7-a138-372bb007313c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Returning 404 to user: Instance 4a07dc78-c9a6-4ebc-bb9f-35f95a18e246 could not be found. {{(pid=61473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:42:18 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-0fb03b61-e71f-4da7-a138-372bb007313c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a07dc78-c9a6-4ebc-bb9f-35f95a18e246" status: 404 len: 111 microversion: 2.1 time: 0.039404 Apr 19 16:42:18 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 103/303] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:42:18 2023] GET /compute/v2.1/servers/4a07dc78-c9a6-4ebc-bb9f-35f95a18e246 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 16:42:18 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell0:SELECT=2 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:42:18 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:42:18 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:42:18 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-8513cc43-8757-4f07-b4da-8f292fc53986 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Calling method '.version_select at 0x7fd49710e9e0>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:42:18 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-8513cc43-8757-4f07-b4da-8f292fc53986 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1274492496" status: 202 len: 0 microversion: 2.1 time: 0.034215 Apr 19 16:42:18 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 99/304] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 19 16:42:18 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1274492496 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 16:42:19 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_api:SELECT=22 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:42:19 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell1:SELECT=36 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:42:19 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-1fed1e4c-b640-4859-9540-34ada62bd1d4 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Action: 'create', calling method: .version_select at 0x7fd4970c65f0>, body: {"keypair": {"name": "tempest-keypair-585730018", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGv5YoXgJJVi7ccVc6EJvusy1zOestSoHi83IxRDV6Ej2NHZCyGgPF74opr4pFpTRtIcq556+cZ8g0o/V6u4IpoXLIuYe2l+COO8PGTNtqyiheiR0Iuw7RUQj7mrp3zZQ=="}} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:42:19 user devstack@n-api.service[61471]: DEBUG nova.quota [None req-1fed1e4c-b640-4859-9540-34ada62bd1d4 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Getting quotas for project b5e6dbe3c46740f3b6d7a0618e076583. Resources: {'key_pairs'} {{(pid=61471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 16:42:19 user devstack@n-api.service[61471]: DEBUG nova.quota [None req-1fed1e4c-b640-4859-9540-34ada62bd1d4 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Getting quotas for user ce3934da35244b148d5fa8c56152a1f0 and project b5e6dbe3c46740f3b6d7a0618e076583. Resources: {'key_pairs'} {{(pid=61471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 16:42:19 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-1fed1e4c-b640-4859-9540-34ada62bd1d4 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051176 Apr 19 16:42:19 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 103/305] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 16:42:19 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:42:21 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-6f020003-a91c-4bc2-8322-5104d6f5cf7c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-401590157", "imageRef": "ab56c4b1-0117-43b0-84b6-28d06a23f182", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "a052dcab-b2be-42a7-aed2-c03db95d21b0"}], "security_groups": [{"name": "tempest-securitygroup--1812590830"}], "key_name": "tempest-keypair-585730018", "user_data": "}} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:42:21 user devstack@n-api.service[61473]: DEBUG nova.network.neutron [None req-6f020003-a91c-4bc2-8322-5104d6f5cf7c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] validate_networks() for [('a052dcab-b2be-42a7-aed2-c03db95d21b0', None, None, None, None, None)] {{(pid=61473) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 16:42:21 user devstack@n-api.service[61473]: DEBUG nova.virt.hardware [None req-6f020003-a91c-4bc2-8322-5104d6f5cf7c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Flavor limits 0:0:0 {{(pid=61473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 16:42:21 user devstack@n-api.service[61473]: DEBUG nova.virt.hardware [None req-6f020003-a91c-4bc2-8322-5104d6f5cf7c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Image limits 0:0:0 {{(pid=61473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 16:42:21 user devstack@n-api.service[61473]: DEBUG nova.virt.hardware [None req-6f020003-a91c-4bc2-8322-5104d6f5cf7c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Flavor pref 0:0:0 {{(pid=61473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 16:42:21 user devstack@n-api.service[61473]: DEBUG nova.virt.hardware [None req-6f020003-a91c-4bc2-8322-5104d6f5cf7c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Image pref 0:0:0 {{(pid=61473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 16:42:21 user devstack@n-api.service[61473]: DEBUG nova.virt.hardware [None req-6f020003-a91c-4bc2-8322-5104d6f5cf7c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 16:42:21 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-6f020003-a91c-4bc2-8322-5104d6f5cf7c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:42:21 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-6f020003-a91c-4bc2-8322-5104d6f5cf7c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:42:21 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-6f020003-a91c-4bc2-8322-5104d6f5cf7c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:42:21 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-6f020003-a91c-4bc2-8322-5104d6f5cf7c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:42:21 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-6f020003-a91c-4bc2-8322-5104d6f5cf7c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:42:21 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-6f020003-a91c-4bc2-8322-5104d6f5cf7c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:42:21 user devstack@n-api.service[61473]: DEBUG nova.quota [None req-6f020003-a91c-4bc2-8322-5104d6f5cf7c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Getting quotas for project b5e6dbe3c46740f3b6d7a0618e076583. Resources: {'instances', 'ram', 'cores'} {{(pid=61473) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 16:42:21 user devstack@n-api.service[61473]: DEBUG nova.quota [None req-6f020003-a91c-4bc2-8322-5104d6f5cf7c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Getting quotas for user ce3934da35244b148d5fa8c56152a1f0 and project b5e6dbe3c46740f3b6d7a0618e076583. Resources: {'instances', 'ram', 'cores'} {{(pid=61473) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 16:42:21 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-6f020003-a91c-4bc2-8322-5104d6f5cf7c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Going to run 1 instances... {{(pid=61473) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 16:42:21 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-6f020003-a91c-4bc2-8322-5104d6f5cf7c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] [instance: 180bfabe-bb88-4d49-98ed-be76df93d4e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ab56c4b1-0117-43b0-84b6-28d06a23f182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61473) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 16:42:21 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-6f020003-a91c-4bc2-8322-5104d6f5cf7c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.638803 Apr 19 16:42:21 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 104/306] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 16:42:21 2023] POST /compute/v2.1/servers => generated 400 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 16:42:21 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-8f3a3de6-dda2-4f59-890f-b8813b97462f tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:42:21 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-8f3a3de6-dda2-4f59-890f-b8813b97462f tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] [instance: 180bfabe-bb88-4d49-98ed-be76df93d4e1] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:42:21 user devstack@n-api.service[61472]: DEBUG nova.policy [None req-8f3a3de6-dda2-4f59-890f-b8813b97462f tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3934da35244b148d5fa8c56152a1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e6dbe3c46740f3b6d7a0618e076583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61472) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:42:21 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-8f3a3de6-dda2-4f59-890f-b8813b97462f tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/180bfabe-bb88-4d49-98ed-be76df93d4e1" status: 200 len: 1230 microversion: 2.1 time: 0.070333 Apr 19 16:42:21 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 100/307] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:42:21 2023] GET /compute/v2.1/servers/180bfabe-bb88-4d49-98ed-be76df93d4e1 => generated 1230 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:42:23 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-5b0a7865-42e3-45f3-a1a0-9bbfd03586d7 tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:42:23 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-5b0a7865-42e3-45f3-a1a0-9bbfd03586d7 tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] [instance: adacc1e4-5ebd-4feb-8dcf-84689765bf54] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:42:23 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-5b0a7865-42e3-45f3-a1a0-9bbfd03586d7 tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:42:23 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-5b0a7865-42e3-45f3-a1a0-9bbfd03586d7 tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:42:23 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-5b0a7865-42e3-45f3-a1a0-9bbfd03586d7 tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:42:23 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-5b0a7865-42e3-45f3-a1a0-9bbfd03586d7 tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:42:23 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-5b0a7865-42e3-45f3-a1a0-9bbfd03586d7 tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:42:23 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-5b0a7865-42e3-45f3-a1a0-9bbfd03586d7 tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:42:24 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-5b0a7865-42e3-45f3-a1a0-9bbfd03586d7 tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccab14a59c694c948e9942de0928e095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b8ca1133fa467f8009125a3fc11583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:42:24 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-5b0a7865-42e3-45f3-a1a0-9bbfd03586d7 tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] 10.0.0.210 "GET /compute/v2.1/servers/adacc1e4-5ebd-4feb-8dcf-84689765bf54" status: 200 len: 1484 microversion: 2.1 time: 0.408787 Apr 19 16:42:24 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 104/308] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:42:23 2023] GET /compute/v2.1/servers/adacc1e4-5ebd-4feb-8dcf-84689765bf54 => generated 1484 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:42:24 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-966360e8-f8fb-479a-bb66-e163bd4491dd req-9b0401f3-d7f3-479b-8bee-af9e45db3b3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "180bfabe-bb88-4d49-98ed-be76df93d4e1", "tag": "0b670fd3-432a-4381-8275-1cb632b18aaa"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:42:24 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-966360e8-f8fb-479a-bb66-e163bd4491dd req-9b0401f3-d7f3-479b-8bee-af9e45db3b3f service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:42:24 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-966360e8-f8fb-479a-bb66-e163bd4491dd req-9b0401f3-d7f3-479b-8bee-af9e45db3b3f service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:42:24 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-966360e8-f8fb-479a-bb66-e163bd4491dd req-9b0401f3-d7f3-479b-8bee-af9e45db3b3f service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:42:24 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-966360e8-f8fb-479a-bb66-e163bd4491dd req-9b0401f3-d7f3-479b-8bee-af9e45db3b3f service nova] Creating event network-changed:0b670fd3-432a-4381-8275-1cb632b18aaa for instance 180bfabe-bb88-4d49-98ed-be76df93d4e1 on user Apr 19 16:42:24 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-966360e8-f8fb-479a-bb66-e163bd4491dd req-9b0401f3-d7f3-479b-8bee-af9e45db3b3f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029395 Apr 19 16:42:24 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 105/309] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:42:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:42:26 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [req-c2d6be8b-6101-410d-90cb-075c57c7cebb req-56bf78d7-5759-4ace-8691-c40c53828918 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "180bfabe-bb88-4d49-98ed-be76df93d4e1", "name": "network-vif-plugged", "status": "completed", "tag": "0b670fd3-432a-4381-8275-1cb632b18aaa"}]} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:42:26 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-c2d6be8b-6101-410d-90cb-075c57c7cebb req-56bf78d7-5759-4ace-8691-c40c53828918 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:42:26 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-c2d6be8b-6101-410d-90cb-075c57c7cebb req-56bf78d7-5759-4ace-8691-c40c53828918 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:42:26 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-c2d6be8b-6101-410d-90cb-075c57c7cebb req-56bf78d7-5759-4ace-8691-c40c53828918 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:42:26 user devstack@n-api.service[61472]: INFO nova.api.openstack.compute.server_external_events [req-c2d6be8b-6101-410d-90cb-075c57c7cebb req-56bf78d7-5759-4ace-8691-c40c53828918 service nova] Creating event network-vif-plugged:0b670fd3-432a-4381-8275-1cb632b18aaa for instance 180bfabe-bb88-4d49-98ed-be76df93d4e1 on user Apr 19 16:42:26 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [req-c2d6be8b-6101-410d-90cb-075c57c7cebb req-56bf78d7-5759-4ace-8691-c40c53828918 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046184 Apr 19 16:42:26 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 101/310] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:42:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:42:27 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-c92a6213-bccb-4f47-907f-1b29e21d9f42 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:42:27 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-c92a6213-bccb-4f47-907f-1b29e21d9f42 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] [instance: 7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:42:27 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-c92a6213-bccb-4f47-907f-1b29e21d9f42 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:42:27 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-c92a6213-bccb-4f47-907f-1b29e21d9f42 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:42:27 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-c92a6213-bccb-4f47-907f-1b29e21d9f42 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:42:27 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-c92a6213-bccb-4f47-907f-1b29e21d9f42 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:42:27 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-c92a6213-bccb-4f47-907f-1b29e21d9f42 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:42:27 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-c92a6213-bccb-4f47-907f-1b29e21d9f42 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:42:27 user devstack@n-api.service[61471]: INFO nova.api.openstack.wsgi [None req-c92a6213-bccb-4f47-907f-1b29e21d9f42 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] HTTP exception thrown: Instance 7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18 could not be found. Apr 19 16:42:27 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-c92a6213-bccb-4f47-907f-1b29e21d9f42 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Request method failure captured: Apr 19 16:42:27 user devstack@n-api.service[61471]: request: DELETE /compute/v2.1/servers/7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18 HTTP/1.1 Apr 19 16:42:27 user devstack@n-api.service[61471]: Accept: application/json Apr 19 16:42:27 user devstack@n-api.service[61471]: Accept-Encoding: identity Apr 19 16:42:27 user devstack@n-api.service[61471]: Connection: close Apr 19 16:42:27 user devstack@n-api.service[61471]: Content-Length: 0 Apr 19 16:42:27 user devstack@n-api.service[61471]: Content-Type: application/json Apr 19 16:42:27 user devstack@n-api.service[61471]: Host: 10.0.0.210 Apr 19 16:42:27 user devstack@n-api.service[61471]: Openstack-System-Scope: None Apr 19 16:42:27 user devstack@n-api.service[61471]: User-Agent: python-urllib3/1.26.15 Apr 19 16:42:27 user devstack@n-api.service[61471]: X-Auth-Token: gAAAAABkQBft97Lb8vXwWY10e1qffFSo9pCiKV_nxukKPY9LMmdZSFBRwKuoOKIxCFrqpqDeRzdcPSEDj68b-o5l31Z4_eRDXw1gJEuFqqj2Tw860aOgd5ZQADEQT3q0cIaqtXe8wGfwGxbcOzsvtQA5rYII5DcCVXxTcc7A5yhZxtXMgTKih84 Apr 19 16:42:27 user devstack@n-api.service[61471]: X-Domain-Id: None Apr 19 16:42:27 user devstack@n-api.service[61471]: X-Domain-Name: None Apr 19 16:42:27 user devstack@n-api.service[61471]: X-Identity-Status: Confirmed Apr 19 16:42:27 user devstack@n-api.service[61471]: X-Is-Admin-Project: True Apr 19 16:42:27 user devstack@n-api.service[61471]: X-Project-Domain-Id: default Apr 19 16:42:27 user devstack@n-api.service[61471]: X-Project-Domain-Name: Default Apr 19 16:42:27 user devstack@n-api.service[61471]: X-Project-Id: 3a63d3a9c6774bba8f276846597e24ca Apr 19 16:42:27 user devstack@n-api.service[61471]: X-Project-Name: tempest-ServersNegativeTestJSON-415326023 Apr 19 16:42:27 user devstack@n-api.service[61471]: X-Role: member,reader Apr 19 16:42:27 user devstack@n-api.service[61471]: X-Roles: member,reader Apr 19 16:42:27 user devstack@n-api.service[61471]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3a63d3a9c6774bba8f276846597e24ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3a63d3a9c6774bba8f276846597e24ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3a63d3a9c6774bba8f276846597e24ca"}]}] Apr 19 16:42:27 user devstack@n-api.service[61471]: X-Tenant: tempest-ServersNegativeTestJSON-415326023 Apr 19 16:42:27 user devstack@n-api.service[61471]: X-Tenant-Id: 3a63d3a9c6774bba8f276846597e24ca Apr 19 16:42:27 user devstack@n-api.service[61471]: X-Tenant-Name: tempest-ServersNegativeTestJSON-415326023 Apr 19 16:42:27 user devstack@n-api.service[61471]: X-User: tempest-ServersNegativeTestJSON-415326023-project-member Apr 19 16:42:27 user devstack@n-api.service[61471]: X-User-Domain-Id: default Apr 19 16:42:27 user devstack@n-api.service[61471]: X-User-Domain-Name: Default Apr 19 16:42:27 user devstack@n-api.service[61471]: X-User-Id: 25d089267c6a4a1391bb89ae66b49da7 Apr 19 16:42:27 user devstack@n-api.service[61471]: X-User-Name: tempest-ServersNegativeTestJSON-415326023-project-member Apr 19 16:42:27 user devstack@n-api.service[61471]: method: > Apr 19 16:42:27 user devstack@n-api.service[61471]: exception: Instance 7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18 could not be found. Apr 19 16:42:27 user devstack@n-api.service[61471]: action_args: {'id': '7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18'} Apr 19 16:42:27 user devstack@n-api.service[61471]: {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:42:27 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:42:27 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:42:27 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:42:27 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:42:27 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:42:27 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:42:27 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:42:27 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:42:27 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:42:27 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18 could not be found. Apr 19 16:42:27 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:42:27 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:42:27 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:42:27 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:42:27 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:42:27 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:42:27 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:42:27 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:42:27 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:42:27 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:42:27 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 19 16:42:27 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 19 16:42:27 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 19 16:42:27 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 19 16:42:27 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:42:27 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:42:27 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:42:27 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:42:27 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18 could not be found. Apr 19 16:42:27 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:42:27 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:42:27 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:42:27 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:42:27 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:42:27 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:42:27 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:42:27 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:42:27 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18 could not be found. Apr 19 16:42:27 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:42:27 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-c92a6213-bccb-4f47-907f-1b29e21d9f42 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Returning 404 to user: Instance 7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18 could not be found. {{(pid=61471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:42:27 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-c92a6213-bccb-4f47-907f-1b29e21d9f42 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18" status: 404 len: 111 microversion: 2.1 time: 0.038242 Apr 19 16:42:27 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 105/311] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 16:42:27 2023] DELETE /compute/v2.1/servers/7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 16:42:27 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-4f4a69fa-2101-4e96-9d2d-d64d6fb8ef7d tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:42:27 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-4f4a69fa-2101-4e96-9d2d-d64d6fb8ef7d tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] [instance: 7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:42:27 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-4f4a69fa-2101-4e96-9d2d-d64d6fb8ef7d tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:42:27 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-4f4a69fa-2101-4e96-9d2d-d64d6fb8ef7d tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:42:27 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-4f4a69fa-2101-4e96-9d2d-d64d6fb8ef7d tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:42:27 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-4f4a69fa-2101-4e96-9d2d-d64d6fb8ef7d tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:42:27 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-4f4a69fa-2101-4e96-9d2d-d64d6fb8ef7d tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:42:27 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-4f4a69fa-2101-4e96-9d2d-d64d6fb8ef7d tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:42:27 user devstack@n-api.service[61473]: INFO nova.api.openstack.wsgi [None req-4f4a69fa-2101-4e96-9d2d-d64d6fb8ef7d tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] HTTP exception thrown: Instance 7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18 could not be found. Apr 19 16:42:27 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-4f4a69fa-2101-4e96-9d2d-d64d6fb8ef7d tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Request method failure captured: Apr 19 16:42:27 user devstack@n-api.service[61473]: request: GET /compute/v2.1/servers/7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18 HTTP/1.1 Apr 19 16:42:27 user devstack@n-api.service[61473]: Accept: application/json Apr 19 16:42:27 user devstack@n-api.service[61473]: Accept-Encoding: identity Apr 19 16:42:27 user devstack@n-api.service[61473]: Connection: close Apr 19 16:42:27 user devstack@n-api.service[61473]: Content-Length: 0 Apr 19 16:42:27 user devstack@n-api.service[61473]: Content-Type: application/json Apr 19 16:42:27 user devstack@n-api.service[61473]: Host: 10.0.0.210 Apr 19 16:42:27 user devstack@n-api.service[61473]: Openstack-System-Scope: None Apr 19 16:42:27 user devstack@n-api.service[61473]: User-Agent: python-urllib3/1.26.15 Apr 19 16:42:27 user devstack@n-api.service[61473]: X-Auth-Token: gAAAAABkQBft97Lb8vXwWY10e1qffFSo9pCiKV_nxukKPY9LMmdZSFBRwKuoOKIxCFrqpqDeRzdcPSEDj68b-o5l31Z4_eRDXw1gJEuFqqj2Tw860aOgd5ZQADEQT3q0cIaqtXe8wGfwGxbcOzsvtQA5rYII5DcCVXxTcc7A5yhZxtXMgTKih84 Apr 19 16:42:27 user devstack@n-api.service[61473]: X-Domain-Id: None Apr 19 16:42:27 user devstack@n-api.service[61473]: X-Domain-Name: None Apr 19 16:42:27 user devstack@n-api.service[61473]: X-Identity-Status: Confirmed Apr 19 16:42:27 user devstack@n-api.service[61473]: X-Is-Admin-Project: True Apr 19 16:42:27 user devstack@n-api.service[61473]: X-Project-Domain-Id: default Apr 19 16:42:27 user devstack@n-api.service[61473]: X-Project-Domain-Name: Default Apr 19 16:42:27 user devstack@n-api.service[61473]: X-Project-Id: 3a63d3a9c6774bba8f276846597e24ca Apr 19 16:42:27 user devstack@n-api.service[61473]: X-Project-Name: tempest-ServersNegativeTestJSON-415326023 Apr 19 16:42:27 user devstack@n-api.service[61473]: X-Role: member,reader Apr 19 16:42:27 user devstack@n-api.service[61473]: X-Roles: member,reader Apr 19 16:42:27 user devstack@n-api.service[61473]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3a63d3a9c6774bba8f276846597e24ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3a63d3a9c6774bba8f276846597e24ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3a63d3a9c6774bba8f276846597e24ca"}]}] Apr 19 16:42:27 user devstack@n-api.service[61473]: X-Tenant: tempest-ServersNegativeTestJSON-415326023 Apr 19 16:42:27 user devstack@n-api.service[61473]: X-Tenant-Id: 3a63d3a9c6774bba8f276846597e24ca Apr 19 16:42:27 user devstack@n-api.service[61473]: X-Tenant-Name: tempest-ServersNegativeTestJSON-415326023 Apr 19 16:42:27 user devstack@n-api.service[61473]: X-User: tempest-ServersNegativeTestJSON-415326023-project-member Apr 19 16:42:27 user devstack@n-api.service[61473]: X-User-Domain-Id: default Apr 19 16:42:27 user devstack@n-api.service[61473]: X-User-Domain-Name: Default Apr 19 16:42:27 user devstack@n-api.service[61473]: X-User-Id: 25d089267c6a4a1391bb89ae66b49da7 Apr 19 16:42:27 user devstack@n-api.service[61473]: X-User-Name: tempest-ServersNegativeTestJSON-415326023-project-member Apr 19 16:42:27 user devstack@n-api.service[61473]: method: > Apr 19 16:42:27 user devstack@n-api.service[61473]: exception: Instance 7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18 could not be found. Apr 19 16:42:27 user devstack@n-api.service[61473]: action_args: {'id': '7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18'} Apr 19 16:42:27 user devstack@n-api.service[61473]: {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:42:27 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:42:27 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:42:27 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:42:27 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:42:27 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:42:27 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:42:27 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:42:27 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:42:27 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:42:27 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18 could not be found. Apr 19 16:42:27 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:42:27 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:42:27 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:42:27 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:42:27 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:42:27 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:42:27 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:42:27 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:42:27 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:42:27 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:42:27 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 16:42:27 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 16:42:27 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:42:27 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:42:27 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:42:27 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:42:27 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18 could not be found. Apr 19 16:42:27 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:42:27 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:42:27 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:42:27 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:42:27 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:42:27 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:42:27 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:42:27 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:42:27 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18 could not be found. Apr 19 16:42:27 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:42:27 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-4f4a69fa-2101-4e96-9d2d-d64d6fb8ef7d tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Returning 404 to user: Instance 7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18 could not be found. {{(pid=61473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:42:27 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-4f4a69fa-2101-4e96-9d2d-d64d6fb8ef7d tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18" status: 404 len: 111 microversion: 2.1 time: 0.028275 Apr 19 16:42:27 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 106/312] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:42:27 2023] GET /compute/v2.1/servers/7b7e09e3-8b6f-48fe-9d33-1ed6b9881e18 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 16:42:27 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-6aac2eea-9cc1-4e27-9c43-911db7f255c3 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:42:27 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-6aac2eea-9cc1-4e27-9c43-911db7f255c3 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] [instance: 11eee783-802b-438a-bc43-a59b6c33ce63] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:42:27 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-6aac2eea-9cc1-4e27-9c43-911db7f255c3 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:42:27 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-6aac2eea-9cc1-4e27-9c43-911db7f255c3 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:42:27 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-6aac2eea-9cc1-4e27-9c43-911db7f255c3 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:42:27 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-6aac2eea-9cc1-4e27-9c43-911db7f255c3 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:42:27 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-6aac2eea-9cc1-4e27-9c43-911db7f255c3 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:42:27 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-6aac2eea-9cc1-4e27-9c43-911db7f255c3 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:42:27 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-6aac2eea-9cc1-4e27-9c43-911db7f255c3 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] [instance: 11eee783-802b-438a-bc43-a59b6c33ce63] Going to try to terminate instance {{(pid=61472) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 16:42:27 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-6aac2eea-9cc1-4e27-9c43-911db7f255c3 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/11eee783-802b-438a-bc43-a59b6c33ce63" status: 204 len: 0 microversion: 2.1 time: 0.176350 Apr 19 16:42:27 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 102/313] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 16:42:27 2023] DELETE /compute/v2.1/servers/11eee783-802b-438a-bc43-a59b6c33ce63 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 16:42:27 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-8596700d-91e1-4087-89ce-9fa4aa2669b8 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:42:27 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-8596700d-91e1-4087-89ce-9fa4aa2669b8 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] [instance: 11eee783-802b-438a-bc43-a59b6c33ce63] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:42:27 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-8596700d-91e1-4087-89ce-9fa4aa2669b8 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:42:27 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-8596700d-91e1-4087-89ce-9fa4aa2669b8 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:42:27 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-8596700d-91e1-4087-89ce-9fa4aa2669b8 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:42:27 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-8596700d-91e1-4087-89ce-9fa4aa2669b8 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:42:27 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-8596700d-91e1-4087-89ce-9fa4aa2669b8 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:42:27 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-8596700d-91e1-4087-89ce-9fa4aa2669b8 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:42:28 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-5d5e9148-f3b9-4575-ae9c-35dc742568f9 req-4e09e152-e87c-462f-a051-0703ca5981e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11eee783-802b-438a-bc43-a59b6c33ce63", "name": "network-vif-unplugged", "status": "completed", "tag": "3ad47771-69d8-4038-985b-3466ee7216bb"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:42:28 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-5d5e9148-f3b9-4575-ae9c-35dc742568f9 req-4e09e152-e87c-462f-a051-0703ca5981e6 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:42:28 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-5d5e9148-f3b9-4575-ae9c-35dc742568f9 req-4e09e152-e87c-462f-a051-0703ca5981e6 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:42:28 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-5d5e9148-f3b9-4575-ae9c-35dc742568f9 req-4e09e152-e87c-462f-a051-0703ca5981e6 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:42:28 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-5d5e9148-f3b9-4575-ae9c-35dc742568f9 req-4e09e152-e87c-462f-a051-0703ca5981e6 service nova] Creating event network-vif-unplugged:3ad47771-69d8-4038-985b-3466ee7216bb for instance 11eee783-802b-438a-bc43-a59b6c33ce63 on user Apr 19 16:42:28 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-5d5e9148-f3b9-4575-ae9c-35dc742568f9 req-4e09e152-e87c-462f-a051-0703ca5981e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029407 Apr 19 16:42:28 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 107/314] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:42:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:42:28 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-ded73472-b529-4298-83c9-4515a2176474 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:42:28 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-ded73472-b529-4298-83c9-4515a2176474 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] [instance: 6b41b6c3-b067-4ae8-9fe2-cbeea18664f5] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:42:28 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-ded73472-b529-4298-83c9-4515a2176474 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:42:28 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-ded73472-b529-4298-83c9-4515a2176474 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:42:28 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-ded73472-b529-4298-83c9-4515a2176474 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:42:28 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-ded73472-b529-4298-83c9-4515a2176474 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:42:28 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-ded73472-b529-4298-83c9-4515a2176474 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:42:28 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-ded73472-b529-4298-83c9-4515a2176474 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:42:28 user devstack@n-api.service[61472]: INFO nova.api.openstack.wsgi [None req-ded73472-b529-4298-83c9-4515a2176474 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] HTTP exception thrown: Instance 6b41b6c3-b067-4ae8-9fe2-cbeea18664f5 could not be found. Apr 19 16:42:28 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-ded73472-b529-4298-83c9-4515a2176474 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Request method failure captured: Apr 19 16:42:28 user devstack@n-api.service[61472]: request: GET /compute/v2.1/servers/6b41b6c3-b067-4ae8-9fe2-cbeea18664f5 HTTP/1.1 Apr 19 16:42:28 user devstack@n-api.service[61472]: Accept: application/json Apr 19 16:42:28 user devstack@n-api.service[61472]: Accept-Encoding: identity Apr 19 16:42:28 user devstack@n-api.service[61472]: Connection: close Apr 19 16:42:28 user devstack@n-api.service[61472]: Content-Length: 0 Apr 19 16:42:28 user devstack@n-api.service[61472]: Content-Type: application/json Apr 19 16:42:28 user devstack@n-api.service[61472]: Host: 10.0.0.210 Apr 19 16:42:28 user devstack@n-api.service[61472]: Openstack-System-Scope: None Apr 19 16:42:28 user devstack@n-api.service[61472]: User-Agent: python-urllib3/1.26.15 Apr 19 16:42:28 user devstack@n-api.service[61472]: X-Auth-Token: gAAAAABkQBlJAd3biY-9KEMgklKDuysOh5htntw3aA2fiekma9t-YKSnQ_fXueCzycnimGgFdyia7dTZ5IIFoyrSkkvN0Ax7HrFu9pZhz8ASGZC0ws3SrcpGgTdtnoVBRkmJP-AvCs1bFk0dWzQz3zTGxS7aTrP0jeg6O5zosEN4jOW0KIFTyRo Apr 19 16:42:28 user devstack@n-api.service[61472]: X-Domain-Id: None Apr 19 16:42:28 user devstack@n-api.service[61472]: X-Domain-Name: None Apr 19 16:42:28 user devstack@n-api.service[61472]: X-Identity-Status: Confirmed Apr 19 16:42:28 user devstack@n-api.service[61472]: X-Is-Admin-Project: True Apr 19 16:42:28 user devstack@n-api.service[61472]: X-Project-Domain-Id: default Apr 19 16:42:28 user devstack@n-api.service[61472]: X-Project-Domain-Name: Default Apr 19 16:42:28 user devstack@n-api.service[61472]: X-Project-Id: 6c9c03f81c174bc89b90e1379b0e358e Apr 19 16:42:28 user devstack@n-api.service[61472]: X-Project-Name: tempest-SnapshotDataIntegrityTests-958082169 Apr 19 16:42:28 user devstack@n-api.service[61472]: X-Role: member,reader Apr 19 16:42:28 user devstack@n-api.service[61472]: X-Roles: member,reader Apr 19 16:42:28 user devstack@n-api.service[61472]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6c9c03f81c174bc89b90e1379b0e358e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6c9c03f81c174bc89b90e1379b0e358e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6c9c03f81c174bc89b90e1379b0e358e"}]}] Apr 19 16:42:28 user devstack@n-api.service[61472]: X-Tenant: tempest-SnapshotDataIntegrityTests-958082169 Apr 19 16:42:28 user devstack@n-api.service[61472]: X-Tenant-Id: 6c9c03f81c174bc89b90e1379b0e358e Apr 19 16:42:28 user devstack@n-api.service[61472]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-958082169 Apr 19 16:42:28 user devstack@n-api.service[61472]: X-User: tempest-SnapshotDataIntegrityTests-958082169-project-member Apr 19 16:42:28 user devstack@n-api.service[61472]: X-User-Domain-Id: default Apr 19 16:42:28 user devstack@n-api.service[61472]: X-User-Domain-Name: Default Apr 19 16:42:28 user devstack@n-api.service[61472]: X-User-Id: 9a8acfb1eb6149dc962e935451099438 Apr 19 16:42:28 user devstack@n-api.service[61472]: X-User-Name: tempest-SnapshotDataIntegrityTests-958082169-project-member Apr 19 16:42:28 user devstack@n-api.service[61472]: method: > Apr 19 16:42:28 user devstack@n-api.service[61472]: exception: Instance 6b41b6c3-b067-4ae8-9fe2-cbeea18664f5 could not be found. Apr 19 16:42:28 user devstack@n-api.service[61472]: action_args: {'id': '6b41b6c3-b067-4ae8-9fe2-cbeea18664f5'} Apr 19 16:42:28 user devstack@n-api.service[61472]: {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:42:28 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:42:28 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:42:28 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:42:28 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:42:28 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:42:28 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:42:28 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:42:28 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:42:28 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:42:28 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b41b6c3-b067-4ae8-9fe2-cbeea18664f5 could not be found. Apr 19 16:42:28 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:42:28 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:42:28 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:42:28 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:42:28 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:42:28 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:42:28 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:42:28 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:42:28 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:42:28 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:42:28 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 16:42:28 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 16:42:28 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:42:28 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:42:28 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:42:28 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:42:28 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b41b6c3-b067-4ae8-9fe2-cbeea18664f5 could not be found. Apr 19 16:42:28 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:42:28 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:42:28 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:42:28 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:42:28 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:42:28 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:42:28 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:42:28 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:42:28 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b41b6c3-b067-4ae8-9fe2-cbeea18664f5 could not be found. Apr 19 16:42:28 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:42:28 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-ded73472-b529-4298-83c9-4515a2176474 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Returning 404 to user: Instance 6b41b6c3-b067-4ae8-9fe2-cbeea18664f5 could not be found. {{(pid=61472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:42:28 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-ded73472-b529-4298-83c9-4515a2176474 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b41b6c3-b067-4ae8-9fe2-cbeea18664f5" status: 404 len: 111 microversion: 2.1 time: 0.052579 Apr 19 16:42:28 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 103/315] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:42:28 2023] GET /compute/v2.1/servers/6b41b6c3-b067-4ae8-9fe2-cbeea18664f5 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 16:42:28 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-cf298731-958a-4438-8de0-28bc4926731c req-ff904a51-6470-4df7-8b19-c88533a5bc60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "180bfabe-bb88-4d49-98ed-be76df93d4e1", "name": "network-vif-plugged", "status": "completed", "tag": "0b670fd3-432a-4381-8275-1cb632b18aaa"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:42:28 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-cf298731-958a-4438-8de0-28bc4926731c req-ff904a51-6470-4df7-8b19-c88533a5bc60 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:42:28 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-cf298731-958a-4438-8de0-28bc4926731c req-ff904a51-6470-4df7-8b19-c88533a5bc60 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:42:28 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-cf298731-958a-4438-8de0-28bc4926731c req-ff904a51-6470-4df7-8b19-c88533a5bc60 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:42:28 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-cf298731-958a-4438-8de0-28bc4926731c req-ff904a51-6470-4df7-8b19-c88533a5bc60 service nova] Creating event network-vif-plugged:0b670fd3-432a-4381-8275-1cb632b18aaa for instance 180bfabe-bb88-4d49-98ed-be76df93d4e1 on user Apr 19 16:42:28 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-cf298731-958a-4438-8de0-28bc4926731c req-ff904a51-6470-4df7-8b19-c88533a5bc60 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034837 Apr 19 16:42:28 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 108/316] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:42:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:42:28 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-60263a44-397d-440f-b31c-4476f72b8d24 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] Calling method '.version_select at 0x7fd49710dfc0>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:42:28 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-60263a44-397d-440f-b31c-4476f72b8d24 tempest-SnapshotDataIntegrityTests-958082169 tempest-SnapshotDataIntegrityTests-958082169-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-252591740" status: 202 len: 0 microversion: 2.1 time: 0.021871 Apr 19 16:42:28 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 104/317] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 16:42:28 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-252591740 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 16:42:28 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-8596700d-91e1-4087-89ce-9fa4aa2669b8 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d089267c6a4a1391bb89ae66b49da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a63d3a9c6774bba8f276846597e24ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:42:28 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-8596700d-91e1-4087-89ce-9fa4aa2669b8 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11eee783-802b-438a-bc43-a59b6c33ce63" status: 200 len: 1500 microversion: 2.1 time: 1.172256 Apr 19 16:42:28 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 106/318] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:42:27 2023] GET /compute/v2.1/servers/11eee783-802b-438a-bc43-a59b6c33ce63 => generated 1500 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:42:30 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-ef099c59-05a3-46f6-93cd-76ade32ff820 req-dc260cae-54ad-4122-b917-ab6704753f32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11eee783-802b-438a-bc43-a59b6c33ce63", "name": "network-vif-deleted", "tag": "3ad47771-69d8-4038-985b-3466ee7216bb"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:42:30 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-ef099c59-05a3-46f6-93cd-76ade32ff820 req-dc260cae-54ad-4122-b917-ab6704753f32 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:42:30 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-ef099c59-05a3-46f6-93cd-76ade32ff820 req-dc260cae-54ad-4122-b917-ab6704753f32 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:42:30 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-ef099c59-05a3-46f6-93cd-76ade32ff820 req-dc260cae-54ad-4122-b917-ab6704753f32 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:42:30 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-ef099c59-05a3-46f6-93cd-76ade32ff820 req-dc260cae-54ad-4122-b917-ab6704753f32 service nova] Creating event network-vif-deleted:3ad47771-69d8-4038-985b-3466ee7216bb for instance 11eee783-802b-438a-bc43-a59b6c33ce63 on user Apr 19 16:42:30 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-ef099c59-05a3-46f6-93cd-76ade32ff820 req-dc260cae-54ad-4122-b917-ab6704753f32 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034510 Apr 19 16:42:30 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 109/319] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:42:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:42:30 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [req-d98db8c1-a73b-4ca6-bb30-f5a3141528e4 req-96f8ae28-246d-42c4-97d8-509959131bb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11eee783-802b-438a-bc43-a59b6c33ce63", "name": "network-vif-plugged", "status": "completed", "tag": "3ad47771-69d8-4038-985b-3466ee7216bb"}]} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:42:30 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-d98db8c1-a73b-4ca6-bb30-f5a3141528e4 req-96f8ae28-246d-42c4-97d8-509959131bb9 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:42:30 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-d98db8c1-a73b-4ca6-bb30-f5a3141528e4 req-96f8ae28-246d-42c4-97d8-509959131bb9 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:42:30 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-d98db8c1-a73b-4ca6-bb30-f5a3141528e4 req-96f8ae28-246d-42c4-97d8-509959131bb9 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:42:30 user devstack@n-api.service[61472]: INFO nova.api.openstack.compute.server_external_events [req-d98db8c1-a73b-4ca6-bb30-f5a3141528e4 req-96f8ae28-246d-42c4-97d8-509959131bb9 service nova] Creating event network-vif-plugged:3ad47771-69d8-4038-985b-3466ee7216bb for instance 11eee783-802b-438a-bc43-a59b6c33ce63 on user Apr 19 16:42:30 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [req-d98db8c1-a73b-4ca6-bb30-f5a3141528e4 req-96f8ae28-246d-42c4-97d8-509959131bb9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030623 Apr 19 16:42:30 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 105/320] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:42:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:42:32 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell0:SELECT=4 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:42:32 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-b5f4936f-8dda-4416-b135-19b574586f0a tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-230570654"}} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:42:32 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-b5f4936f-8dda-4416-b135-19b574586f0a tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] [instance: 4bca7be9-c7ba-4c5a-9860-bf516f174865] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:42:32 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-b5f4936f-8dda-4416-b135-19b574586f0a tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:42:32 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-b5f4936f-8dda-4416-b135-19b574586f0a tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:42:32 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-b5f4936f-8dda-4416-b135-19b574586f0a tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:42:32 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-b5f4936f-8dda-4416-b135-19b574586f0a tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:42:32 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-b5f4936f-8dda-4416-b135-19b574586f0a tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:42:32 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-b5f4936f-8dda-4416-b135-19b574586f0a tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:42:33 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-b5f4936f-8dda-4416-b135-19b574586f0a tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4bca7be9-c7ba-4c5a-9860-bf516f174865/action" status: 202 len: 52 microversion: 2.87 time: 1.097854 Apr 19 16:42:33 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 107/321] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 19 16:42:32 2023] POST /compute/v2.1/servers/4bca7be9-c7ba-4c5a-9860-bf516f174865/action => generated 52 bytes in 1100 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 19 16:42:38 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell0:SELECT=2 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:42:38 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell0:SELECT=6 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:42:38 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-25f29e92-68bf-47eb-bdc8-cf04cf468171 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:42:38 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-25f29e92-68bf-47eb-bdc8-cf04cf468171 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] [instance: 4bca7be9-c7ba-4c5a-9860-bf516f174865] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:42:38 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-25f29e92-68bf-47eb-bdc8-cf04cf468171 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:42:38 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-25f29e92-68bf-47eb-bdc8-cf04cf468171 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:42:38 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-25f29e92-68bf-47eb-bdc8-cf04cf468171 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:42:38 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-25f29e92-68bf-47eb-bdc8-cf04cf468171 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:42:38 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-25f29e92-68bf-47eb-bdc8-cf04cf468171 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:42:38 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-25f29e92-68bf-47eb-bdc8-cf04cf468171 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:42:38 user devstack@n-api.service[61473]: DEBUG nova.policy [None req-25f29e92-68bf-47eb-bdc8-cf04cf468171 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f2a02626ca4957823de39c9a31d1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ee4833fd147e2a494be5d7634a2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61473) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:42:38 user devstack@n-api.service[61473]: DEBUG nova.policy [None req-25f29e92-68bf-47eb-bdc8-cf04cf468171 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63f2a02626ca4957823de39c9a31d1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ee4833fd147e2a494be5d7634a2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61473) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:42:38 user devstack@n-api.service[61473]: DEBUG nova.policy [None req-25f29e92-68bf-47eb-bdc8-cf04cf468171 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63f2a02626ca4957823de39c9a31d1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ee4833fd147e2a494be5d7634a2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61473) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:42:38 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-25f29e92-68bf-47eb-bdc8-cf04cf468171 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4bca7be9-c7ba-4c5a-9860-bf516f174865" status: 200 len: 1690 microversion: 2.87 time: 0.243974 Apr 19 16:42:38 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 110/322] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 16:42:38 2023] GET /compute/v2.1/servers/4bca7be9-c7ba-4c5a-9860-bf516f174865 => generated 1690 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 16:42:40 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell0:SELECT=2 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:42:40 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-6fbef02f-dec0-4ee2-88b8-6805ed7c628d tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:42:40 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-6fbef02f-dec0-4ee2-88b8-6805ed7c628d tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] [instance: edd2688e-940e-4ab3-b27c-b6d4aab3efc5] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:42:40 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-6fbef02f-dec0-4ee2-88b8-6805ed7c628d tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:42:40 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-6fbef02f-dec0-4ee2-88b8-6805ed7c628d tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:42:40 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-6fbef02f-dec0-4ee2-88b8-6805ed7c628d tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:42:40 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-6fbef02f-dec0-4ee2-88b8-6805ed7c628d tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:42:40 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-6fbef02f-dec0-4ee2-88b8-6805ed7c628d tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:42:40 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-6fbef02f-dec0-4ee2-88b8-6805ed7c628d tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:42:40 user devstack@n-api.service[61472]: DEBUG nova.policy [None req-6fbef02f-dec0-4ee2-88b8-6805ed7c628d tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023314f8cf79430b83c5184d9a54be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78962d13860a4df3a8aa100e2afaca6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61472) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:42:40 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-6fbef02f-dec0-4ee2-88b8-6805ed7c628d tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] 10.0.0.210 "GET /compute/v2.1/servers/edd2688e-940e-4ab3-b27c-b6d4aab3efc5" status: 200 len: 1659 microversion: 2.1 time: 0.234287 Apr 19 16:42:40 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 106/323] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:42:40 2023] GET /compute/v2.1/servers/edd2688e-940e-4ab3-b27c-b6d4aab3efc5 => generated 1659 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 16:42:40 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-84f81f00-4d74-431e-bfd5-3a757e4738b2 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:42:40 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-84f81f00-4d74-431e-bfd5-3a757e4738b2 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] [instance: edd2688e-940e-4ab3-b27c-b6d4aab3efc5] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:42:40 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-84f81f00-4d74-431e-bfd5-3a757e4738b2 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:42:40 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-84f81f00-4d74-431e-bfd5-3a757e4738b2 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:42:40 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-84f81f00-4d74-431e-bfd5-3a757e4738b2 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:42:40 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-84f81f00-4d74-431e-bfd5-3a757e4738b2 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:42:40 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-84f81f00-4d74-431e-bfd5-3a757e4738b2 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:42:40 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-84f81f00-4d74-431e-bfd5-3a757e4738b2 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:42:41 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-84f81f00-4d74-431e-bfd5-3a757e4738b2 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023314f8cf79430b83c5184d9a54be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78962d13860a4df3a8aa100e2afaca6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:42:41 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-84f81f00-4d74-431e-bfd5-3a757e4738b2 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] 10.0.0.210 "GET /compute/v2.1/servers/edd2688e-940e-4ab3-b27c-b6d4aab3efc5" status: 200 len: 1659 microversion: 2.1 time: 0.376391 Apr 19 16:42:41 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 108/324] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:42:40 2023] GET /compute/v2.1/servers/edd2688e-940e-4ab3-b27c-b6d4aab3efc5 => generated 1659 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:42:41 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-f0f9e3d4-86d4-47c6-92a3-5c76804580ca tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:42:41 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-f0f9e3d4-86d4-47c6-92a3-5c76804580ca tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] [instance: edd2688e-940e-4ab3-b27c-b6d4aab3efc5] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:42:41 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-f0f9e3d4-86d4-47c6-92a3-5c76804580ca tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:42:41 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-f0f9e3d4-86d4-47c6-92a3-5c76804580ca tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:42:41 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-f0f9e3d4-86d4-47c6-92a3-5c76804580ca tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:42:41 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-f0f9e3d4-86d4-47c6-92a3-5c76804580ca tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:42:41 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-f0f9e3d4-86d4-47c6-92a3-5c76804580ca tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:42:41 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-f0f9e3d4-86d4-47c6-92a3-5c76804580ca tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:42:41 user devstack@n-api.service[61473]: DEBUG nova.policy [None req-f0f9e3d4-86d4-47c6-92a3-5c76804580ca tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023314f8cf79430b83c5184d9a54be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78962d13860a4df3a8aa100e2afaca6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61473) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:42:41 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-f0f9e3d4-86d4-47c6-92a3-5c76804580ca tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] 10.0.0.210 "GET /compute/v2.1/servers/edd2688e-940e-4ab3-b27c-b6d4aab3efc5" status: 200 len: 1659 microversion: 2.1 time: 0.139322 Apr 19 16:42:41 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 111/325] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:42:41 2023] GET /compute/v2.1/servers/edd2688e-940e-4ab3-b27c-b6d4aab3efc5 => generated 1659 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:43:11 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-57732b0e-2641-4200-929b-d98e80206531 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:43:11 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-57732b0e-2641-4200-929b-d98e80206531 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] [instance: 180bfabe-bb88-4d49-98ed-be76df93d4e1] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:43:11 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:43:11 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:43:11 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-57732b0e-2641-4200-929b-d98e80206531 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:43:11 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-57732b0e-2641-4200-929b-d98e80206531 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:43:11 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-57732b0e-2641-4200-929b-d98e80206531 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:43:11 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-57732b0e-2641-4200-929b-d98e80206531 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:43:11 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-57732b0e-2641-4200-929b-d98e80206531 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:43:11 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-57732b0e-2641-4200-929b-d98e80206531 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:43:12 user devstack@n-api.service[61472]: DEBUG nova.policy [None req-57732b0e-2641-4200-929b-d98e80206531 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3934da35244b148d5fa8c56152a1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e6dbe3c46740f3b6d7a0618e076583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61472) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:43:12 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-57732b0e-2641-4200-929b-d98e80206531 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/180bfabe-bb88-4d49-98ed-be76df93d4e1" status: 200 len: 1536 microversion: 2.1 time: 0.218223 Apr 19 16:43:12 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 107/326] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:43:11 2023] GET /compute/v2.1/servers/180bfabe-bb88-4d49-98ed-be76df93d4e1 => generated 1536 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:43:18 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-f9e42514-742d-47d5-a6e7-2c98a40f8f53 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:43:18 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-f9e42514-742d-47d5-a6e7-2c98a40f8f53 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] [instance: 11eee783-802b-438a-bc43-a59b6c33ce63] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:43:18 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:43:18 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:43:18 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-f9e42514-742d-47d5-a6e7-2c98a40f8f53 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:43:18 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-f9e42514-742d-47d5-a6e7-2c98a40f8f53 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:43:18 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-f9e42514-742d-47d5-a6e7-2c98a40f8f53 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:43:18 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-f9e42514-742d-47d5-a6e7-2c98a40f8f53 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:43:18 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-f9e42514-742d-47d5-a6e7-2c98a40f8f53 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:43:18 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-f9e42514-742d-47d5-a6e7-2c98a40f8f53 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:43:18 user devstack@n-api.service[61471]: INFO nova.api.openstack.wsgi [None req-f9e42514-742d-47d5-a6e7-2c98a40f8f53 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] HTTP exception thrown: Instance 11eee783-802b-438a-bc43-a59b6c33ce63 could not be found. Apr 19 16:43:18 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-f9e42514-742d-47d5-a6e7-2c98a40f8f53 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Request method failure captured: Apr 19 16:43:18 user devstack@n-api.service[61471]: request: GET /compute/v2.1/servers/11eee783-802b-438a-bc43-a59b6c33ce63 HTTP/1.1 Apr 19 16:43:18 user devstack@n-api.service[61471]: Accept: application/json Apr 19 16:43:18 user devstack@n-api.service[61471]: Accept-Encoding: identity Apr 19 16:43:18 user devstack@n-api.service[61471]: Connection: close Apr 19 16:43:18 user devstack@n-api.service[61471]: Content-Length: 0 Apr 19 16:43:18 user devstack@n-api.service[61471]: Content-Type: application/json Apr 19 16:43:18 user devstack@n-api.service[61471]: Host: 10.0.0.210 Apr 19 16:43:18 user devstack@n-api.service[61471]: Openstack-System-Scope: None Apr 19 16:43:18 user devstack@n-api.service[61471]: User-Agent: python-urllib3/1.26.15 Apr 19 16:43:18 user devstack@n-api.service[61471]: X-Auth-Token: gAAAAABkQBft97Lb8vXwWY10e1qffFSo9pCiKV_nxukKPY9LMmdZSFBRwKuoOKIxCFrqpqDeRzdcPSEDj68b-o5l31Z4_eRDXw1gJEuFqqj2Tw860aOgd5ZQADEQT3q0cIaqtXe8wGfwGxbcOzsvtQA5rYII5DcCVXxTcc7A5yhZxtXMgTKih84 Apr 19 16:43:18 user devstack@n-api.service[61471]: X-Domain-Id: None Apr 19 16:43:18 user devstack@n-api.service[61471]: X-Domain-Name: None Apr 19 16:43:18 user devstack@n-api.service[61471]: X-Identity-Status: Confirmed Apr 19 16:43:18 user devstack@n-api.service[61471]: X-Is-Admin-Project: True Apr 19 16:43:18 user devstack@n-api.service[61471]: X-Project-Domain-Id: default Apr 19 16:43:18 user devstack@n-api.service[61471]: X-Project-Domain-Name: Default Apr 19 16:43:18 user devstack@n-api.service[61471]: X-Project-Id: 3a63d3a9c6774bba8f276846597e24ca Apr 19 16:43:18 user devstack@n-api.service[61471]: X-Project-Name: tempest-ServersNegativeTestJSON-415326023 Apr 19 16:43:18 user devstack@n-api.service[61471]: X-Role: member,reader Apr 19 16:43:18 user devstack@n-api.service[61471]: X-Roles: member,reader Apr 19 16:43:19 user devstack@n-api.service[61471]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3a63d3a9c6774bba8f276846597e24ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3a63d3a9c6774bba8f276846597e24ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3a63d3a9c6774bba8f276846597e24ca"}]}] Apr 19 16:43:19 user devstack@n-api.service[61471]: X-Tenant: tempest-ServersNegativeTestJSON-415326023 Apr 19 16:43:19 user devstack@n-api.service[61471]: X-Tenant-Id: 3a63d3a9c6774bba8f276846597e24ca Apr 19 16:43:19 user devstack@n-api.service[61471]: X-Tenant-Name: tempest-ServersNegativeTestJSON-415326023 Apr 19 16:43:19 user devstack@n-api.service[61471]: X-User: tempest-ServersNegativeTestJSON-415326023-project-member Apr 19 16:43:19 user devstack@n-api.service[61471]: X-User-Domain-Id: default Apr 19 16:43:19 user devstack@n-api.service[61471]: X-User-Domain-Name: Default Apr 19 16:43:19 user devstack@n-api.service[61471]: X-User-Id: 25d089267c6a4a1391bb89ae66b49da7 Apr 19 16:43:19 user devstack@n-api.service[61471]: X-User-Name: tempest-ServersNegativeTestJSON-415326023-project-member Apr 19 16:43:19 user devstack@n-api.service[61471]: method: > Apr 19 16:43:19 user devstack@n-api.service[61471]: exception: Instance 11eee783-802b-438a-bc43-a59b6c33ce63 could not be found. Apr 19 16:43:19 user devstack@n-api.service[61471]: action_args: {'id': '11eee783-802b-438a-bc43-a59b6c33ce63'} Apr 19 16:43:19 user devstack@n-api.service[61471]: {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:43:19 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:43:19 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:43:19 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:43:19 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:43:19 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:43:19 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:43:19 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:43:19 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:43:19 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:43:19 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11eee783-802b-438a-bc43-a59b6c33ce63 could not be found. Apr 19 16:43:19 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:43:19 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:43:19 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:43:19 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:43:19 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:43:19 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:43:19 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:43:19 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:43:19 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:43:19 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:43:19 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 16:43:19 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 16:43:19 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:43:19 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:43:19 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:43:19 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:43:19 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11eee783-802b-438a-bc43-a59b6c33ce63 could not be found. Apr 19 16:43:19 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:43:19 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:43:19 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:43:19 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:43:19 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:43:19 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:43:19 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:43:19 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:43:19 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11eee783-802b-438a-bc43-a59b6c33ce63 could not be found. Apr 19 16:43:19 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:43:19 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-f9e42514-742d-47d5-a6e7-2c98a40f8f53 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] Returning 404 to user: Instance 11eee783-802b-438a-bc43-a59b6c33ce63 could not be found. {{(pid=61471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:43:19 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-f9e42514-742d-47d5-a6e7-2c98a40f8f53 tempest-ServersNegativeTestJSON-415326023 tempest-ServersNegativeTestJSON-415326023-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11eee783-802b-438a-bc43-a59b6c33ce63" status: 404 len: 111 microversion: 2.1 time: 0.036521 Apr 19 16:43:19 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 109/327] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:43:18 2023] GET /compute/v2.1/servers/11eee783-802b-438a-bc43-a59b6c33ce63 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 16:43:25 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-0c8875a6-18ef-4a74-82d3-04c02b10c7d5 tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:43:25 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-0c8875a6-18ef-4a74-82d3-04c02b10c7d5 tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] [instance: adacc1e4-5ebd-4feb-8dcf-84689765bf54] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:43:25 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:43:25 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell1:SELECT=26 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:43:25 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-0c8875a6-18ef-4a74-82d3-04c02b10c7d5 tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:43:25 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-0c8875a6-18ef-4a74-82d3-04c02b10c7d5 tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:43:25 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-0c8875a6-18ef-4a74-82d3-04c02b10c7d5 tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:43:25 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-0c8875a6-18ef-4a74-82d3-04c02b10c7d5 tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:43:25 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-0c8875a6-18ef-4a74-82d3-04c02b10c7d5 tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:43:25 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-0c8875a6-18ef-4a74-82d3-04c02b10c7d5 tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:43:25 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-0c8875a6-18ef-4a74-82d3-04c02b10c7d5 tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] [instance: adacc1e4-5ebd-4feb-8dcf-84689765bf54] Going to try to terminate instance {{(pid=61473) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 16:43:25 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-0c8875a6-18ef-4a74-82d3-04c02b10c7d5 tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/adacc1e4-5ebd-4feb-8dcf-84689765bf54" status: 204 len: 0 microversion: 2.1 time: 0.119201 Apr 19 16:43:25 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 112/328] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 16:43:25 2023] DELETE /compute/v2.1/servers/adacc1e4-5ebd-4feb-8dcf-84689765bf54 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 16:43:25 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-dd5992ae-417f-4339-ae1e-bc5d0ac0de71 tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:43:25 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-dd5992ae-417f-4339-ae1e-bc5d0ac0de71 tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] [instance: adacc1e4-5ebd-4feb-8dcf-84689765bf54] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:43:25 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_api:SELECT=2 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:43:25 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell1:SELECT=6 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:43:25 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-dd5992ae-417f-4339-ae1e-bc5d0ac0de71 tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:43:25 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-dd5992ae-417f-4339-ae1e-bc5d0ac0de71 tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:43:25 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-dd5992ae-417f-4339-ae1e-bc5d0ac0de71 tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:43:25 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-dd5992ae-417f-4339-ae1e-bc5d0ac0de71 tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:43:25 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-dd5992ae-417f-4339-ae1e-bc5d0ac0de71 tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:43:25 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-dd5992ae-417f-4339-ae1e-bc5d0ac0de71 tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:43:26 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [req-1c42fbd2-9302-43eb-a05d-1703cb6f8df2 req-d85d626e-ae11-447e-adf4-2098a08f049e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adacc1e4-5ebd-4feb-8dcf-84689765bf54", "name": "network-vif-unplugged", "status": "completed", "tag": "107129df-e278-4a6b-9d01-ca0d891d2b0a"}]} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:43:26 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-1c42fbd2-9302-43eb-a05d-1703cb6f8df2 req-d85d626e-ae11-447e-adf4-2098a08f049e service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:43:26 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-1c42fbd2-9302-43eb-a05d-1703cb6f8df2 req-d85d626e-ae11-447e-adf4-2098a08f049e service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:43:26 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-1c42fbd2-9302-43eb-a05d-1703cb6f8df2 req-d85d626e-ae11-447e-adf4-2098a08f049e service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:43:26 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-1c42fbd2-9302-43eb-a05d-1703cb6f8df2 req-d85d626e-ae11-447e-adf4-2098a08f049e service nova] Creating event network-vif-unplugged:107129df-e278-4a6b-9d01-ca0d891d2b0a for instance adacc1e4-5ebd-4feb-8dcf-84689765bf54 on user Apr 19 16:43:26 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [req-1c42fbd2-9302-43eb-a05d-1703cb6f8df2 req-d85d626e-ae11-447e-adf4-2098a08f049e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035308 Apr 19 16:43:26 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 110/329] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:43:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:43:26 user devstack@n-api.service[61472]: DEBUG nova.policy [None req-dd5992ae-417f-4339-ae1e-bc5d0ac0de71 tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccab14a59c694c948e9942de0928e095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b8ca1133fa467f8009125a3fc11583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61472) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:43:26 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-dd5992ae-417f-4339-ae1e-bc5d0ac0de71 tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] 10.0.0.210 "GET /compute/v2.1/servers/adacc1e4-5ebd-4feb-8dcf-84689765bf54" status: 200 len: 1490 microversion: 2.1 time: 0.393880 Apr 19 16:43:26 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 108/330] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:43:25 2023] GET /compute/v2.1/servers/adacc1e4-5ebd-4feb-8dcf-84689765bf54 => generated 1490 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:43:27 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-482bc312-0f6c-44d4-a4fc-83739aab145c req-3975e102-3d3e-4433-8713-61ab0e6e0f4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adacc1e4-5ebd-4feb-8dcf-84689765bf54", "name": "network-vif-deleted", "tag": "107129df-e278-4a6b-9d01-ca0d891d2b0a"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:43:27 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-482bc312-0f6c-44d4-a4fc-83739aab145c req-3975e102-3d3e-4433-8713-61ab0e6e0f4e service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:43:27 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-482bc312-0f6c-44d4-a4fc-83739aab145c req-3975e102-3d3e-4433-8713-61ab0e6e0f4e service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:43:27 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-482bc312-0f6c-44d4-a4fc-83739aab145c req-3975e102-3d3e-4433-8713-61ab0e6e0f4e service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:43:27 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-482bc312-0f6c-44d4-a4fc-83739aab145c req-3975e102-3d3e-4433-8713-61ab0e6e0f4e service nova] Creating event network-vif-deleted:107129df-e278-4a6b-9d01-ca0d891d2b0a for instance adacc1e4-5ebd-4feb-8dcf-84689765bf54 on user Apr 19 16:43:27 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-482bc312-0f6c-44d4-a4fc-83739aab145c req-3975e102-3d3e-4433-8713-61ab0e6e0f4e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031387 Apr 19 16:43:27 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 113/331] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:43:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:43:28 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [req-082d27a9-6158-47cd-aa5f-456cb7f6616c req-aadbf820-a77d-4418-a48a-1f7427ea9d88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adacc1e4-5ebd-4feb-8dcf-84689765bf54", "name": "network-vif-plugged", "status": "completed", "tag": "107129df-e278-4a6b-9d01-ca0d891d2b0a"}]} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:43:28 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-082d27a9-6158-47cd-aa5f-456cb7f6616c req-aadbf820-a77d-4418-a48a-1f7427ea9d88 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:43:28 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-082d27a9-6158-47cd-aa5f-456cb7f6616c req-aadbf820-a77d-4418-a48a-1f7427ea9d88 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:43:28 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-082d27a9-6158-47cd-aa5f-456cb7f6616c req-aadbf820-a77d-4418-a48a-1f7427ea9d88 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:43:28 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-082d27a9-6158-47cd-aa5f-456cb7f6616c req-aadbf820-a77d-4418-a48a-1f7427ea9d88 service nova] Creating event network-vif-plugged:107129df-e278-4a6b-9d01-ca0d891d2b0a for instance adacc1e4-5ebd-4feb-8dcf-84689765bf54 on user Apr 19 16:43:28 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [req-082d27a9-6158-47cd-aa5f-456cb7f6616c req-aadbf820-a77d-4418-a48a-1f7427ea9d88 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035236 Apr 19 16:43:28 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 111/332] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:43:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:43:38 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-17a25437-0ef8-4b4f-8d43-8104828ae4ee tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1496981344", "imageRef": "ab56c4b1-0117-43b0-84b6-28d06a23f182", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "ab56c4b1-0117-43b0-84b6-28d06a23f182", "destination_type": "volume"}], "networks": [{"uuid": "bdc7f4b4-1167-484c-ab08-77c4f58bf2f6"}]}} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:43:38 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_api:SELECT=2 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:43:38 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell1:SELECT=6 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:43:39 user devstack@n-api.service[61472]: DEBUG nova.network.neutron [None req-17a25437-0ef8-4b4f-8d43-8104828ae4ee tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] validate_networks() for [('bdc7f4b4-1167-484c-ab08-77c4f58bf2f6', None, None, None, None, None)] {{(pid=61472) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 16:43:40 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-17a25437-0ef8-4b4f-8d43-8104828ae4ee tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Flavor limits 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 16:43:40 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-17a25437-0ef8-4b4f-8d43-8104828ae4ee tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Image limits 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 16:43:40 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-17a25437-0ef8-4b4f-8d43-8104828ae4ee tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Flavor pref 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 16:43:40 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-17a25437-0ef8-4b4f-8d43-8104828ae4ee tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Image pref 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 16:43:40 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-17a25437-0ef8-4b4f-8d43-8104828ae4ee tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 16:43:40 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-17a25437-0ef8-4b4f-8d43-8104828ae4ee tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:43:40 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-17a25437-0ef8-4b4f-8d43-8104828ae4ee tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:43:40 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-17a25437-0ef8-4b4f-8d43-8104828ae4ee tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:43:40 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-17a25437-0ef8-4b4f-8d43-8104828ae4ee tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:43:40 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-17a25437-0ef8-4b4f-8d43-8104828ae4ee tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:43:40 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-17a25437-0ef8-4b4f-8d43-8104828ae4ee tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:43:40 user devstack@n-api.service[61472]: DEBUG nova.quota [None req-17a25437-0ef8-4b4f-8d43-8104828ae4ee tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Getting quotas for project e58ee4833fd147e2a494be5d7634a2fa. Resources: {'instances', 'ram', 'cores'} {{(pid=61472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 16:43:40 user devstack@n-api.service[61472]: DEBUG nova.quota [None req-17a25437-0ef8-4b4f-8d43-8104828ae4ee tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Getting quotas for user 63f2a02626ca4957823de39c9a31d1b8 and project e58ee4833fd147e2a494be5d7634a2fa. Resources: {'instances', 'ram', 'cores'} {{(pid=61472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 16:43:40 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-17a25437-0ef8-4b4f-8d43-8104828ae4ee tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Going to run 1 instances... {{(pid=61472) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 16:43:40 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-17a25437-0ef8-4b4f-8d43-8104828ae4ee tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] [instance: e22496fe-e437-4dd3-85e1-0310b362554b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ab56c4b1-0117-43b0-84b6-28d06a23f182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 16:43:40 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-17a25437-0ef8-4b4f-8d43-8104828ae4ee tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 1.314440 Apr 19 16:43:40 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 109/333] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 19 16:43:38 2023] POST /compute/v2.1/servers => generated 378 bytes in 1316 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 19 16:43:40 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:43:40 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:43:40 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-96e790cb-dc4c-4b90-8114-6259c7cb80e0 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:43:40 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-96e790cb-dc4c-4b90-8114-6259c7cb80e0 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] [instance: e22496fe-e437-4dd3-85e1-0310b362554b] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:43:40 user devstack@n-api.service[61473]: DEBUG nova.policy [None req-96e790cb-dc4c-4b90-8114-6259c7cb80e0 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f2a02626ca4957823de39c9a31d1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ee4833fd147e2a494be5d7634a2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61473) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:43:40 user devstack@n-api.service[61473]: DEBUG nova.policy [None req-96e790cb-dc4c-4b90-8114-6259c7cb80e0 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63f2a02626ca4957823de39c9a31d1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ee4833fd147e2a494be5d7634a2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61473) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:43:40 user devstack@n-api.service[61473]: DEBUG nova.policy [None req-96e790cb-dc4c-4b90-8114-6259c7cb80e0 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63f2a02626ca4957823de39c9a31d1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ee4833fd147e2a494be5d7634a2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61473) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:43:40 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-96e790cb-dc4c-4b90-8114-6259c7cb80e0 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e22496fe-e437-4dd3-85e1-0310b362554b" status: 200 len: 1395 microversion: 2.87 time: 0.213252 Apr 19 16:43:40 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 114/334] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 16:43:40 2023] GET /compute/v2.1/servers/e22496fe-e437-4dd3-85e1-0310b362554b => generated 1395 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 16:43:42 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_api:SELECT=6 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:43:42 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell1:SELECT=6 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:43:43 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [req-88aa1ae9-a67c-4da3-bdda-3e610b994861 req-54353715-5dbf-4dd7-b569-012dbb5dfe17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e22496fe-e437-4dd3-85e1-0310b362554b", "tag": "820844f7-5573-4306-a7fa-52de437189ac"}]} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:43:43 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-88aa1ae9-a67c-4da3-bdda-3e610b994861 req-54353715-5dbf-4dd7-b569-012dbb5dfe17 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:43:43 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-88aa1ae9-a67c-4da3-bdda-3e610b994861 req-54353715-5dbf-4dd7-b569-012dbb5dfe17 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:43:43 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-88aa1ae9-a67c-4da3-bdda-3e610b994861 req-54353715-5dbf-4dd7-b569-012dbb5dfe17 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:43:43 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-88aa1ae9-a67c-4da3-bdda-3e610b994861 req-54353715-5dbf-4dd7-b569-012dbb5dfe17 service nova] Creating event network-changed:820844f7-5573-4306-a7fa-52de437189ac for instance e22496fe-e437-4dd3-85e1-0310b362554b on user Apr 19 16:43:43 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [req-88aa1ae9-a67c-4da3-bdda-3e610b994861 req-54353715-5dbf-4dd7-b569-012dbb5dfe17 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.216686 Apr 19 16:43:43 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 112/335] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:43:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:43:43 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-e1797e07-60cf-4735-b5ec-4717b405bf3f tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:43:43 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-e1797e07-60cf-4735-b5ec-4717b405bf3f tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] [instance: edd2688e-940e-4ab3-b27c-b6d4aab3efc5] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:43:43 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-e1797e07-60cf-4735-b5ec-4717b405bf3f tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:43:43 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-e1797e07-60cf-4735-b5ec-4717b405bf3f tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:43:43 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-e1797e07-60cf-4735-b5ec-4717b405bf3f tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:43:43 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-e1797e07-60cf-4735-b5ec-4717b405bf3f tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:43:43 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-e1797e07-60cf-4735-b5ec-4717b405bf3f tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:43:43 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-e1797e07-60cf-4735-b5ec-4717b405bf3f tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:43:43 user devstack@n-api.service[61472]: DEBUG nova.policy [None req-e1797e07-60cf-4735-b5ec-4717b405bf3f tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023314f8cf79430b83c5184d9a54be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78962d13860a4df3a8aa100e2afaca6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61472) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:43:43 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-e1797e07-60cf-4735-b5ec-4717b405bf3f tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] 10.0.0.210 "GET /compute/v2.1/servers/edd2688e-940e-4ab3-b27c-b6d4aab3efc5" status: 200 len: 1659 microversion: 2.1 time: 0.233631 Apr 19 16:43:43 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 110/336] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:43:43 2023] GET /compute/v2.1/servers/edd2688e-940e-4ab3-b27c-b6d4aab3efc5 => generated 1659 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:43:47 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-de6bdf6d-2e53-4534-aa98-c3715ab59366 req-7c2b7baf-a881-4817-bd2e-904a8afe24e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e22496fe-e437-4dd3-85e1-0310b362554b", "name": "network-vif-deleted", "tag": "820844f7-5573-4306-a7fa-52de437189ac"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:43:47 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-de6bdf6d-2e53-4534-aa98-c3715ab59366 req-7c2b7baf-a881-4817-bd2e-904a8afe24e7 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:43:47 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-de6bdf6d-2e53-4534-aa98-c3715ab59366 req-7c2b7baf-a881-4817-bd2e-904a8afe24e7 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:43:47 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-de6bdf6d-2e53-4534-aa98-c3715ab59366 req-7c2b7baf-a881-4817-bd2e-904a8afe24e7 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:43:47 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.compute.server_external_events [req-de6bdf6d-2e53-4534-aa98-c3715ab59366 req-7c2b7baf-a881-4817-bd2e-904a8afe24e7 service nova] Unable to find a host for instance e22496fe-e437-4dd3-85e1-0310b362554b. Dropping event network-vif-deleted {{(pid=61473) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 19 16:43:47 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-de6bdf6d-2e53-4534-aa98-c3715ab59366 req-7c2b7baf-a881-4817-bd2e-904a8afe24e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.030141 Apr 19 16:43:47 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 115/337] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:43:47 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 19 16:44:12 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_api:SELECT=2 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:44:12 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell1:SELECT=2 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:44:12 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-c994374e-36dd-4b62-a7ad-39164eec2b42 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:44:12 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-c994374e-36dd-4b62-a7ad-39164eec2b42 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] [instance: 180bfabe-bb88-4d49-98ed-be76df93d4e1] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:44:12 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-c994374e-36dd-4b62-a7ad-39164eec2b42 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:44:12 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-c994374e-36dd-4b62-a7ad-39164eec2b42 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:44:12 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-c994374e-36dd-4b62-a7ad-39164eec2b42 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:44:12 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-c994374e-36dd-4b62-a7ad-39164eec2b42 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:44:12 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-c994374e-36dd-4b62-a7ad-39164eec2b42 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:44:12 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-c994374e-36dd-4b62-a7ad-39164eec2b42 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:44:12 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-c994374e-36dd-4b62-a7ad-39164eec2b42 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/180bfabe-bb88-4d49-98ed-be76df93d4e1/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.329714 Apr 19 16:44:12 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 113/338] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 16:44:12 2023] GET /compute/v2.1/servers/180bfabe-bb88-4d49-98ed-be76df93d4e1/os-interface => generated 282 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:44:13 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [req-8f6f17f5-e59b-417f-956e-7ed911b821ee req-40bbda24-38f1-4258-8d6a-74dc4b131e5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "180bfabe-bb88-4d49-98ed-be76df93d4e1", "tag": "0b670fd3-432a-4381-8275-1cb632b18aaa"}]} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:44:13 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell0:SELECT=2 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:44:13 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell0:SELECT=6 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:44:13 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:44:13 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell1:SELECT=8 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:44:13 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-8f6f17f5-e59b-417f-956e-7ed911b821ee req-40bbda24-38f1-4258-8d6a-74dc4b131e5b service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:44:13 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-8f6f17f5-e59b-417f-956e-7ed911b821ee req-40bbda24-38f1-4258-8d6a-74dc4b131e5b service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:44:13 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-8f6f17f5-e59b-417f-956e-7ed911b821ee req-40bbda24-38f1-4258-8d6a-74dc4b131e5b service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:44:13 user devstack@n-api.service[61472]: INFO nova.api.openstack.compute.server_external_events [req-8f6f17f5-e59b-417f-956e-7ed911b821ee req-40bbda24-38f1-4258-8d6a-74dc4b131e5b service nova] Creating event network-changed:0b670fd3-432a-4381-8275-1cb632b18aaa for instance 180bfabe-bb88-4d49-98ed-be76df93d4e1 on user Apr 19 16:44:13 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [req-8f6f17f5-e59b-417f-956e-7ed911b821ee req-40bbda24-38f1-4258-8d6a-74dc4b131e5b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037415 Apr 19 16:44:13 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 111/339] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:44:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 16:44:13 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell0:SELECT=2 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:44:13 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_api:SELECT=8 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:44:13 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell1:SELECT=2 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:44:13 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-c2d5be11-eeba-46c5-8c19-ae8627296d2c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:44:13 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-c2d5be11-eeba-46c5-8c19-ae8627296d2c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] [instance: 180bfabe-bb88-4d49-98ed-be76df93d4e1] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:44:13 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-c2d5be11-eeba-46c5-8c19-ae8627296d2c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:44:13 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-c2d5be11-eeba-46c5-8c19-ae8627296d2c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:44:13 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-c2d5be11-eeba-46c5-8c19-ae8627296d2c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:44:13 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-c2d5be11-eeba-46c5-8c19-ae8627296d2c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:44:13 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-c2d5be11-eeba-46c5-8c19-ae8627296d2c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:44:13 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-c2d5be11-eeba-46c5-8c19-ae8627296d2c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:44:13 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-c2d5be11-eeba-46c5-8c19-ae8627296d2c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/180bfabe-bb88-4d49-98ed-be76df93d4e1/ips" status: 200 len: 104 microversion: 2.1 time: 0.043100 Apr 19 16:44:13 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 116/340] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 19 16:44:13 2023] GET /compute/v2.1/servers/180bfabe-bb88-4d49-98ed-be76df93d4e1/ips => generated 104 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:44:14 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-fad7578f-92dd-4b60-bb18-07e2056ae476 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:44:14 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-fad7578f-92dd-4b60-bb18-07e2056ae476 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] [instance: 180bfabe-bb88-4d49-98ed-be76df93d4e1] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:44:14 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-fad7578f-92dd-4b60-bb18-07e2056ae476 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:44:14 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-fad7578f-92dd-4b60-bb18-07e2056ae476 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:44:14 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-fad7578f-92dd-4b60-bb18-07e2056ae476 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:44:14 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-fad7578f-92dd-4b60-bb18-07e2056ae476 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:44:14 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-fad7578f-92dd-4b60-bb18-07e2056ae476 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:44:14 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-fad7578f-92dd-4b60-bb18-07e2056ae476 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:44:14 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-fad7578f-92dd-4b60-bb18-07e2056ae476 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] [instance: 180bfabe-bb88-4d49-98ed-be76df93d4e1] Going to try to terminate instance {{(pid=61471) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 16:44:14 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-fad7578f-92dd-4b60-bb18-07e2056ae476 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/180bfabe-bb88-4d49-98ed-be76df93d4e1" status: 204 len: 0 microversion: 2.1 time: 0.117351 Apr 19 16:44:14 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 114/341] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 16:44:14 2023] DELETE /compute/v2.1/servers/180bfabe-bb88-4d49-98ed-be76df93d4e1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 16:44:14 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-1095bdb8-714f-401f-b92d-61c1deec27f5 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:44:14 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-1095bdb8-714f-401f-b92d-61c1deec27f5 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] [instance: 180bfabe-bb88-4d49-98ed-be76df93d4e1] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:44:14 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-1095bdb8-714f-401f-b92d-61c1deec27f5 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:44:14 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-1095bdb8-714f-401f-b92d-61c1deec27f5 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:44:14 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-1095bdb8-714f-401f-b92d-61c1deec27f5 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:44:14 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-1095bdb8-714f-401f-b92d-61c1deec27f5 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:44:14 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-1095bdb8-714f-401f-b92d-61c1deec27f5 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:44:14 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-1095bdb8-714f-401f-b92d-61c1deec27f5 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:44:15 user devstack@n-api.service[61472]: DEBUG nova.policy [None req-1095bdb8-714f-401f-b92d-61c1deec27f5 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3934da35244b148d5fa8c56152a1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e6dbe3c46740f3b6d7a0618e076583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61472) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:44:15 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-1095bdb8-714f-401f-b92d-61c1deec27f5 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/180bfabe-bb88-4d49-98ed-be76df93d4e1" status: 200 len: 1660 microversion: 2.1 time: 0.372820 Apr 19 16:44:15 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 112/342] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:44:14 2023] GET /compute/v2.1/servers/180bfabe-bb88-4d49-98ed-be76df93d4e1 => generated 1660 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:44:15 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-e402f12f-a7d9-4966-b6f3-3f7b3ac483f2 req-66de9eb3-488a-4fb3-a7cd-b280322aa542 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "180bfabe-bb88-4d49-98ed-be76df93d4e1", "name": "network-vif-unplugged", "status": "completed", "tag": "0b670fd3-432a-4381-8275-1cb632b18aaa"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:44:15 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-e402f12f-a7d9-4966-b6f3-3f7b3ac483f2 req-66de9eb3-488a-4fb3-a7cd-b280322aa542 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:44:15 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-e402f12f-a7d9-4966-b6f3-3f7b3ac483f2 req-66de9eb3-488a-4fb3-a7cd-b280322aa542 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:44:15 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-e402f12f-a7d9-4966-b6f3-3f7b3ac483f2 req-66de9eb3-488a-4fb3-a7cd-b280322aa542 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:44:15 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-e402f12f-a7d9-4966-b6f3-3f7b3ac483f2 req-66de9eb3-488a-4fb3-a7cd-b280322aa542 service nova] Creating event network-vif-unplugged:0b670fd3-432a-4381-8275-1cb632b18aaa for instance 180bfabe-bb88-4d49-98ed-be76df93d4e1 on user Apr 19 16:44:15 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-e402f12f-a7d9-4966-b6f3-3f7b3ac483f2 req-66de9eb3-488a-4fb3-a7cd-b280322aa542 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.201961 Apr 19 16:44:15 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 117/343] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:44:15 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:44:16 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-ca1db986-4dd6-416d-a1c7-3ac96c8fa4d1 tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:44:16 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-ca1db986-4dd6-416d-a1c7-3ac96c8fa4d1 tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] [instance: adacc1e4-5ebd-4feb-8dcf-84689765bf54] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:44:16 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-ca1db986-4dd6-416d-a1c7-3ac96c8fa4d1 tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:44:16 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-ca1db986-4dd6-416d-a1c7-3ac96c8fa4d1 tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:44:16 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-ca1db986-4dd6-416d-a1c7-3ac96c8fa4d1 tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:44:16 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-ca1db986-4dd6-416d-a1c7-3ac96c8fa4d1 tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:44:16 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-ca1db986-4dd6-416d-a1c7-3ac96c8fa4d1 tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:44:16 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-ca1db986-4dd6-416d-a1c7-3ac96c8fa4d1 tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:44:16 user devstack@n-api.service[61471]: INFO nova.api.openstack.wsgi [None req-ca1db986-4dd6-416d-a1c7-3ac96c8fa4d1 tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] HTTP exception thrown: Instance adacc1e4-5ebd-4feb-8dcf-84689765bf54 could not be found. Apr 19 16:44:16 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-ca1db986-4dd6-416d-a1c7-3ac96c8fa4d1 tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Request method failure captured: Apr 19 16:44:16 user devstack@n-api.service[61471]: request: GET /compute/v2.1/servers/adacc1e4-5ebd-4feb-8dcf-84689765bf54 HTTP/1.1 Apr 19 16:44:16 user devstack@n-api.service[61471]: Accept: application/json Apr 19 16:44:16 user devstack@n-api.service[61471]: Accept-Encoding: identity Apr 19 16:44:16 user devstack@n-api.service[61471]: Connection: close Apr 19 16:44:16 user devstack@n-api.service[61471]: Content-Length: 0 Apr 19 16:44:16 user devstack@n-api.service[61471]: Content-Type: application/json Apr 19 16:44:16 user devstack@n-api.service[61471]: Host: 10.0.0.210 Apr 19 16:44:16 user devstack@n-api.service[61471]: Openstack-System-Scope: None Apr 19 16:44:16 user devstack@n-api.service[61471]: User-Agent: python-urllib3/1.26.15 Apr 19 16:44:16 user devstack@n-api.service[61471]: X-Auth-Token: gAAAAABkQBm6OP5YN-wf4trvBb4RUHGhO_FlrDCwv3tpajVZY7hfzw7bjdJ2MvWOcvnSOopmnmOJNxQ-MoVrTk7vhtW_kx73E-G93OkRNwwXiGBf5rC5EDzUPxDVkz35qcvBeb1RZv8xZrwXMV1vAvLE7YhQY10Tod_XxIDRl1iRMcU_7XCTzM8 Apr 19 16:44:16 user devstack@n-api.service[61471]: X-Domain-Id: None Apr 19 16:44:16 user devstack@n-api.service[61471]: X-Domain-Name: None Apr 19 16:44:16 user devstack@n-api.service[61471]: X-Identity-Status: Confirmed Apr 19 16:44:16 user devstack@n-api.service[61471]: X-Is-Admin-Project: True Apr 19 16:44:16 user devstack@n-api.service[61471]: X-Project-Domain-Id: default Apr 19 16:44:16 user devstack@n-api.service[61471]: X-Project-Domain-Name: Default Apr 19 16:44:16 user devstack@n-api.service[61471]: X-Project-Id: 69b8ca1133fa467f8009125a3fc11583 Apr 19 16:44:16 user devstack@n-api.service[61471]: X-Project-Name: tempest-VolumesActionsTest-554838780 Apr 19 16:44:16 user devstack@n-api.service[61471]: X-Role: member,reader Apr 19 16:44:16 user devstack@n-api.service[61471]: X-Roles: member,reader Apr 19 16:44:16 user devstack@n-api.service[61471]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/69b8ca1133fa467f8009125a3fc11583"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/69b8ca1133fa467f8009125a3fc11583"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/69b8ca1133fa467f8009125a3fc11583"}]}] Apr 19 16:44:16 user devstack@n-api.service[61471]: X-Tenant: tempest-VolumesActionsTest-554838780 Apr 19 16:44:16 user devstack@n-api.service[61471]: X-Tenant-Id: 69b8ca1133fa467f8009125a3fc11583 Apr 19 16:44:16 user devstack@n-api.service[61471]: X-Tenant-Name: tempest-VolumesActionsTest-554838780 Apr 19 16:44:16 user devstack@n-api.service[61471]: X-User: tempest-VolumesActionsTest-554838780-project-member Apr 19 16:44:16 user devstack@n-api.service[61471]: X-User-Domain-Id: default Apr 19 16:44:16 user devstack@n-api.service[61471]: X-User-Domain-Name: Default Apr 19 16:44:16 user devstack@n-api.service[61471]: X-User-Id: ccab14a59c694c948e9942de0928e095 Apr 19 16:44:16 user devstack@n-api.service[61471]: X-User-Name: tempest-VolumesActionsTest-554838780-project-member Apr 19 16:44:16 user devstack@n-api.service[61471]: method: > Apr 19 16:44:16 user devstack@n-api.service[61471]: exception: Instance adacc1e4-5ebd-4feb-8dcf-84689765bf54 could not be found. Apr 19 16:44:16 user devstack@n-api.service[61471]: action_args: {'id': 'adacc1e4-5ebd-4feb-8dcf-84689765bf54'} Apr 19 16:44:16 user devstack@n-api.service[61471]: {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:44:16 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:44:16 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:44:16 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:44:16 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:44:16 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:44:16 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:44:16 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:44:16 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:44:16 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:44:16 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adacc1e4-5ebd-4feb-8dcf-84689765bf54 could not be found. Apr 19 16:44:16 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:44:16 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:44:16 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:44:16 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:44:16 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:44:16 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:44:16 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:44:16 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:44:16 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:44:16 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:44:16 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 16:44:16 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 16:44:16 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:44:16 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:44:16 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:44:16 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:44:16 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adacc1e4-5ebd-4feb-8dcf-84689765bf54 could not be found. Apr 19 16:44:16 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:44:16 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:44:16 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:44:16 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:44:16 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:44:16 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:44:16 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:44:16 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:44:16 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adacc1e4-5ebd-4feb-8dcf-84689765bf54 could not be found. Apr 19 16:44:16 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:44:16 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-ca1db986-4dd6-416d-a1c7-3ac96c8fa4d1 tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] Returning 404 to user: Instance adacc1e4-5ebd-4feb-8dcf-84689765bf54 could not be found. {{(pid=61471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:44:16 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-ca1db986-4dd6-416d-a1c7-3ac96c8fa4d1 tempest-VolumesActionsTest-554838780 tempest-VolumesActionsTest-554838780-project-member] 10.0.0.210 "GET /compute/v2.1/servers/adacc1e4-5ebd-4feb-8dcf-84689765bf54" status: 404 len: 111 microversion: 2.1 time: 0.033752 Apr 19 16:44:16 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 115/344] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:44:16 2023] GET /compute/v2.1/servers/adacc1e4-5ebd-4feb-8dcf-84689765bf54 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 16:44:16 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [req-555439a2-aa52-4043-b14c-587746eef665 req-424c70d3-5f5e-4b85-8e1d-e1da9d8d0998 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "180bfabe-bb88-4d49-98ed-be76df93d4e1", "name": "network-vif-deleted", "tag": "0b670fd3-432a-4381-8275-1cb632b18aaa"}]} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:44:16 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-555439a2-aa52-4043-b14c-587746eef665 req-424c70d3-5f5e-4b85-8e1d-e1da9d8d0998 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:44:16 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-555439a2-aa52-4043-b14c-587746eef665 req-424c70d3-5f5e-4b85-8e1d-e1da9d8d0998 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:44:16 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-555439a2-aa52-4043-b14c-587746eef665 req-424c70d3-5f5e-4b85-8e1d-e1da9d8d0998 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:44:16 user devstack@n-api.service[61472]: INFO nova.api.openstack.compute.server_external_events [req-555439a2-aa52-4043-b14c-587746eef665 req-424c70d3-5f5e-4b85-8e1d-e1da9d8d0998 service nova] Creating event network-vif-deleted:0b670fd3-432a-4381-8275-1cb632b18aaa for instance 180bfabe-bb88-4d49-98ed-be76df93d4e1 on user Apr 19 16:44:16 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [req-555439a2-aa52-4043-b14c-587746eef665 req-424c70d3-5f5e-4b85-8e1d-e1da9d8d0998 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027725 Apr 19 16:44:16 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 113/345] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:44:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:44:17 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-ccf93949-d15c-471e-b9c1-fb67e5d9f59c req-72cb0639-dda6-4049-b8c1-a4540a23e092 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "180bfabe-bb88-4d49-98ed-be76df93d4e1", "name": "network-vif-plugged", "status": "completed", "tag": "0b670fd3-432a-4381-8275-1cb632b18aaa"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:44:17 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-ccf93949-d15c-471e-b9c1-fb67e5d9f59c req-72cb0639-dda6-4049-b8c1-a4540a23e092 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:44:17 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-ccf93949-d15c-471e-b9c1-fb67e5d9f59c req-72cb0639-dda6-4049-b8c1-a4540a23e092 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:44:17 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-ccf93949-d15c-471e-b9c1-fb67e5d9f59c req-72cb0639-dda6-4049-b8c1-a4540a23e092 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:44:17 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-ccf93949-d15c-471e-b9c1-fb67e5d9f59c req-72cb0639-dda6-4049-b8c1-a4540a23e092 service nova] Creating event network-vif-plugged:0b670fd3-432a-4381-8275-1cb632b18aaa for instance 180bfabe-bb88-4d49-98ed-be76df93d4e1 on user Apr 19 16:44:17 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-ccf93949-d15c-471e-b9c1-fb67e5d9f59c req-72cb0639-dda6-4049-b8c1-a4540a23e092 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029179 Apr 19 16:44:17 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 118/346] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:44:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:44:30 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-9b0ca6d1-e81b-4fc8-b4f4-91f2d98e2d1c tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:44:30 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-9b0ca6d1-e81b-4fc8-b4f4-91f2d98e2d1c tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] [instance: e22496fe-e437-4dd3-85e1-0310b362554b] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:44:30 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:44:30 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:44:30 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-9b0ca6d1-e81b-4fc8-b4f4-91f2d98e2d1c tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:44:30 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-9b0ca6d1-e81b-4fc8-b4f4-91f2d98e2d1c tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:44:30 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-9b0ca6d1-e81b-4fc8-b4f4-91f2d98e2d1c tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:44:30 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-9b0ca6d1-e81b-4fc8-b4f4-91f2d98e2d1c tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:44:30 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-9b0ca6d1-e81b-4fc8-b4f4-91f2d98e2d1c tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:44:30 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-9b0ca6d1-e81b-4fc8-b4f4-91f2d98e2d1c tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:44:30 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-9b0ca6d1-e81b-4fc8-b4f4-91f2d98e2d1c tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:44:30 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-9b0ca6d1-e81b-4fc8-b4f4-91f2d98e2d1c tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:44:30 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-9b0ca6d1-e81b-4fc8-b4f4-91f2d98e2d1c tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:44:30 user devstack@n-api.service[61471]: DEBUG nova.objects.instance [None req-9b0ca6d1-e81b-4fc8-b4f4-91f2d98e2d1c tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lazy-loading 'fault' on Instance uuid e22496fe-e437-4dd3-85e1-0310b362554b {{(pid=61471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 19 16:44:30 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-9b0ca6d1-e81b-4fc8-b4f4-91f2d98e2d1c tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f2a02626ca4957823de39c9a31d1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ee4833fd147e2a494be5d7634a2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:44:30 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-9b0ca6d1-e81b-4fc8-b4f4-91f2d98e2d1c tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63f2a02626ca4957823de39c9a31d1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ee4833fd147e2a494be5d7634a2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:44:30 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-9b0ca6d1-e81b-4fc8-b4f4-91f2d98e2d1c tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63f2a02626ca4957823de39c9a31d1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ee4833fd147e2a494be5d7634a2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:44:30 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-9b0ca6d1-e81b-4fc8-b4f4-91f2d98e2d1c tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e22496fe-e437-4dd3-85e1-0310b362554b" status: 200 len: 1650 microversion: 2.87 time: 0.130603 Apr 19 16:44:30 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 116/347] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 16:44:30 2023] GET /compute/v2.1/servers/e22496fe-e437-4dd3-85e1-0310b362554b => generated 1650 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 16:44:30 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_api:SELECT=6 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:44:30 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell1:SELECT=10 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:44:30 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-3981980e-9c7c-4349-8bc4-089cd73e5c2e tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:44:30 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-3981980e-9c7c-4349-8bc4-089cd73e5c2e tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] [instance: e22496fe-e437-4dd3-85e1-0310b362554b] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:44:30 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-3981980e-9c7c-4349-8bc4-089cd73e5c2e tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:44:30 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-3981980e-9c7c-4349-8bc4-089cd73e5c2e tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:44:30 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-3981980e-9c7c-4349-8bc4-089cd73e5c2e tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:44:30 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-3981980e-9c7c-4349-8bc4-089cd73e5c2e tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:44:30 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-3981980e-9c7c-4349-8bc4-089cd73e5c2e tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:44:30 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-3981980e-9c7c-4349-8bc4-089cd73e5c2e tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:44:30 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-3981980e-9c7c-4349-8bc4-089cd73e5c2e tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] [instance: e22496fe-e437-4dd3-85e1-0310b362554b] Going to try to terminate instance {{(pid=61472) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 16:44:30 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-3981980e-9c7c-4349-8bc4-089cd73e5c2e tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] [instance: e22496fe-e437-4dd3-85e1-0310b362554b] Doing local delete in cell 529680e7-3be5-45cb-be5e-d097b6f534fd(cell1) {{(pid=61472) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 19 16:44:30 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-3981980e-9c7c-4349-8bc4-089cd73e5c2e tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:44:30 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-3981980e-9c7c-4349-8bc4-089cd73e5c2e tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:44:30 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-3981980e-9c7c-4349-8bc4-089cd73e5c2e tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:44:30 user devstack@n-api.service[61472]: WARNING nova.compute.api [None req-3981980e-9c7c-4349-8bc4-089cd73e5c2e tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] [instance: e22496fe-e437-4dd3-85e1-0310b362554b] instance's host None is down, deleting from database Apr 19 16:44:30 user devstack@n-api.service[61472]: DEBUG nova.network.neutron [None req-3981980e-9c7c-4349-8bc4-089cd73e5c2e tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] [instance: e22496fe-e437-4dd3-85e1-0310b362554b] deallocate_for_instance() {{(pid=61472) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 19 16:44:30 user devstack@n-api.service[61472]: DEBUG nova.network.neutron [None req-3981980e-9c7c-4349-8bc4-089cd73e5c2e tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] [instance: e22496fe-e437-4dd3-85e1-0310b362554b] Instance cache missing network info. {{(pid=61472) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 19 16:44:30 user devstack@n-api.service[61472]: DEBUG nova.network.neutron [None req-3981980e-9c7c-4349-8bc4-089cd73e5c2e tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] [instance: e22496fe-e437-4dd3-85e1-0310b362554b] Updating instance_info_cache with network_info: [] {{(pid=61472) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 19 16:44:30 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-3981980e-9c7c-4349-8bc4-089cd73e5c2e tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] [instance: e22496fe-e437-4dd3-85e1-0310b362554b] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61472) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 19 16:44:30 user devstack@n-api.service[61472]: WARNING nova.compute.api [None req-3981980e-9c7c-4349-8bc4-089cd73e5c2e tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] [instance: e22496fe-e437-4dd3-85e1-0310b362554b] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 19 16:44:31 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-3981980e-9c7c-4349-8bc4-089cd73e5c2e tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e22496fe-e437-4dd3-85e1-0310b362554b" status: 204 len: 0 microversion: 2.87 time: 0.549881 Apr 19 16:44:31 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 114/348] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 19 16:44:30 2023] DELETE /compute/v2.1/servers/e22496fe-e437-4dd3-85e1-0310b362554b => generated 0 bytes in 552 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 19 16:44:31 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_api:SELECT=6 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:44:31 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell1:SELECT=8 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:44:31 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-91e2f3d1-e56f-4828-a27a-c9d157f52b54 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:44:31 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-91e2f3d1-e56f-4828-a27a-c9d157f52b54 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] [instance: e22496fe-e437-4dd3-85e1-0310b362554b] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:44:31 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-91e2f3d1-e56f-4828-a27a-c9d157f52b54 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:44:31 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-91e2f3d1-e56f-4828-a27a-c9d157f52b54 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:44:31 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-91e2f3d1-e56f-4828-a27a-c9d157f52b54 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:44:31 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-91e2f3d1-e56f-4828-a27a-c9d157f52b54 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:44:31 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-91e2f3d1-e56f-4828-a27a-c9d157f52b54 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:44:31 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-91e2f3d1-e56f-4828-a27a-c9d157f52b54 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:44:31 user devstack@n-api.service[61473]: INFO nova.api.openstack.wsgi [None req-91e2f3d1-e56f-4828-a27a-c9d157f52b54 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] HTTP exception thrown: Instance e22496fe-e437-4dd3-85e1-0310b362554b could not be found. Apr 19 16:44:31 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-91e2f3d1-e56f-4828-a27a-c9d157f52b54 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Request method failure captured: Apr 19 16:44:31 user devstack@n-api.service[61473]: request: GET /compute/v2.1/servers/e22496fe-e437-4dd3-85e1-0310b362554b HTTP/1.1 Apr 19 16:44:31 user devstack@n-api.service[61473]: Accept: application/json Apr 19 16:44:31 user devstack@n-api.service[61473]: Accept-Encoding: identity Apr 19 16:44:31 user devstack@n-api.service[61473]: Connection: close Apr 19 16:44:31 user devstack@n-api.service[61473]: Content-Length: 0 Apr 19 16:44:31 user devstack@n-api.service[61473]: Content-Type: application/json Apr 19 16:44:31 user devstack@n-api.service[61473]: Host: 10.0.0.210 Apr 19 16:44:31 user devstack@n-api.service[61473]: Openstack-System-Scope: None Apr 19 16:44:31 user devstack@n-api.service[61473]: User-Agent: python-urllib3/1.26.15 Apr 19 16:44:31 user devstack@n-api.service[61473]: X-Auth-Token: gAAAAABkQBijykh3S2adH6umevG9TAoFxyN59y4R4BBewsH_kL5fmZak3LoVbATytpojLreFD5t3R4GbFybNCRMdj8zC0Vm3JiC5xHMewyKnRzsZImcv1C_pNgiZvAvFgLtqKepdjPT0GfgbgohTtEJgnPvWu7GRPBx2c9KLd4GIKwjjadzvR7M Apr 19 16:44:31 user devstack@n-api.service[61473]: X-Domain-Id: None Apr 19 16:44:31 user devstack@n-api.service[61473]: X-Domain-Name: None Apr 19 16:44:31 user devstack@n-api.service[61473]: X-Identity-Status: Confirmed Apr 19 16:44:31 user devstack@n-api.service[61473]: X-Is-Admin-Project: True Apr 19 16:44:31 user devstack@n-api.service[61473]: X-Openstack-Nova-Api-Version: 2.87 Apr 19 16:44:31 user devstack@n-api.service[61473]: X-Project-Domain-Id: default Apr 19 16:44:31 user devstack@n-api.service[61473]: X-Project-Domain-Name: Default Apr 19 16:44:31 user devstack@n-api.service[61473]: X-Project-Id: e58ee4833fd147e2a494be5d7634a2fa Apr 19 16:44:31 user devstack@n-api.service[61473]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-847899299 Apr 19 16:44:31 user devstack@n-api.service[61473]: X-Role: member,reader Apr 19 16:44:31 user devstack@n-api.service[61473]: X-Roles: member,reader Apr 19 16:44:31 user devstack@n-api.service[61473]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e58ee4833fd147e2a494be5d7634a2fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e58ee4833fd147e2a494be5d7634a2fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e58ee4833fd147e2a494be5d7634a2fa"}]}] Apr 19 16:44:31 user devstack@n-api.service[61473]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-847899299 Apr 19 16:44:31 user devstack@n-api.service[61473]: X-Tenant-Id: e58ee4833fd147e2a494be5d7634a2fa Apr 19 16:44:31 user devstack@n-api.service[61473]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-847899299 Apr 19 16:44:31 user devstack@n-api.service[61473]: X-User: tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member Apr 19 16:44:31 user devstack@n-api.service[61473]: X-User-Domain-Id: default Apr 19 16:44:31 user devstack@n-api.service[61473]: X-User-Domain-Name: Default Apr 19 16:44:31 user devstack@n-api.service[61473]: X-User-Id: 63f2a02626ca4957823de39c9a31d1b8 Apr 19 16:44:31 user devstack@n-api.service[61473]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member Apr 19 16:44:31 user devstack@n-api.service[61473]: method: > Apr 19 16:44:31 user devstack@n-api.service[61473]: exception: Instance e22496fe-e437-4dd3-85e1-0310b362554b could not be found. Apr 19 16:44:31 user devstack@n-api.service[61473]: action_args: {'id': 'e22496fe-e437-4dd3-85e1-0310b362554b'} Apr 19 16:44:31 user devstack@n-api.service[61473]: {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:44:31 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:44:31 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:44:31 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:44:31 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:44:31 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:44:31 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:44:31 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:44:31 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:44:31 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:44:31 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e22496fe-e437-4dd3-85e1-0310b362554b could not be found. Apr 19 16:44:31 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:44:31 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:44:31 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:44:31 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:44:31 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:44:31 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:44:31 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:44:31 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:44:31 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:44:31 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:44:31 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 16:44:31 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 16:44:31 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:44:31 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:44:31 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:44:31 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:44:31 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e22496fe-e437-4dd3-85e1-0310b362554b could not be found. Apr 19 16:44:31 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:44:31 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:44:31 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:44:31 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:44:31 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:44:31 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:44:31 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:44:31 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:44:31 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e22496fe-e437-4dd3-85e1-0310b362554b could not be found. Apr 19 16:44:31 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:44:31 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-91e2f3d1-e56f-4828-a27a-c9d157f52b54 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Returning 404 to user: Instance e22496fe-e437-4dd3-85e1-0310b362554b could not be found. {{(pid=61473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:44:31 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-91e2f3d1-e56f-4828-a27a-c9d157f52b54 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e22496fe-e437-4dd3-85e1-0310b362554b" status: 404 len: 111 microversion: 2.87 time: 0.033765 Apr 19 16:44:31 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 119/349] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 16:44:31 2023] GET /compute/v2.1/servers/e22496fe-e437-4dd3-85e1-0310b362554b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 16:44:31 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-f0538430-9872-486f-abeb-b085a8295082 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:44:31 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-f0538430-9872-486f-abeb-b085a8295082 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] [instance: 4bca7be9-c7ba-4c5a-9860-bf516f174865] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:44:31 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-f0538430-9872-486f-abeb-b085a8295082 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:44:31 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-f0538430-9872-486f-abeb-b085a8295082 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:44:31 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-f0538430-9872-486f-abeb-b085a8295082 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:44:31 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-f0538430-9872-486f-abeb-b085a8295082 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:44:31 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-f0538430-9872-486f-abeb-b085a8295082 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:44:31 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-f0538430-9872-486f-abeb-b085a8295082 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:44:31 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-f0538430-9872-486f-abeb-b085a8295082 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] [instance: 4bca7be9-c7ba-4c5a-9860-bf516f174865] Going to try to terminate instance {{(pid=61471) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 16:44:31 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-f0538430-9872-486f-abeb-b085a8295082 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4bca7be9-c7ba-4c5a-9860-bf516f174865" status: 204 len: 0 microversion: 2.87 time: 0.107354 Apr 19 16:44:31 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 117/350] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 19 16:44:31 2023] DELETE /compute/v2.1/servers/4bca7be9-c7ba-4c5a-9860-bf516f174865 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 19 16:44:31 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-2990ecaa-728a-49e5-9d84-c9d4e4abafe2 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:44:31 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-2990ecaa-728a-49e5-9d84-c9d4e4abafe2 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] [instance: 4bca7be9-c7ba-4c5a-9860-bf516f174865] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:44:31 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-2990ecaa-728a-49e5-9d84-c9d4e4abafe2 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:44:31 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-2990ecaa-728a-49e5-9d84-c9d4e4abafe2 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:44:31 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-2990ecaa-728a-49e5-9d84-c9d4e4abafe2 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:44:31 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-2990ecaa-728a-49e5-9d84-c9d4e4abafe2 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:44:31 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-2990ecaa-728a-49e5-9d84-c9d4e4abafe2 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:44:31 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-2990ecaa-728a-49e5-9d84-c9d4e4abafe2 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:44:31 user devstack@n-api.service[61472]: DEBUG nova.policy [None req-2990ecaa-728a-49e5-9d84-c9d4e4abafe2 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f2a02626ca4957823de39c9a31d1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ee4833fd147e2a494be5d7634a2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61472) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:44:31 user devstack@n-api.service[61472]: DEBUG nova.policy [None req-2990ecaa-728a-49e5-9d84-c9d4e4abafe2 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63f2a02626ca4957823de39c9a31d1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ee4833fd147e2a494be5d7634a2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61472) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:44:31 user devstack@n-api.service[61472]: DEBUG nova.policy [None req-2990ecaa-728a-49e5-9d84-c9d4e4abafe2 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63f2a02626ca4957823de39c9a31d1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ee4833fd147e2a494be5d7634a2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61472) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:44:31 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-2990ecaa-728a-49e5-9d84-c9d4e4abafe2 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4bca7be9-c7ba-4c5a-9860-bf516f174865" status: 200 len: 1696 microversion: 2.87 time: 0.325394 Apr 19 16:44:31 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 115/351] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 16:44:31 2023] GET /compute/v2.1/servers/4bca7be9-c7ba-4c5a-9860-bf516f174865 => generated 1696 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 16:44:31 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-214266b5-372b-4c33-87f3-e2174562f7f9 req-35c6f962-90cf-4115-af7c-d232d771c9c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bca7be9-c7ba-4c5a-9860-bf516f174865", "name": "network-vif-unplugged", "status": "completed", "tag": "3b89e9db-a95a-4407-b2ed-681d9e5854e6"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:44:31 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-214266b5-372b-4c33-87f3-e2174562f7f9 req-35c6f962-90cf-4115-af7c-d232d771c9c9 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:44:31 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-214266b5-372b-4c33-87f3-e2174562f7f9 req-35c6f962-90cf-4115-af7c-d232d771c9c9 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:44:31 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-214266b5-372b-4c33-87f3-e2174562f7f9 req-35c6f962-90cf-4115-af7c-d232d771c9c9 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:44:31 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-214266b5-372b-4c33-87f3-e2174562f7f9 req-35c6f962-90cf-4115-af7c-d232d771c9c9 service nova] Creating event network-vif-unplugged:3b89e9db-a95a-4407-b2ed-681d9e5854e6 for instance 4bca7be9-c7ba-4c5a-9860-bf516f174865 on user Apr 19 16:44:32 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-214266b5-372b-4c33-87f3-e2174562f7f9 req-35c6f962-90cf-4115-af7c-d232d771c9c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030194 Apr 19 16:44:32 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 120/352] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:44:31 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:44:33 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [req-dd0a8e7b-b439-4305-94c3-995d33d7d427 req-b236126c-5161-4be7-8dcc-7894c6bda5ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bca7be9-c7ba-4c5a-9860-bf516f174865", "name": "network-vif-deleted", "tag": "3b89e9db-a95a-4407-b2ed-681d9e5854e6"}]} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:44:33 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-dd0a8e7b-b439-4305-94c3-995d33d7d427 req-b236126c-5161-4be7-8dcc-7894c6bda5ec service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:44:33 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-dd0a8e7b-b439-4305-94c3-995d33d7d427 req-b236126c-5161-4be7-8dcc-7894c6bda5ec service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:44:33 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-dd0a8e7b-b439-4305-94c3-995d33d7d427 req-b236126c-5161-4be7-8dcc-7894c6bda5ec service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:44:33 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-dd0a8e7b-b439-4305-94c3-995d33d7d427 req-b236126c-5161-4be7-8dcc-7894c6bda5ec service nova] Creating event network-vif-deleted:3b89e9db-a95a-4407-b2ed-681d9e5854e6 for instance 4bca7be9-c7ba-4c5a-9860-bf516f174865 on user Apr 19 16:44:33 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [req-dd0a8e7b-b439-4305-94c3-995d33d7d427 req-b236126c-5161-4be7-8dcc-7894c6bda5ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031434 Apr 19 16:44:33 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 118/353] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:44:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:44:34 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [req-6fce2949-9032-4b50-9f8c-4d9fbb144c90 req-5698fb5f-5a8b-4570-b550-7b7046cebcbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bca7be9-c7ba-4c5a-9860-bf516f174865", "name": "network-vif-plugged", "status": "completed", "tag": "3b89e9db-a95a-4407-b2ed-681d9e5854e6"}]} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:44:34 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-6fce2949-9032-4b50-9f8c-4d9fbb144c90 req-5698fb5f-5a8b-4570-b550-7b7046cebcbe service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:44:34 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-6fce2949-9032-4b50-9f8c-4d9fbb144c90 req-5698fb5f-5a8b-4570-b550-7b7046cebcbe service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:44:34 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-6fce2949-9032-4b50-9f8c-4d9fbb144c90 req-5698fb5f-5a8b-4570-b550-7b7046cebcbe service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:44:34 user devstack@n-api.service[61472]: INFO nova.api.openstack.compute.server_external_events [req-6fce2949-9032-4b50-9f8c-4d9fbb144c90 req-5698fb5f-5a8b-4570-b550-7b7046cebcbe service nova] Creating event network-vif-plugged:3b89e9db-a95a-4407-b2ed-681d9e5854e6 for instance 4bca7be9-c7ba-4c5a-9860-bf516f174865 on user Apr 19 16:44:34 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [req-6fce2949-9032-4b50-9f8c-4d9fbb144c90 req-5698fb5f-5a8b-4570-b550-7b7046cebcbe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034390 Apr 19 16:44:34 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 116/354] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:44:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:44:43 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_api:SELECT=4 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:44:43 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell1:SELECT=4 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:44:43 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-d97e6200-b850-4259-b51d-931d24dd6210 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:44:43 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-d97e6200-b850-4259-b51d-931d24dd6210 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] [instance: edd2688e-940e-4ab3-b27c-b6d4aab3efc5] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:44:43 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-d97e6200-b850-4259-b51d-931d24dd6210 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:44:43 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-d97e6200-b850-4259-b51d-931d24dd6210 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:44:43 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-d97e6200-b850-4259-b51d-931d24dd6210 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:44:43 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-d97e6200-b850-4259-b51d-931d24dd6210 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:44:43 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-d97e6200-b850-4259-b51d-931d24dd6210 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:44:43 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-d97e6200-b850-4259-b51d-931d24dd6210 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:44:43 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-d97e6200-b850-4259-b51d-931d24dd6210 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] [instance: edd2688e-940e-4ab3-b27c-b6d4aab3efc5] Going to try to terminate instance {{(pid=61473) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 16:44:44 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-d97e6200-b850-4259-b51d-931d24dd6210 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/edd2688e-940e-4ab3-b27c-b6d4aab3efc5" status: 204 len: 0 microversion: 2.1 time: 0.163277 Apr 19 16:44:44 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 121/355] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 16:44:43 2023] DELETE /compute/v2.1/servers/edd2688e-940e-4ab3-b27c-b6d4aab3efc5 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 16:44:44 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:44:44 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:44:44 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-78ad1e80-f0b1-4525-995a-6ac798c1cb42 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:44:44 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-78ad1e80-f0b1-4525-995a-6ac798c1cb42 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] [instance: edd2688e-940e-4ab3-b27c-b6d4aab3efc5] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:44:44 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-78ad1e80-f0b1-4525-995a-6ac798c1cb42 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:44:44 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-78ad1e80-f0b1-4525-995a-6ac798c1cb42 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:44:44 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-78ad1e80-f0b1-4525-995a-6ac798c1cb42 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:44:44 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-78ad1e80-f0b1-4525-995a-6ac798c1cb42 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:44:44 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-78ad1e80-f0b1-4525-995a-6ac798c1cb42 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:44:44 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-78ad1e80-f0b1-4525-995a-6ac798c1cb42 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:44:44 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-78ad1e80-f0b1-4525-995a-6ac798c1cb42 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023314f8cf79430b83c5184d9a54be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78962d13860a4df3a8aa100e2afaca6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:44:44 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-78ad1e80-f0b1-4525-995a-6ac798c1cb42 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] 10.0.0.210 "GET /compute/v2.1/servers/edd2688e-940e-4ab3-b27c-b6d4aab3efc5" status: 200 len: 1665 microversion: 2.1 time: 0.239280 Apr 19 16:44:44 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 119/356] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:44:44 2023] GET /compute/v2.1/servers/edd2688e-940e-4ab3-b27c-b6d4aab3efc5 => generated 1665 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:44:44 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [req-73f1d030-5f44-4671-ba2d-8bbdb97fc0f2 req-66e3eaf5-3b80-46d0-83a5-4c4f4252858a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edd2688e-940e-4ab3-b27c-b6d4aab3efc5", "name": "network-vif-unplugged", "status": "completed", "tag": "f8192a07-aa51-45e4-b140-3517cb9813d4"}]} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:44:44 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:44:44 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:44:44 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-73f1d030-5f44-4671-ba2d-8bbdb97fc0f2 req-66e3eaf5-3b80-46d0-83a5-4c4f4252858a service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:44:44 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-73f1d030-5f44-4671-ba2d-8bbdb97fc0f2 req-66e3eaf5-3b80-46d0-83a5-4c4f4252858a service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:44:44 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-73f1d030-5f44-4671-ba2d-8bbdb97fc0f2 req-66e3eaf5-3b80-46d0-83a5-4c4f4252858a service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:44:44 user devstack@n-api.service[61472]: INFO nova.api.openstack.compute.server_external_events [req-73f1d030-5f44-4671-ba2d-8bbdb97fc0f2 req-66e3eaf5-3b80-46d0-83a5-4c4f4252858a service nova] Creating event network-vif-unplugged:f8192a07-aa51-45e4-b140-3517cb9813d4 for instance edd2688e-940e-4ab3-b27c-b6d4aab3efc5 on user Apr 19 16:44:44 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [req-73f1d030-5f44-4671-ba2d-8bbdb97fc0f2 req-66e3eaf5-3b80-46d0-83a5-4c4f4252858a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050698 Apr 19 16:44:44 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 117/357] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:44:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:44:46 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-71a2aa8a-4db4-489a-8a6d-3ac64b5c616e req-1b1744a4-20b4-4302-a190-4f27d9681639 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edd2688e-940e-4ab3-b27c-b6d4aab3efc5", "name": "network-vif-plugged", "status": "completed", "tag": "f8192a07-aa51-45e4-b140-3517cb9813d4"}, {"server_uuid": "edd2688e-940e-4ab3-b27c-b6d4aab3efc5", "name": "network-vif-deleted", "tag": "f8192a07-aa51-45e4-b140-3517cb9813d4"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:44:46 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-71a2aa8a-4db4-489a-8a6d-3ac64b5c616e req-1b1744a4-20b4-4302-a190-4f27d9681639 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:44:46 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-71a2aa8a-4db4-489a-8a6d-3ac64b5c616e req-1b1744a4-20b4-4302-a190-4f27d9681639 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:44:46 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-71a2aa8a-4db4-489a-8a6d-3ac64b5c616e req-1b1744a4-20b4-4302-a190-4f27d9681639 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:44:46 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-71a2aa8a-4db4-489a-8a6d-3ac64b5c616e req-1b1744a4-20b4-4302-a190-4f27d9681639 service nova] Creating event network-vif-plugged:f8192a07-aa51-45e4-b140-3517cb9813d4 for instance edd2688e-940e-4ab3-b27c-b6d4aab3efc5 on user Apr 19 16:44:46 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-71a2aa8a-4db4-489a-8a6d-3ac64b5c616e req-1b1744a4-20b4-4302-a190-4f27d9681639 service nova] Creating event network-vif-deleted:f8192a07-aa51-45e4-b140-3517cb9813d4 for instance edd2688e-940e-4ab3-b27c-b6d4aab3efc5 on user Apr 19 16:44:46 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-71a2aa8a-4db4-489a-8a6d-3ac64b5c616e req-1b1744a4-20b4-4302-a190-4f27d9681639 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029210 Apr 19 16:44:46 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 122/358] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:44:46 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:44:50 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-0cbafc56-8517-4019-8602-89cd03e4f0ae tempest-TestVolumeBootPattern-910562612 tempest-TestVolumeBootPattern-910562612-project-member] Action: 'create', calling method: .version_select at 0x7fd4970c6320>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-547264759", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKzibm5j5uwDI1yFbrjrLWLACbg4Ye8YZRq3a/wCS/v9B6fmI8cEBycvUhLCLhbX2rrjkiQIdFj4ZReBMy6K6by09eIXewwMOlVmOZpMEU68lwQNSeT/gwPZ1MntvAO9GQ=="}} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:44:50 user devstack@n-api.service[61471]: DEBUG nova.quota [None req-0cbafc56-8517-4019-8602-89cd03e4f0ae tempest-TestVolumeBootPattern-910562612 tempest-TestVolumeBootPattern-910562612-project-member] Getting quotas for project 19af8d95e35146e3af57a519da4d2a09. Resources: {'key_pairs'} {{(pid=61471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 16:44:50 user devstack@n-api.service[61471]: DEBUG nova.quota [None req-0cbafc56-8517-4019-8602-89cd03e4f0ae tempest-TestVolumeBootPattern-910562612 tempest-TestVolumeBootPattern-910562612-project-member] Getting quotas for user 9dd20f06c6be4447a28f0adb5b7e4e59 and project 19af8d95e35146e3af57a519da4d2a09. Resources: {'key_pairs'} {{(pid=61471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 16:44:50 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-0cbafc56-8517-4019-8602-89cd03e4f0ae tempest-TestVolumeBootPattern-910562612 tempest-TestVolumeBootPattern-910562612-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.048060 Apr 19 16:44:50 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 120/359] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 16:44:50 2023] POST /compute/v2.1/os-keypairs => generated 399 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:44:53 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-749cb34a-9dd2-46a2-84c0-9662c988e51b tempest-TestVolumeBootPattern-910562612 tempest-TestVolumeBootPattern-910562612-project-member] Calling method '.version_select at 0x7fd49710e7a0>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:44:53 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-749cb34a-9dd2-46a2-84c0-9662c988e51b tempest-TestVolumeBootPattern-910562612 tempest-TestVolumeBootPattern-910562612-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-547264759" status: 202 len: 0 microversion: 2.1 time: 0.021641 Apr 19 16:44:53 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 118/360] 10.0.0.210 () {62 vars in 1337 bytes} [Wed Apr 19 16:44:53 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-547264759 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 16:45:05 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:45:05 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:45:05 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-4e604ce0-d0c0-43dc-b315-f0ab7a97a414 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:45:05 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-4e604ce0-d0c0-43dc-b315-f0ab7a97a414 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] [instance: 180bfabe-bb88-4d49-98ed-be76df93d4e1] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:45:05 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-4e604ce0-d0c0-43dc-b315-f0ab7a97a414 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:45:05 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-4e604ce0-d0c0-43dc-b315-f0ab7a97a414 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:45:05 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-4e604ce0-d0c0-43dc-b315-f0ab7a97a414 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:45:05 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-4e604ce0-d0c0-43dc-b315-f0ab7a97a414 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:45:05 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-4e604ce0-d0c0-43dc-b315-f0ab7a97a414 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:45:05 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-4e604ce0-d0c0-43dc-b315-f0ab7a97a414 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:45:05 user devstack@n-api.service[61473]: INFO nova.api.openstack.wsgi [None req-4e604ce0-d0c0-43dc-b315-f0ab7a97a414 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] HTTP exception thrown: Instance 180bfabe-bb88-4d49-98ed-be76df93d4e1 could not be found. Apr 19 16:45:05 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-4e604ce0-d0c0-43dc-b315-f0ab7a97a414 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Request method failure captured: Apr 19 16:45:05 user devstack@n-api.service[61473]: request: GET /compute/v2.1/servers/180bfabe-bb88-4d49-98ed-be76df93d4e1 HTTP/1.1 Apr 19 16:45:05 user devstack@n-api.service[61473]: Accept: application/json Apr 19 16:45:05 user devstack@n-api.service[61473]: Accept-Encoding: identity Apr 19 16:45:05 user devstack@n-api.service[61473]: Connection: close Apr 19 16:45:05 user devstack@n-api.service[61473]: Content-Length: 0 Apr 19 16:45:05 user devstack@n-api.service[61473]: Content-Type: application/json Apr 19 16:45:05 user devstack@n-api.service[61473]: Host: 10.0.0.210 Apr 19 16:45:05 user devstack@n-api.service[61473]: Openstack-System-Scope: None Apr 19 16:45:05 user devstack@n-api.service[61473]: User-Agent: python-urllib3/1.26.15 Apr 19 16:45:05 user devstack@n-api.service[61473]: X-Auth-Token: gAAAAABkQBlDbykaiytEqM6n7azX05ezt87urFSIm2ijRuhoI5U43XuhEECWvLvB6QQEmCwFG3X1VWTVQ5rbsfRlViRz5jOx6aGCSmV9wbSuJSepzPDJPe4E6QZQXbarJ6eQ6J-5LNt-9A82PF6l1yXXDhIlRcYybDExHkVoYjJYXalAWYgU29A Apr 19 16:45:05 user devstack@n-api.service[61473]: X-Domain-Id: None Apr 19 16:45:05 user devstack@n-api.service[61473]: X-Domain-Name: None Apr 19 16:45:05 user devstack@n-api.service[61473]: X-Identity-Status: Confirmed Apr 19 16:45:05 user devstack@n-api.service[61473]: X-Is-Admin-Project: True Apr 19 16:45:05 user devstack@n-api.service[61473]: X-Project-Domain-Id: default Apr 19 16:45:05 user devstack@n-api.service[61473]: X-Project-Domain-Name: Default Apr 19 16:45:05 user devstack@n-api.service[61473]: X-Project-Id: b5e6dbe3c46740f3b6d7a0618e076583 Apr 19 16:45:05 user devstack@n-api.service[61473]: X-Project-Name: tempest-AttachVolumeTestJSON-1317079953 Apr 19 16:45:05 user devstack@n-api.service[61473]: X-Role: member,reader Apr 19 16:45:05 user devstack@n-api.service[61473]: X-Roles: member,reader Apr 19 16:45:05 user devstack@n-api.service[61473]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b5e6dbe3c46740f3b6d7a0618e076583"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b5e6dbe3c46740f3b6d7a0618e076583"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b5e6dbe3c46740f3b6d7a0618e076583"}]}] Apr 19 16:45:05 user devstack@n-api.service[61473]: X-Tenant: tempest-AttachVolumeTestJSON-1317079953 Apr 19 16:45:05 user devstack@n-api.service[61473]: X-Tenant-Id: b5e6dbe3c46740f3b6d7a0618e076583 Apr 19 16:45:05 user devstack@n-api.service[61473]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1317079953 Apr 19 16:45:05 user devstack@n-api.service[61473]: X-User: tempest-AttachVolumeTestJSON-1317079953-project-member Apr 19 16:45:05 user devstack@n-api.service[61473]: X-User-Domain-Id: default Apr 19 16:45:05 user devstack@n-api.service[61473]: X-User-Domain-Name: Default Apr 19 16:45:05 user devstack@n-api.service[61473]: X-User-Id: ce3934da35244b148d5fa8c56152a1f0 Apr 19 16:45:05 user devstack@n-api.service[61473]: X-User-Name: tempest-AttachVolumeTestJSON-1317079953-project-member Apr 19 16:45:05 user devstack@n-api.service[61473]: method: > Apr 19 16:45:05 user devstack@n-api.service[61473]: exception: Instance 180bfabe-bb88-4d49-98ed-be76df93d4e1 could not be found. Apr 19 16:45:05 user devstack@n-api.service[61473]: action_args: {'id': '180bfabe-bb88-4d49-98ed-be76df93d4e1'} Apr 19 16:45:05 user devstack@n-api.service[61473]: {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:45:05 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:45:05 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:45:05 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:45:05 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:45:05 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:45:05 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:45:05 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:45:05 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:45:05 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:45:05 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 180bfabe-bb88-4d49-98ed-be76df93d4e1 could not be found. Apr 19 16:45:05 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:45:05 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:45:05 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:45:05 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:45:05 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:45:05 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:45:05 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:45:05 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:45:05 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:45:05 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:45:05 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 16:45:05 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 16:45:05 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:45:05 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:45:05 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:45:05 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:45:05 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 180bfabe-bb88-4d49-98ed-be76df93d4e1 could not be found. Apr 19 16:45:05 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:45:05 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:45:05 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:45:05 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:45:05 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:45:05 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:45:05 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:45:05 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:45:05 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 180bfabe-bb88-4d49-98ed-be76df93d4e1 could not be found. Apr 19 16:45:05 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:45:05 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-4e604ce0-d0c0-43dc-b315-f0ab7a97a414 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Returning 404 to user: Instance 180bfabe-bb88-4d49-98ed-be76df93d4e1 could not be found. {{(pid=61473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:45:05 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-4e604ce0-d0c0-43dc-b315-f0ab7a97a414 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/180bfabe-bb88-4d49-98ed-be76df93d4e1" status: 404 len: 111 microversion: 2.1 time: 0.235171 Apr 19 16:45:05 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 123/361] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:45:05 2023] GET /compute/v2.1/servers/180bfabe-bb88-4d49-98ed-be76df93d4e1 => generated 111 bytes in 236 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 16:45:05 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell1:SELECT=6 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:45:05 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell0:SELECT=4 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:45:05 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:45:05 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-92016399-5708-421d-a776-d41f082b2bce tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Calling method '.version_select at 0x7fd4971a5e10>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:45:05 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-92016399-5708-421d-a776-d41f082b2bce tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-585730018" status: 202 len: 0 microversion: 2.1 time: 0.026174 Apr 19 16:45:05 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 121/362] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 19 16:45:05 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-585730018 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 16:45:06 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-4bcf492f-0b9c-45be-a46a-5f24bae20b4c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:45:06 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-4bcf492f-0b9c-45be-a46a-5f24bae20b4c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] [instance: 180bfabe-bb88-4d49-98ed-be76df93d4e1] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:45:06 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell1:SELECT=2 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:45:06 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:45:06 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-4bcf492f-0b9c-45be-a46a-5f24bae20b4c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:45:06 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-4bcf492f-0b9c-45be-a46a-5f24bae20b4c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:45:06 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-4bcf492f-0b9c-45be-a46a-5f24bae20b4c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:45:06 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-4bcf492f-0b9c-45be-a46a-5f24bae20b4c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:45:06 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-4bcf492f-0b9c-45be-a46a-5f24bae20b4c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:45:06 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-4bcf492f-0b9c-45be-a46a-5f24bae20b4c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:45:06 user devstack@n-api.service[61472]: INFO nova.api.openstack.wsgi [None req-4bcf492f-0b9c-45be-a46a-5f24bae20b4c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] HTTP exception thrown: Instance 180bfabe-bb88-4d49-98ed-be76df93d4e1 could not be found. Apr 19 16:45:06 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-4bcf492f-0b9c-45be-a46a-5f24bae20b4c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Request method failure captured: Apr 19 16:45:06 user devstack@n-api.service[61472]: request: DELETE /compute/v2.1/servers/180bfabe-bb88-4d49-98ed-be76df93d4e1 HTTP/1.1 Apr 19 16:45:06 user devstack@n-api.service[61472]: Accept: application/json Apr 19 16:45:06 user devstack@n-api.service[61472]: Accept-Encoding: identity Apr 19 16:45:06 user devstack@n-api.service[61472]: Connection: close Apr 19 16:45:06 user devstack@n-api.service[61472]: Content-Length: 0 Apr 19 16:45:06 user devstack@n-api.service[61472]: Content-Type: application/json Apr 19 16:45:06 user devstack@n-api.service[61472]: Host: 10.0.0.210 Apr 19 16:45:06 user devstack@n-api.service[61472]: Openstack-System-Scope: None Apr 19 16:45:06 user devstack@n-api.service[61472]: User-Agent: python-urllib3/1.26.15 Apr 19 16:45:06 user devstack@n-api.service[61472]: X-Auth-Token: gAAAAABkQBlDbykaiytEqM6n7azX05ezt87urFSIm2ijRuhoI5U43XuhEECWvLvB6QQEmCwFG3X1VWTVQ5rbsfRlViRz5jOx6aGCSmV9wbSuJSepzPDJPe4E6QZQXbarJ6eQ6J-5LNt-9A82PF6l1yXXDhIlRcYybDExHkVoYjJYXalAWYgU29A Apr 19 16:45:06 user devstack@n-api.service[61472]: X-Domain-Id: None Apr 19 16:45:06 user devstack@n-api.service[61472]: X-Domain-Name: None Apr 19 16:45:06 user devstack@n-api.service[61472]: X-Identity-Status: Confirmed Apr 19 16:45:06 user devstack@n-api.service[61472]: X-Is-Admin-Project: True Apr 19 16:45:06 user devstack@n-api.service[61472]: X-Project-Domain-Id: default Apr 19 16:45:06 user devstack@n-api.service[61472]: X-Project-Domain-Name: Default Apr 19 16:45:06 user devstack@n-api.service[61472]: X-Project-Id: b5e6dbe3c46740f3b6d7a0618e076583 Apr 19 16:45:06 user devstack@n-api.service[61472]: X-Project-Name: tempest-AttachVolumeTestJSON-1317079953 Apr 19 16:45:06 user devstack@n-api.service[61472]: X-Role: member,reader Apr 19 16:45:06 user devstack@n-api.service[61472]: X-Roles: member,reader Apr 19 16:45:06 user devstack@n-api.service[61472]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b5e6dbe3c46740f3b6d7a0618e076583"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b5e6dbe3c46740f3b6d7a0618e076583"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b5e6dbe3c46740f3b6d7a0618e076583"}]}] Apr 19 16:45:06 user devstack@n-api.service[61472]: X-Tenant: tempest-AttachVolumeTestJSON-1317079953 Apr 19 16:45:06 user devstack@n-api.service[61472]: X-Tenant-Id: b5e6dbe3c46740f3b6d7a0618e076583 Apr 19 16:45:06 user devstack@n-api.service[61472]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1317079953 Apr 19 16:45:06 user devstack@n-api.service[61472]: X-User: tempest-AttachVolumeTestJSON-1317079953-project-member Apr 19 16:45:06 user devstack@n-api.service[61472]: X-User-Domain-Id: default Apr 19 16:45:06 user devstack@n-api.service[61472]: X-User-Domain-Name: Default Apr 19 16:45:06 user devstack@n-api.service[61472]: X-User-Id: ce3934da35244b148d5fa8c56152a1f0 Apr 19 16:45:06 user devstack@n-api.service[61472]: X-User-Name: tempest-AttachVolumeTestJSON-1317079953-project-member Apr 19 16:45:06 user devstack@n-api.service[61472]: method: > Apr 19 16:45:06 user devstack@n-api.service[61472]: exception: Instance 180bfabe-bb88-4d49-98ed-be76df93d4e1 could not be found. Apr 19 16:45:06 user devstack@n-api.service[61472]: action_args: {'id': '180bfabe-bb88-4d49-98ed-be76df93d4e1'} Apr 19 16:45:06 user devstack@n-api.service[61472]: {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 180bfabe-bb88-4d49-98ed-be76df93d4e1 could not be found. Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 180bfabe-bb88-4d49-98ed-be76df93d4e1 could not be found. Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 180bfabe-bb88-4d49-98ed-be76df93d4e1 could not be found. Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:45:06 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-4bcf492f-0b9c-45be-a46a-5f24bae20b4c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Returning 404 to user: Instance 180bfabe-bb88-4d49-98ed-be76df93d4e1 could not be found. {{(pid=61472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:45:06 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-4bcf492f-0b9c-45be-a46a-5f24bae20b4c tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/180bfabe-bb88-4d49-98ed-be76df93d4e1" status: 404 len: 111 microversion: 2.1 time: 0.033490 Apr 19 16:45:06 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 119/363] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 16:45:06 2023] DELETE /compute/v2.1/servers/180bfabe-bb88-4d49-98ed-be76df93d4e1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 16:45:06 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-f139c019-7041-45a4-861d-07560a516a32 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:45:06 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-f139c019-7041-45a4-861d-07560a516a32 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] [instance: 180bfabe-bb88-4d49-98ed-be76df93d4e1] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:45:06 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-f139c019-7041-45a4-861d-07560a516a32 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:45:06 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-f139c019-7041-45a4-861d-07560a516a32 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:45:06 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-f139c019-7041-45a4-861d-07560a516a32 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:45:06 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-f139c019-7041-45a4-861d-07560a516a32 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:45:06 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-f139c019-7041-45a4-861d-07560a516a32 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:45:06 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-f139c019-7041-45a4-861d-07560a516a32 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:45:06 user devstack@n-api.service[61473]: INFO nova.api.openstack.wsgi [None req-f139c019-7041-45a4-861d-07560a516a32 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] HTTP exception thrown: Instance 180bfabe-bb88-4d49-98ed-be76df93d4e1 could not be found. Apr 19 16:45:06 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-f139c019-7041-45a4-861d-07560a516a32 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Request method failure captured: Apr 19 16:45:06 user devstack@n-api.service[61473]: request: GET /compute/v2.1/servers/180bfabe-bb88-4d49-98ed-be76df93d4e1 HTTP/1.1 Apr 19 16:45:06 user devstack@n-api.service[61473]: Accept: application/json Apr 19 16:45:06 user devstack@n-api.service[61473]: Accept-Encoding: identity Apr 19 16:45:06 user devstack@n-api.service[61473]: Connection: close Apr 19 16:45:06 user devstack@n-api.service[61473]: Content-Length: 0 Apr 19 16:45:06 user devstack@n-api.service[61473]: Content-Type: application/json Apr 19 16:45:06 user devstack@n-api.service[61473]: Host: 10.0.0.210 Apr 19 16:45:06 user devstack@n-api.service[61473]: Openstack-System-Scope: None Apr 19 16:45:06 user devstack@n-api.service[61473]: User-Agent: python-urllib3/1.26.15 Apr 19 16:45:06 user devstack@n-api.service[61473]: X-Auth-Token: gAAAAABkQBlDbykaiytEqM6n7azX05ezt87urFSIm2ijRuhoI5U43XuhEECWvLvB6QQEmCwFG3X1VWTVQ5rbsfRlViRz5jOx6aGCSmV9wbSuJSepzPDJPe4E6QZQXbarJ6eQ6J-5LNt-9A82PF6l1yXXDhIlRcYybDExHkVoYjJYXalAWYgU29A Apr 19 16:45:06 user devstack@n-api.service[61473]: X-Domain-Id: None Apr 19 16:45:06 user devstack@n-api.service[61473]: X-Domain-Name: None Apr 19 16:45:06 user devstack@n-api.service[61473]: X-Identity-Status: Confirmed Apr 19 16:45:06 user devstack@n-api.service[61473]: X-Is-Admin-Project: True Apr 19 16:45:06 user devstack@n-api.service[61473]: X-Project-Domain-Id: default Apr 19 16:45:06 user devstack@n-api.service[61473]: X-Project-Domain-Name: Default Apr 19 16:45:06 user devstack@n-api.service[61473]: X-Project-Id: b5e6dbe3c46740f3b6d7a0618e076583 Apr 19 16:45:06 user devstack@n-api.service[61473]: X-Project-Name: tempest-AttachVolumeTestJSON-1317079953 Apr 19 16:45:06 user devstack@n-api.service[61473]: X-Role: member,reader Apr 19 16:45:06 user devstack@n-api.service[61473]: X-Roles: member,reader Apr 19 16:45:06 user devstack@n-api.service[61473]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b5e6dbe3c46740f3b6d7a0618e076583"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b5e6dbe3c46740f3b6d7a0618e076583"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b5e6dbe3c46740f3b6d7a0618e076583"}]}] Apr 19 16:45:06 user devstack@n-api.service[61473]: X-Tenant: tempest-AttachVolumeTestJSON-1317079953 Apr 19 16:45:06 user devstack@n-api.service[61473]: X-Tenant-Id: b5e6dbe3c46740f3b6d7a0618e076583 Apr 19 16:45:06 user devstack@n-api.service[61473]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1317079953 Apr 19 16:45:06 user devstack@n-api.service[61473]: X-User: tempest-AttachVolumeTestJSON-1317079953-project-member Apr 19 16:45:06 user devstack@n-api.service[61473]: X-User-Domain-Id: default Apr 19 16:45:06 user devstack@n-api.service[61473]: X-User-Domain-Name: Default Apr 19 16:45:06 user devstack@n-api.service[61473]: X-User-Id: ce3934da35244b148d5fa8c56152a1f0 Apr 19 16:45:06 user devstack@n-api.service[61473]: X-User-Name: tempest-AttachVolumeTestJSON-1317079953-project-member Apr 19 16:45:06 user devstack@n-api.service[61473]: method: > Apr 19 16:45:06 user devstack@n-api.service[61473]: exception: Instance 180bfabe-bb88-4d49-98ed-be76df93d4e1 could not be found. Apr 19 16:45:06 user devstack@n-api.service[61473]: action_args: {'id': '180bfabe-bb88-4d49-98ed-be76df93d4e1'} Apr 19 16:45:06 user devstack@n-api.service[61473]: {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:45:06 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:45:06 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:45:06 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:45:06 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:45:06 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:45:06 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:45:06 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:45:06 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:45:06 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:45:06 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 180bfabe-bb88-4d49-98ed-be76df93d4e1 could not be found. Apr 19 16:45:06 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:45:06 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:45:06 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:45:06 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:45:06 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:45:06 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:45:06 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:45:06 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:45:06 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:45:06 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:45:06 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 16:45:06 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 16:45:06 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:45:06 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:45:06 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:45:06 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:45:06 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 180bfabe-bb88-4d49-98ed-be76df93d4e1 could not be found. Apr 19 16:45:06 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:45:06 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:45:06 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:45:06 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:45:06 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:45:06 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:45:06 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:45:06 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:45:06 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 180bfabe-bb88-4d49-98ed-be76df93d4e1 could not be found. Apr 19 16:45:06 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:45:06 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-f139c019-7041-45a4-861d-07560a516a32 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Returning 404 to user: Instance 180bfabe-bb88-4d49-98ed-be76df93d4e1 could not be found. {{(pid=61473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:45:06 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-f139c019-7041-45a4-861d-07560a516a32 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/180bfabe-bb88-4d49-98ed-be76df93d4e1" status: 404 len: 111 microversion: 2.1 time: 0.027423 Apr 19 16:45:06 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 124/364] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:45:06 2023] GET /compute/v2.1/servers/180bfabe-bb88-4d49-98ed-be76df93d4e1 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 16:45:06 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-e51b42db-fdd7-4f37-833d-c11f02753839 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:45:06 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-e51b42db-fdd7-4f37-833d-c11f02753839 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] [instance: 4a07dc78-c9a6-4ebc-bb9f-35f95a18e246] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:45:06 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-e51b42db-fdd7-4f37-833d-c11f02753839 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:45:06 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-e51b42db-fdd7-4f37-833d-c11f02753839 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:45:06 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-e51b42db-fdd7-4f37-833d-c11f02753839 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:45:06 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-e51b42db-fdd7-4f37-833d-c11f02753839 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:45:06 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-e51b42db-fdd7-4f37-833d-c11f02753839 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:45:06 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-e51b42db-fdd7-4f37-833d-c11f02753839 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:45:06 user devstack@n-api.service[61471]: INFO nova.api.openstack.wsgi [None req-e51b42db-fdd7-4f37-833d-c11f02753839 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] HTTP exception thrown: Instance 4a07dc78-c9a6-4ebc-bb9f-35f95a18e246 could not be found. Apr 19 16:45:06 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-e51b42db-fdd7-4f37-833d-c11f02753839 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Request method failure captured: Apr 19 16:45:06 user devstack@n-api.service[61471]: request: DELETE /compute/v2.1/servers/4a07dc78-c9a6-4ebc-bb9f-35f95a18e246 HTTP/1.1 Apr 19 16:45:06 user devstack@n-api.service[61471]: Accept: application/json Apr 19 16:45:06 user devstack@n-api.service[61471]: Accept-Encoding: identity Apr 19 16:45:06 user devstack@n-api.service[61471]: Connection: close Apr 19 16:45:06 user devstack@n-api.service[61471]: Content-Length: 0 Apr 19 16:45:06 user devstack@n-api.service[61471]: Content-Type: application/json Apr 19 16:45:06 user devstack@n-api.service[61471]: Host: 10.0.0.210 Apr 19 16:45:06 user devstack@n-api.service[61471]: Openstack-System-Scope: None Apr 19 16:45:06 user devstack@n-api.service[61471]: User-Agent: python-urllib3/1.26.15 Apr 19 16:45:06 user devstack@n-api.service[61471]: X-Auth-Token: gAAAAABkQBlDbykaiytEqM6n7azX05ezt87urFSIm2ijRuhoI5U43XuhEECWvLvB6QQEmCwFG3X1VWTVQ5rbsfRlViRz5jOx6aGCSmV9wbSuJSepzPDJPe4E6QZQXbarJ6eQ6J-5LNt-9A82PF6l1yXXDhIlRcYybDExHkVoYjJYXalAWYgU29A Apr 19 16:45:06 user devstack@n-api.service[61471]: X-Domain-Id: None Apr 19 16:45:06 user devstack@n-api.service[61471]: X-Domain-Name: None Apr 19 16:45:06 user devstack@n-api.service[61471]: X-Identity-Status: Confirmed Apr 19 16:45:06 user devstack@n-api.service[61471]: X-Is-Admin-Project: True Apr 19 16:45:06 user devstack@n-api.service[61471]: X-Project-Domain-Id: default Apr 19 16:45:06 user devstack@n-api.service[61471]: X-Project-Domain-Name: Default Apr 19 16:45:06 user devstack@n-api.service[61471]: X-Project-Id: b5e6dbe3c46740f3b6d7a0618e076583 Apr 19 16:45:06 user devstack@n-api.service[61471]: X-Project-Name: tempest-AttachVolumeTestJSON-1317079953 Apr 19 16:45:06 user devstack@n-api.service[61471]: X-Role: member,reader Apr 19 16:45:06 user devstack@n-api.service[61471]: X-Roles: member,reader Apr 19 16:45:06 user devstack@n-api.service[61471]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b5e6dbe3c46740f3b6d7a0618e076583"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b5e6dbe3c46740f3b6d7a0618e076583"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b5e6dbe3c46740f3b6d7a0618e076583"}]}] Apr 19 16:45:06 user devstack@n-api.service[61471]: X-Tenant: tempest-AttachVolumeTestJSON-1317079953 Apr 19 16:45:06 user devstack@n-api.service[61471]: X-Tenant-Id: b5e6dbe3c46740f3b6d7a0618e076583 Apr 19 16:45:06 user devstack@n-api.service[61471]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1317079953 Apr 19 16:45:06 user devstack@n-api.service[61471]: X-User: tempest-AttachVolumeTestJSON-1317079953-project-member Apr 19 16:45:06 user devstack@n-api.service[61471]: X-User-Domain-Id: default Apr 19 16:45:06 user devstack@n-api.service[61471]: X-User-Domain-Name: Default Apr 19 16:45:06 user devstack@n-api.service[61471]: X-User-Id: ce3934da35244b148d5fa8c56152a1f0 Apr 19 16:45:06 user devstack@n-api.service[61471]: X-User-Name: tempest-AttachVolumeTestJSON-1317079953-project-member Apr 19 16:45:06 user devstack@n-api.service[61471]: method: > Apr 19 16:45:06 user devstack@n-api.service[61471]: exception: Instance 4a07dc78-c9a6-4ebc-bb9f-35f95a18e246 could not be found. Apr 19 16:45:06 user devstack@n-api.service[61471]: action_args: {'id': '4a07dc78-c9a6-4ebc-bb9f-35f95a18e246'} Apr 19 16:45:06 user devstack@n-api.service[61471]: {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:45:06 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:45:06 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:45:06 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:45:06 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:45:06 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:45:06 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:45:06 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:45:06 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:45:06 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:45:06 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a07dc78-c9a6-4ebc-bb9f-35f95a18e246 could not be found. Apr 19 16:45:06 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:45:06 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:45:06 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:45:06 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:45:06 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:45:06 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:45:06 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:45:06 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:45:06 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:45:06 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:45:06 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 19 16:45:06 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 19 16:45:06 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 19 16:45:06 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 19 16:45:06 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:45:06 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:45:06 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:45:06 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:45:06 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a07dc78-c9a6-4ebc-bb9f-35f95a18e246 could not be found. Apr 19 16:45:06 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:45:06 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:45:06 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:45:06 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:45:06 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:45:06 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:45:06 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:45:06 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:45:06 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a07dc78-c9a6-4ebc-bb9f-35f95a18e246 could not be found. Apr 19 16:45:06 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:45:06 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-e51b42db-fdd7-4f37-833d-c11f02753839 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Returning 404 to user: Instance 4a07dc78-c9a6-4ebc-bb9f-35f95a18e246 could not be found. {{(pid=61471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:45:06 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-e51b42db-fdd7-4f37-833d-c11f02753839 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4a07dc78-c9a6-4ebc-bb9f-35f95a18e246" status: 404 len: 111 microversion: 2.1 time: 0.026655 Apr 19 16:45:06 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 122/365] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 16:45:06 2023] DELETE /compute/v2.1/servers/4a07dc78-c9a6-4ebc-bb9f-35f95a18e246 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 16:45:06 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-5364d4bd-9a06-48c2-9174-9a4fb9340d70 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:45:06 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-5364d4bd-9a06-48c2-9174-9a4fb9340d70 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] [instance: 4a07dc78-c9a6-4ebc-bb9f-35f95a18e246] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:45:06 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-5364d4bd-9a06-48c2-9174-9a4fb9340d70 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:45:06 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-5364d4bd-9a06-48c2-9174-9a4fb9340d70 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:45:06 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-5364d4bd-9a06-48c2-9174-9a4fb9340d70 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:45:06 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-5364d4bd-9a06-48c2-9174-9a4fb9340d70 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:45:06 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-5364d4bd-9a06-48c2-9174-9a4fb9340d70 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:45:06 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-5364d4bd-9a06-48c2-9174-9a4fb9340d70 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:45:06 user devstack@n-api.service[61472]: INFO nova.api.openstack.wsgi [None req-5364d4bd-9a06-48c2-9174-9a4fb9340d70 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] HTTP exception thrown: Instance 4a07dc78-c9a6-4ebc-bb9f-35f95a18e246 could not be found. Apr 19 16:45:06 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-5364d4bd-9a06-48c2-9174-9a4fb9340d70 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Request method failure captured: Apr 19 16:45:06 user devstack@n-api.service[61472]: request: GET /compute/v2.1/servers/4a07dc78-c9a6-4ebc-bb9f-35f95a18e246 HTTP/1.1 Apr 19 16:45:06 user devstack@n-api.service[61472]: Accept: application/json Apr 19 16:45:06 user devstack@n-api.service[61472]: Accept-Encoding: identity Apr 19 16:45:06 user devstack@n-api.service[61472]: Connection: close Apr 19 16:45:06 user devstack@n-api.service[61472]: Content-Length: 0 Apr 19 16:45:06 user devstack@n-api.service[61472]: Content-Type: application/json Apr 19 16:45:06 user devstack@n-api.service[61472]: Host: 10.0.0.210 Apr 19 16:45:06 user devstack@n-api.service[61472]: Openstack-System-Scope: None Apr 19 16:45:06 user devstack@n-api.service[61472]: User-Agent: python-urllib3/1.26.15 Apr 19 16:45:06 user devstack@n-api.service[61472]: X-Auth-Token: gAAAAABkQBlDbykaiytEqM6n7azX05ezt87urFSIm2ijRuhoI5U43XuhEECWvLvB6QQEmCwFG3X1VWTVQ5rbsfRlViRz5jOx6aGCSmV9wbSuJSepzPDJPe4E6QZQXbarJ6eQ6J-5LNt-9A82PF6l1yXXDhIlRcYybDExHkVoYjJYXalAWYgU29A Apr 19 16:45:06 user devstack@n-api.service[61472]: X-Domain-Id: None Apr 19 16:45:06 user devstack@n-api.service[61472]: X-Domain-Name: None Apr 19 16:45:06 user devstack@n-api.service[61472]: X-Identity-Status: Confirmed Apr 19 16:45:06 user devstack@n-api.service[61472]: X-Is-Admin-Project: True Apr 19 16:45:06 user devstack@n-api.service[61472]: X-Project-Domain-Id: default Apr 19 16:45:06 user devstack@n-api.service[61472]: X-Project-Domain-Name: Default Apr 19 16:45:06 user devstack@n-api.service[61472]: X-Project-Id: b5e6dbe3c46740f3b6d7a0618e076583 Apr 19 16:45:06 user devstack@n-api.service[61472]: X-Project-Name: tempest-AttachVolumeTestJSON-1317079953 Apr 19 16:45:06 user devstack@n-api.service[61472]: X-Role: member,reader Apr 19 16:45:06 user devstack@n-api.service[61472]: X-Roles: member,reader Apr 19 16:45:06 user devstack@n-api.service[61472]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b5e6dbe3c46740f3b6d7a0618e076583"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b5e6dbe3c46740f3b6d7a0618e076583"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b5e6dbe3c46740f3b6d7a0618e076583"}]}] Apr 19 16:45:06 user devstack@n-api.service[61472]: X-Tenant: tempest-AttachVolumeTestJSON-1317079953 Apr 19 16:45:06 user devstack@n-api.service[61472]: X-Tenant-Id: b5e6dbe3c46740f3b6d7a0618e076583 Apr 19 16:45:06 user devstack@n-api.service[61472]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1317079953 Apr 19 16:45:06 user devstack@n-api.service[61472]: X-User: tempest-AttachVolumeTestJSON-1317079953-project-member Apr 19 16:45:06 user devstack@n-api.service[61472]: X-User-Domain-Id: default Apr 19 16:45:06 user devstack@n-api.service[61472]: X-User-Domain-Name: Default Apr 19 16:45:06 user devstack@n-api.service[61472]: X-User-Id: ce3934da35244b148d5fa8c56152a1f0 Apr 19 16:45:06 user devstack@n-api.service[61472]: X-User-Name: tempest-AttachVolumeTestJSON-1317079953-project-member Apr 19 16:45:06 user devstack@n-api.service[61472]: method: > Apr 19 16:45:06 user devstack@n-api.service[61472]: exception: Instance 4a07dc78-c9a6-4ebc-bb9f-35f95a18e246 could not be found. Apr 19 16:45:06 user devstack@n-api.service[61472]: action_args: {'id': '4a07dc78-c9a6-4ebc-bb9f-35f95a18e246'} Apr 19 16:45:06 user devstack@n-api.service[61472]: {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a07dc78-c9a6-4ebc-bb9f-35f95a18e246 could not be found. Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a07dc78-c9a6-4ebc-bb9f-35f95a18e246 could not be found. Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a07dc78-c9a6-4ebc-bb9f-35f95a18e246 could not be found. Apr 19 16:45:06 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:45:06 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-5364d4bd-9a06-48c2-9174-9a4fb9340d70 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] Returning 404 to user: Instance 4a07dc78-c9a6-4ebc-bb9f-35f95a18e246 could not be found. {{(pid=61472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:45:06 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-5364d4bd-9a06-48c2-9174-9a4fb9340d70 tempest-AttachVolumeTestJSON-1317079953 tempest-AttachVolumeTestJSON-1317079953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a07dc78-c9a6-4ebc-bb9f-35f95a18e246" status: 404 len: 111 microversion: 2.1 time: 0.026250 Apr 19 16:45:06 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 120/366] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:45:06 2023] GET /compute/v2.1/servers/4a07dc78-c9a6-4ebc-bb9f-35f95a18e246 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 16:45:22 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-1f100778-f3a7-461c-9dcc-ccc5bab68ebe tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:45:22 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-1f100778-f3a7-461c-9dcc-ccc5bab68ebe tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] [instance: 4bca7be9-c7ba-4c5a-9860-bf516f174865] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:45:22 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_api:SELECT=4 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:45:22 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell1:SELECT=4 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:45:22 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-1f100778-f3a7-461c-9dcc-ccc5bab68ebe tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:45:22 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-1f100778-f3a7-461c-9dcc-ccc5bab68ebe tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:45:22 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-1f100778-f3a7-461c-9dcc-ccc5bab68ebe tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:45:22 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-1f100778-f3a7-461c-9dcc-ccc5bab68ebe tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:45:22 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-1f100778-f3a7-461c-9dcc-ccc5bab68ebe tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:45:22 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-1f100778-f3a7-461c-9dcc-ccc5bab68ebe tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:45:22 user devstack@n-api.service[61473]: INFO nova.api.openstack.wsgi [None req-1f100778-f3a7-461c-9dcc-ccc5bab68ebe tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] HTTP exception thrown: Instance 4bca7be9-c7ba-4c5a-9860-bf516f174865 could not be found. Apr 19 16:45:22 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-1f100778-f3a7-461c-9dcc-ccc5bab68ebe tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Request method failure captured: Apr 19 16:45:22 user devstack@n-api.service[61473]: request: GET /compute/v2.1/servers/4bca7be9-c7ba-4c5a-9860-bf516f174865 HTTP/1.1 Apr 19 16:45:22 user devstack@n-api.service[61473]: Accept: application/json Apr 19 16:45:22 user devstack@n-api.service[61473]: Accept-Encoding: identity Apr 19 16:45:22 user devstack@n-api.service[61473]: Connection: close Apr 19 16:45:22 user devstack@n-api.service[61473]: Content-Length: 0 Apr 19 16:45:22 user devstack@n-api.service[61473]: Content-Type: application/json Apr 19 16:45:22 user devstack@n-api.service[61473]: Host: 10.0.0.210 Apr 19 16:45:22 user devstack@n-api.service[61473]: Openstack-System-Scope: None Apr 19 16:45:22 user devstack@n-api.service[61473]: User-Agent: python-urllib3/1.26.15 Apr 19 16:45:22 user devstack@n-api.service[61473]: X-Auth-Token: gAAAAABkQBijykh3S2adH6umevG9TAoFxyN59y4R4BBewsH_kL5fmZak3LoVbATytpojLreFD5t3R4GbFybNCRMdj8zC0Vm3JiC5xHMewyKnRzsZImcv1C_pNgiZvAvFgLtqKepdjPT0GfgbgohTtEJgnPvWu7GRPBx2c9KLd4GIKwjjadzvR7M Apr 19 16:45:22 user devstack@n-api.service[61473]: X-Domain-Id: None Apr 19 16:45:22 user devstack@n-api.service[61473]: X-Domain-Name: None Apr 19 16:45:22 user devstack@n-api.service[61473]: X-Identity-Status: Confirmed Apr 19 16:45:22 user devstack@n-api.service[61473]: X-Is-Admin-Project: True Apr 19 16:45:22 user devstack@n-api.service[61473]: X-Openstack-Nova-Api-Version: 2.87 Apr 19 16:45:22 user devstack@n-api.service[61473]: X-Project-Domain-Id: default Apr 19 16:45:22 user devstack@n-api.service[61473]: X-Project-Domain-Name: Default Apr 19 16:45:22 user devstack@n-api.service[61473]: X-Project-Id: e58ee4833fd147e2a494be5d7634a2fa Apr 19 16:45:22 user devstack@n-api.service[61473]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-847899299 Apr 19 16:45:22 user devstack@n-api.service[61473]: X-Role: member,reader Apr 19 16:45:22 user devstack@n-api.service[61473]: X-Roles: member,reader Apr 19 16:45:22 user devstack@n-api.service[61473]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e58ee4833fd147e2a494be5d7634a2fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e58ee4833fd147e2a494be5d7634a2fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e58ee4833fd147e2a494be5d7634a2fa"}]}] Apr 19 16:45:22 user devstack@n-api.service[61473]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-847899299 Apr 19 16:45:22 user devstack@n-api.service[61473]: X-Tenant-Id: e58ee4833fd147e2a494be5d7634a2fa Apr 19 16:45:22 user devstack@n-api.service[61473]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-847899299 Apr 19 16:45:22 user devstack@n-api.service[61473]: X-User: tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member Apr 19 16:45:22 user devstack@n-api.service[61473]: X-User-Domain-Id: default Apr 19 16:45:22 user devstack@n-api.service[61473]: X-User-Domain-Name: Default Apr 19 16:45:22 user devstack@n-api.service[61473]: X-User-Id: 63f2a02626ca4957823de39c9a31d1b8 Apr 19 16:45:22 user devstack@n-api.service[61473]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member Apr 19 16:45:22 user devstack@n-api.service[61473]: method: > Apr 19 16:45:22 user devstack@n-api.service[61473]: exception: Instance 4bca7be9-c7ba-4c5a-9860-bf516f174865 could not be found. Apr 19 16:45:22 user devstack@n-api.service[61473]: action_args: {'id': '4bca7be9-c7ba-4c5a-9860-bf516f174865'} Apr 19 16:45:22 user devstack@n-api.service[61473]: {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:45:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:45:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:45:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:45:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:45:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:45:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:45:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:45:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:45:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:45:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bca7be9-c7ba-4c5a-9860-bf516f174865 could not be found. Apr 19 16:45:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:45:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:45:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:45:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:45:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:45:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:45:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:45:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:45:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:45:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:45:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 16:45:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 16:45:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:45:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:45:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:45:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:45:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bca7be9-c7ba-4c5a-9860-bf516f174865 could not be found. Apr 19 16:45:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:45:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:45:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:45:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:45:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:45:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:45:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:45:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:45:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bca7be9-c7ba-4c5a-9860-bf516f174865 could not be found. Apr 19 16:45:22 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:45:22 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-1f100778-f3a7-461c-9dcc-ccc5bab68ebe tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Returning 404 to user: Instance 4bca7be9-c7ba-4c5a-9860-bf516f174865 could not be found. {{(pid=61473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:45:22 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-1f100778-f3a7-461c-9dcc-ccc5bab68ebe tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4bca7be9-c7ba-4c5a-9860-bf516f174865" status: 404 len: 111 microversion: 2.87 time: 0.031510 Apr 19 16:45:22 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 125/367] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 16:45:22 2023] GET /compute/v2.1/servers/4bca7be9-c7ba-4c5a-9860-bf516f174865 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 16:45:22 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-bb935abb-4252-444c-850e-b7209fb39662 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:45:22 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-bb935abb-4252-444c-850e-b7209fb39662 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] [instance: 269dc247-e424-4102-9c7f-1f3da95afebf] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:45:22 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:45:22 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell1:SELECT=2 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:45:22 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-bb935abb-4252-444c-850e-b7209fb39662 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:45:22 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-bb935abb-4252-444c-850e-b7209fb39662 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:45:22 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-bb935abb-4252-444c-850e-b7209fb39662 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:45:22 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-bb935abb-4252-444c-850e-b7209fb39662 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:45:22 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-bb935abb-4252-444c-850e-b7209fb39662 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:45:22 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-bb935abb-4252-444c-850e-b7209fb39662 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:45:22 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-bb935abb-4252-444c-850e-b7209fb39662 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] [instance: 269dc247-e424-4102-9c7f-1f3da95afebf] Going to try to terminate instance {{(pid=61471) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 16:45:22 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-bb935abb-4252-444c-850e-b7209fb39662 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/269dc247-e424-4102-9c7f-1f3da95afebf" status: 204 len: 0 microversion: 2.87 time: 0.174519 Apr 19 16:45:22 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 123/368] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 19 16:45:22 2023] DELETE /compute/v2.1/servers/269dc247-e424-4102-9c7f-1f3da95afebf => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 19 16:45:22 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-bc373872-38d9-4039-adeb-ccac9839e7f9 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:45:22 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-bc373872-38d9-4039-adeb-ccac9839e7f9 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] [instance: 269dc247-e424-4102-9c7f-1f3da95afebf] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:45:22 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_api:SELECT=4 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:45:22 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell1:SELECT=4 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:45:22 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-bc373872-38d9-4039-adeb-ccac9839e7f9 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:45:22 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-bc373872-38d9-4039-adeb-ccac9839e7f9 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:45:22 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-bc373872-38d9-4039-adeb-ccac9839e7f9 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:45:22 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-bc373872-38d9-4039-adeb-ccac9839e7f9 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:45:22 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-bc373872-38d9-4039-adeb-ccac9839e7f9 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:45:22 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-bc373872-38d9-4039-adeb-ccac9839e7f9 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:45:22 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-80556bb2-1c2a-489f-90ab-9313d04feaf2 req-1a760d0f-fbf8-47b1-81ca-00509f6b00b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "269dc247-e424-4102-9c7f-1f3da95afebf", "name": "network-vif-unplugged", "status": "completed", "tag": "23d34df8-c537-47b0-a008-5a0c4db98175"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:45:22 user devstack@n-api.service[61472]: DEBUG nova.policy [None req-bc373872-38d9-4039-adeb-ccac9839e7f9 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f2a02626ca4957823de39c9a31d1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ee4833fd147e2a494be5d7634a2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61472) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:45:22 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-80556bb2-1c2a-489f-90ab-9313d04feaf2 req-1a760d0f-fbf8-47b1-81ca-00509f6b00b1 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:45:22 user devstack@n-api.service[61472]: DEBUG nova.policy [None req-bc373872-38d9-4039-adeb-ccac9839e7f9 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63f2a02626ca4957823de39c9a31d1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ee4833fd147e2a494be5d7634a2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61472) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:45:22 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-80556bb2-1c2a-489f-90ab-9313d04feaf2 req-1a760d0f-fbf8-47b1-81ca-00509f6b00b1 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:45:22 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-80556bb2-1c2a-489f-90ab-9313d04feaf2 req-1a760d0f-fbf8-47b1-81ca-00509f6b00b1 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:45:22 user devstack@n-api.service[61472]: DEBUG nova.policy [None req-bc373872-38d9-4039-adeb-ccac9839e7f9 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63f2a02626ca4957823de39c9a31d1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ee4833fd147e2a494be5d7634a2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61472) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:45:22 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-bc373872-38d9-4039-adeb-ccac9839e7f9 tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] 10.0.0.210 "GET /compute/v2.1/servers/269dc247-e424-4102-9c7f-1f3da95afebf" status: 200 len: 1697 microversion: 2.87 time: 0.266593 Apr 19 16:45:22 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 121/369] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 16:45:22 2023] GET /compute/v2.1/servers/269dc247-e424-4102-9c7f-1f3da95afebf => generated 1697 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 16:45:22 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-80556bb2-1c2a-489f-90ab-9313d04feaf2 req-1a760d0f-fbf8-47b1-81ca-00509f6b00b1 service nova] Creating event network-vif-unplugged:23d34df8-c537-47b0-a008-5a0c4db98175 for instance 269dc247-e424-4102-9c7f-1f3da95afebf on user Apr 19 16:45:22 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-80556bb2-1c2a-489f-90ab-9313d04feaf2 req-1a760d0f-fbf8-47b1-81ca-00509f6b00b1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030927 Apr 19 16:45:22 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 126/370] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:45:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:45:24 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [req-a154e243-c858-440e-89c1-c46420f15a51 req-94e94a0e-a4d0-499c-8fec-3ad55159b691 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "269dc247-e424-4102-9c7f-1f3da95afebf", "name": "network-vif-plugged", "status": "completed", "tag": "23d34df8-c537-47b0-a008-5a0c4db98175"}, {"server_uuid": "269dc247-e424-4102-9c7f-1f3da95afebf", "name": "network-vif-plugged", "status": "completed", "tag": "23d34df8-c537-47b0-a008-5a0c4db98175"}, {"server_uuid": "269dc247-e424-4102-9c7f-1f3da95afebf", "name": "network-vif-plugged", "status": "completed", "tag": "23d34df8-c537-47b0-a008-5a0c4db98175"}, {"server_uuid": "269dc247-e424-4102-9c7f-1f3da95afebf", "name": "network-vif-unplugged", "status": "completed", "tag": "23d34df8-c537-47b0-a008-5a0c4db98175"}, {"server_uuid": "269dc247-e424-4102-9c7f-1f3da95afebf", "name": "network-vif-plugged", "status": "completed", "tag": "23d34df8-c537-47b0-a008-5a0c4db98175"}, {"server_uuid": "269dc247-e424-4102-9c7f-1f3da95afebf", "name": "network-vif-deleted", "tag": "23d34df8-c537-47b0-a008-5a0c4db98175"}]} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:45:24 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-a154e243-c858-440e-89c1-c46420f15a51 req-94e94a0e-a4d0-499c-8fec-3ad55159b691 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:45:24 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-a154e243-c858-440e-89c1-c46420f15a51 req-94e94a0e-a4d0-499c-8fec-3ad55159b691 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:45:24 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-a154e243-c858-440e-89c1-c46420f15a51 req-94e94a0e-a4d0-499c-8fec-3ad55159b691 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:45:24 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-a154e243-c858-440e-89c1-c46420f15a51 req-94e94a0e-a4d0-499c-8fec-3ad55159b691 service nova] Creating event network-vif-plugged:23d34df8-c537-47b0-a008-5a0c4db98175 for instance 269dc247-e424-4102-9c7f-1f3da95afebf on user Apr 19 16:45:24 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-a154e243-c858-440e-89c1-c46420f15a51 req-94e94a0e-a4d0-499c-8fec-3ad55159b691 service nova] Creating event network-vif-plugged:23d34df8-c537-47b0-a008-5a0c4db98175 for instance 269dc247-e424-4102-9c7f-1f3da95afebf on user Apr 19 16:45:24 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-a154e243-c858-440e-89c1-c46420f15a51 req-94e94a0e-a4d0-499c-8fec-3ad55159b691 service nova] Creating event network-vif-plugged:23d34df8-c537-47b0-a008-5a0c4db98175 for instance 269dc247-e424-4102-9c7f-1f3da95afebf on user Apr 19 16:45:24 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-a154e243-c858-440e-89c1-c46420f15a51 req-94e94a0e-a4d0-499c-8fec-3ad55159b691 service nova] Creating event network-vif-unplugged:23d34df8-c537-47b0-a008-5a0c4db98175 for instance 269dc247-e424-4102-9c7f-1f3da95afebf on user Apr 19 16:45:24 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-a154e243-c858-440e-89c1-c46420f15a51 req-94e94a0e-a4d0-499c-8fec-3ad55159b691 service nova] Creating event network-vif-plugged:23d34df8-c537-47b0-a008-5a0c4db98175 for instance 269dc247-e424-4102-9c7f-1f3da95afebf on user Apr 19 16:45:24 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-a154e243-c858-440e-89c1-c46420f15a51 req-94e94a0e-a4d0-499c-8fec-3ad55159b691 service nova] Creating event network-vif-deleted:23d34df8-c537-47b0-a008-5a0c4db98175 for instance 269dc247-e424-4102-9c7f-1f3da95afebf on user Apr 19 16:45:24 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [req-a154e243-c858-440e-89c1-c46420f15a51 req-94e94a0e-a4d0-499c-8fec-3ad55159b691 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1040 microversion: 2.1 time: 0.035686 Apr 19 16:45:24 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 124/371] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:45:24 2023] POST /compute/v2.1/os-server-external-events => generated 1040 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:45:34 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-a57c54d3-ba17-49b1-968c-2bf9709a8667 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:45:34 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-a57c54d3-ba17-49b1-968c-2bf9709a8667 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] [instance: edd2688e-940e-4ab3-b27c-b6d4aab3efc5] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:45:34 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell1:SELECT=6 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:45:34 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_api:SELECT=4 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:45:34 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-a57c54d3-ba17-49b1-968c-2bf9709a8667 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:45:34 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-a57c54d3-ba17-49b1-968c-2bf9709a8667 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:45:34 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-a57c54d3-ba17-49b1-968c-2bf9709a8667 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:45:34 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-a57c54d3-ba17-49b1-968c-2bf9709a8667 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:45:34 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-a57c54d3-ba17-49b1-968c-2bf9709a8667 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:45:34 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-a57c54d3-ba17-49b1-968c-2bf9709a8667 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:45:34 user devstack@n-api.service[61472]: INFO nova.api.openstack.wsgi [None req-a57c54d3-ba17-49b1-968c-2bf9709a8667 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] HTTP exception thrown: Instance edd2688e-940e-4ab3-b27c-b6d4aab3efc5 could not be found. Apr 19 16:45:34 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-a57c54d3-ba17-49b1-968c-2bf9709a8667 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Request method failure captured: Apr 19 16:45:34 user devstack@n-api.service[61472]: request: GET /compute/v2.1/servers/edd2688e-940e-4ab3-b27c-b6d4aab3efc5 HTTP/1.1 Apr 19 16:45:34 user devstack@n-api.service[61472]: Accept: application/json Apr 19 16:45:34 user devstack@n-api.service[61472]: Accept-Encoding: identity Apr 19 16:45:34 user devstack@n-api.service[61472]: Connection: close Apr 19 16:45:34 user devstack@n-api.service[61472]: Content-Length: 0 Apr 19 16:45:34 user devstack@n-api.service[61472]: Content-Type: application/json Apr 19 16:45:34 user devstack@n-api.service[61472]: Host: 10.0.0.210 Apr 19 16:45:34 user devstack@n-api.service[61472]: Openstack-System-Scope: None Apr 19 16:45:34 user devstack@n-api.service[61472]: User-Agent: python-urllib3/1.26.15 Apr 19 16:45:34 user devstack@n-api.service[61472]: X-Auth-Token: gAAAAABkQBhmPnjW532y9qJ4zK5doLa-PV0SI35llCo67m0aMTftUIVTfTzZjY_MHvNdQHsjzs_o7EyoxfjtSD2ncztXt4sinAyKYxuM9yjbxwMT167C3KRjUS4J-Cz2q_0OBcYUeu_-cki3GqSuglHZCLwkBXgQ9CvRrmd5bUtSYtUPhbij9rw Apr 19 16:45:34 user devstack@n-api.service[61472]: X-Domain-Id: None Apr 19 16:45:34 user devstack@n-api.service[61472]: X-Domain-Name: None Apr 19 16:45:34 user devstack@n-api.service[61472]: X-Identity-Status: Confirmed Apr 19 16:45:34 user devstack@n-api.service[61472]: X-Is-Admin-Project: True Apr 19 16:45:34 user devstack@n-api.service[61472]: X-Project-Domain-Id: default Apr 19 16:45:34 user devstack@n-api.service[61472]: X-Project-Domain-Name: Default Apr 19 16:45:34 user devstack@n-api.service[61472]: X-Project-Id: 78962d13860a4df3a8aa100e2afaca6d Apr 19 16:45:34 user devstack@n-api.service[61472]: X-Project-Name: tempest-ServerActionsTestJSON-804711150 Apr 19 16:45:34 user devstack@n-api.service[61472]: X-Role: member,reader Apr 19 16:45:34 user devstack@n-api.service[61472]: X-Roles: member,reader Apr 19 16:45:34 user devstack@n-api.service[61472]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/78962d13860a4df3a8aa100e2afaca6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/78962d13860a4df3a8aa100e2afaca6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/78962d13860a4df3a8aa100e2afaca6d"}]}] Apr 19 16:45:34 user devstack@n-api.service[61472]: X-Tenant: tempest-ServerActionsTestJSON-804711150 Apr 19 16:45:34 user devstack@n-api.service[61472]: X-Tenant-Id: 78962d13860a4df3a8aa100e2afaca6d Apr 19 16:45:34 user devstack@n-api.service[61472]: X-Tenant-Name: tempest-ServerActionsTestJSON-804711150 Apr 19 16:45:34 user devstack@n-api.service[61472]: X-User: tempest-ServerActionsTestJSON-804711150-project-member Apr 19 16:45:34 user devstack@n-api.service[61472]: X-User-Domain-Id: default Apr 19 16:45:34 user devstack@n-api.service[61472]: X-User-Domain-Name: Default Apr 19 16:45:34 user devstack@n-api.service[61472]: X-User-Id: 023314f8cf79430b83c5184d9a54be45 Apr 19 16:45:34 user devstack@n-api.service[61472]: X-User-Name: tempest-ServerActionsTestJSON-804711150-project-member Apr 19 16:45:34 user devstack@n-api.service[61472]: method: > Apr 19 16:45:34 user devstack@n-api.service[61472]: exception: Instance edd2688e-940e-4ab3-b27c-b6d4aab3efc5 could not be found. Apr 19 16:45:34 user devstack@n-api.service[61472]: action_args: {'id': 'edd2688e-940e-4ab3-b27c-b6d4aab3efc5'} Apr 19 16:45:34 user devstack@n-api.service[61472]: {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:45:34 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:45:34 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:45:34 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:45:34 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:45:34 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:45:34 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:45:34 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:45:34 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:45:34 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:45:34 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edd2688e-940e-4ab3-b27c-b6d4aab3efc5 could not be found. Apr 19 16:45:34 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:45:34 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:45:34 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:45:34 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:45:34 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:45:34 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:45:34 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:45:34 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:45:34 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:45:34 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:45:34 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 16:45:34 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 16:45:34 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:45:34 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:45:34 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:45:34 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:45:34 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edd2688e-940e-4ab3-b27c-b6d4aab3efc5 could not be found. Apr 19 16:45:34 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:45:34 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:45:34 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:45:34 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:45:34 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:45:34 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:45:34 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:45:34 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:45:34 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edd2688e-940e-4ab3-b27c-b6d4aab3efc5 could not be found. Apr 19 16:45:34 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:45:34 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-a57c54d3-ba17-49b1-968c-2bf9709a8667 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Returning 404 to user: Instance edd2688e-940e-4ab3-b27c-b6d4aab3efc5 could not be found. {{(pid=61472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:45:34 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-a57c54d3-ba17-49b1-968c-2bf9709a8667 tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] 10.0.0.210 "GET /compute/v2.1/servers/edd2688e-940e-4ab3-b27c-b6d4aab3efc5" status: 404 len: 111 microversion: 2.1 time: 0.040389 Apr 19 16:45:34 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 122/372] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:45:34 2023] GET /compute/v2.1/servers/edd2688e-940e-4ab3-b27c-b6d4aab3efc5 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 16:45:34 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_api:SELECT=4 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:45:34 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell1:SELECT=4 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:45:34 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-2ffd7803-85c8-4f26-89df-316ea7a009bc tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] Calling method '.version_select at 0x7fd49717af80>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:45:34 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-2ffd7803-85c8-4f26-89df-316ea7a009bc tempest-ServerActionsTestJSON-804711150 tempest-ServerActionsTestJSON-804711150-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1808529544" status: 202 len: 0 microversion: 2.1 time: 0.038936 Apr 19 16:45:34 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 127/373] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 19 16:45:34 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1808529544 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 16:46:12 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:46:12 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:46:12 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-5ab0ba80-9139-4190-b0b9-5f58d7310d1d tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:46:12 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-5ab0ba80-9139-4190-b0b9-5f58d7310d1d tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] [instance: 269dc247-e424-4102-9c7f-1f3da95afebf] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:46:12 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-5ab0ba80-9139-4190-b0b9-5f58d7310d1d tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:46:12 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-5ab0ba80-9139-4190-b0b9-5f58d7310d1d tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:46:12 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-5ab0ba80-9139-4190-b0b9-5f58d7310d1d tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:46:12 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-5ab0ba80-9139-4190-b0b9-5f58d7310d1d tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:46:12 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-5ab0ba80-9139-4190-b0b9-5f58d7310d1d tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:46:12 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-5ab0ba80-9139-4190-b0b9-5f58d7310d1d tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:46:12 user devstack@n-api.service[61471]: INFO nova.api.openstack.wsgi [None req-5ab0ba80-9139-4190-b0b9-5f58d7310d1d tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] HTTP exception thrown: Instance 269dc247-e424-4102-9c7f-1f3da95afebf could not be found. Apr 19 16:46:12 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-5ab0ba80-9139-4190-b0b9-5f58d7310d1d tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Request method failure captured: Apr 19 16:46:12 user devstack@n-api.service[61471]: request: GET /compute/v2.1/servers/269dc247-e424-4102-9c7f-1f3da95afebf HTTP/1.1 Apr 19 16:46:12 user devstack@n-api.service[61471]: Accept: application/json Apr 19 16:46:12 user devstack@n-api.service[61471]: Accept-Encoding: identity Apr 19 16:46:12 user devstack@n-api.service[61471]: Connection: close Apr 19 16:46:12 user devstack@n-api.service[61471]: Content-Length: 0 Apr 19 16:46:12 user devstack@n-api.service[61471]: Content-Type: application/json Apr 19 16:46:12 user devstack@n-api.service[61471]: Host: 10.0.0.210 Apr 19 16:46:12 user devstack@n-api.service[61471]: Openstack-System-Scope: None Apr 19 16:46:12 user devstack@n-api.service[61471]: User-Agent: python-urllib3/1.26.15 Apr 19 16:46:12 user devstack@n-api.service[61471]: X-Auth-Token: gAAAAABkQBijykh3S2adH6umevG9TAoFxyN59y4R4BBewsH_kL5fmZak3LoVbATytpojLreFD5t3R4GbFybNCRMdj8zC0Vm3JiC5xHMewyKnRzsZImcv1C_pNgiZvAvFgLtqKepdjPT0GfgbgohTtEJgnPvWu7GRPBx2c9KLd4GIKwjjadzvR7M Apr 19 16:46:12 user devstack@n-api.service[61471]: X-Domain-Id: None Apr 19 16:46:12 user devstack@n-api.service[61471]: X-Domain-Name: None Apr 19 16:46:12 user devstack@n-api.service[61471]: X-Identity-Status: Confirmed Apr 19 16:46:12 user devstack@n-api.service[61471]: X-Is-Admin-Project: True Apr 19 16:46:12 user devstack@n-api.service[61471]: X-Openstack-Nova-Api-Version: 2.87 Apr 19 16:46:12 user devstack@n-api.service[61471]: X-Project-Domain-Id: default Apr 19 16:46:12 user devstack@n-api.service[61471]: X-Project-Domain-Name: Default Apr 19 16:46:12 user devstack@n-api.service[61471]: X-Project-Id: e58ee4833fd147e2a494be5d7634a2fa Apr 19 16:46:12 user devstack@n-api.service[61471]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-847899299 Apr 19 16:46:12 user devstack@n-api.service[61471]: X-Role: member,reader Apr 19 16:46:12 user devstack@n-api.service[61471]: X-Roles: member,reader Apr 19 16:46:12 user devstack@n-api.service[61471]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e58ee4833fd147e2a494be5d7634a2fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e58ee4833fd147e2a494be5d7634a2fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e58ee4833fd147e2a494be5d7634a2fa"}]}] Apr 19 16:46:12 user devstack@n-api.service[61471]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-847899299 Apr 19 16:46:12 user devstack@n-api.service[61471]: X-Tenant-Id: e58ee4833fd147e2a494be5d7634a2fa Apr 19 16:46:12 user devstack@n-api.service[61471]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-847899299 Apr 19 16:46:12 user devstack@n-api.service[61471]: X-User: tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member Apr 19 16:46:12 user devstack@n-api.service[61471]: X-User-Domain-Id: default Apr 19 16:46:12 user devstack@n-api.service[61471]: X-User-Domain-Name: Default Apr 19 16:46:12 user devstack@n-api.service[61471]: X-User-Id: 63f2a02626ca4957823de39c9a31d1b8 Apr 19 16:46:12 user devstack@n-api.service[61471]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member Apr 19 16:46:12 user devstack@n-api.service[61471]: method: > Apr 19 16:46:12 user devstack@n-api.service[61471]: exception: Instance 269dc247-e424-4102-9c7f-1f3da95afebf could not be found. Apr 19 16:46:12 user devstack@n-api.service[61471]: action_args: {'id': '269dc247-e424-4102-9c7f-1f3da95afebf'} Apr 19 16:46:12 user devstack@n-api.service[61471]: {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:46:12 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:46:12 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:46:12 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:46:12 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:46:12 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:46:12 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:46:12 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:46:12 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:46:12 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:46:12 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 269dc247-e424-4102-9c7f-1f3da95afebf could not be found. Apr 19 16:46:12 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:46:12 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:46:12 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:46:12 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:46:12 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:46:12 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:46:12 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:46:12 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:46:12 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:46:12 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:46:12 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 16:46:12 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 16:46:12 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:46:12 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:46:12 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:46:12 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:46:12 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 269dc247-e424-4102-9c7f-1f3da95afebf could not be found. Apr 19 16:46:12 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:46:12 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:46:12 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:46:12 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:46:12 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:46:12 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:46:12 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:46:12 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:46:12 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 269dc247-e424-4102-9c7f-1f3da95afebf could not be found. Apr 19 16:46:12 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:46:12 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-5ab0ba80-9139-4190-b0b9-5f58d7310d1d tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] Returning 404 to user: Instance 269dc247-e424-4102-9c7f-1f3da95afebf could not be found. {{(pid=61471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:46:12 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-5ab0ba80-9139-4190-b0b9-5f58d7310d1d tempest-ServerBootFromVolumeStableRescueTest-847899299 tempest-ServerBootFromVolumeStableRescueTest-847899299-project-member] 10.0.0.210 "GET /compute/v2.1/servers/269dc247-e424-4102-9c7f-1f3da95afebf" status: 404 len: 111 microversion: 2.87 time: 0.048141 Apr 19 16:46:12 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 125/374] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 16:46:12 2023] GET /compute/v2.1/servers/269dc247-e424-4102-9c7f-1f3da95afebf => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 16:46:22 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_api:SELECT=2 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:46:22 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell1:SELECT=2 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:46:22 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-acddf62b-be29-46e9-9688-98c11d7b376b tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Action: 'create', calling method: .version_select at 0x7fd49708fbe0>, body: {"keypair": {"name": "tempest-keypair-1475830126", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCVzyLTXpRht/4IplIOijF73YyifGVkaAiSytyQggnt0OPvYRcgJm5RGqIxT9B/mfwwRRXRT9uwhGIhps0PRfPQfKo7m/XXrWvPv1o7LBVXKnH+jrtD9tBOjFjGN2SyGkw=="}} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:46:22 user devstack@n-api.service[61472]: DEBUG nova.quota [None req-acddf62b-be29-46e9-9688-98c11d7b376b tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Getting quotas for project 15013c46167d404b865c441ba9bc12cb. Resources: {'key_pairs'} {{(pid=61472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 16:46:22 user devstack@n-api.service[61472]: DEBUG nova.quota [None req-acddf62b-be29-46e9-9688-98c11d7b376b tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Getting quotas for user 7854b1c9825048d5b56b2e3b09b1a007 and project 15013c46167d404b865c441ba9bc12cb. Resources: {'key_pairs'} {{(pid=61472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 16:46:22 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-acddf62b-be29-46e9-9688-98c11d7b376b tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.149215 Apr 19 16:46:22 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 123/375] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 16:46:22 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:46:24 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:46:24 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-1f8c7802-7e2f-4aa9-b847-c7d78a7128be tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-1362433718", "imageRef": "ab56c4b1-0117-43b0-84b6-28d06a23f182", "flavorRef": "42", "networks": [{"uuid": "aef3b3b0-246c-4499-a222-d3db41f25800"}], "security_groups": [{"name": "tempest-securitygroup--1513695673"}], "key_name": "tempest-keypair-1475830126", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:46:24 user devstack@n-api.service[61473]: DEBUG nova.network.neutron [None req-1f8c7802-7e2f-4aa9-b847-c7d78a7128be tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] validate_networks() for [('aef3b3b0-246c-4499-a222-d3db41f25800', None, None, None, None, None)] {{(pid=61473) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 16:46:24 user devstack@n-api.service[61473]: DEBUG nova.virt.hardware [None req-1f8c7802-7e2f-4aa9-b847-c7d78a7128be tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Flavor limits 0:0:0 {{(pid=61473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 16:46:24 user devstack@n-api.service[61473]: DEBUG nova.virt.hardware [None req-1f8c7802-7e2f-4aa9-b847-c7d78a7128be tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Image limits 0:0:0 {{(pid=61473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 16:46:24 user devstack@n-api.service[61473]: DEBUG nova.virt.hardware [None req-1f8c7802-7e2f-4aa9-b847-c7d78a7128be tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Flavor pref 0:0:0 {{(pid=61473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 16:46:24 user devstack@n-api.service[61473]: DEBUG nova.virt.hardware [None req-1f8c7802-7e2f-4aa9-b847-c7d78a7128be tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Image pref 0:0:0 {{(pid=61473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 16:46:24 user devstack@n-api.service[61473]: DEBUG nova.virt.hardware [None req-1f8c7802-7e2f-4aa9-b847-c7d78a7128be tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 16:46:24 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-1f8c7802-7e2f-4aa9-b847-c7d78a7128be tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:46:24 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-1f8c7802-7e2f-4aa9-b847-c7d78a7128be tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:46:24 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-1f8c7802-7e2f-4aa9-b847-c7d78a7128be tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:46:24 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-1f8c7802-7e2f-4aa9-b847-c7d78a7128be tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:46:24 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-1f8c7802-7e2f-4aa9-b847-c7d78a7128be tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:46:24 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-1f8c7802-7e2f-4aa9-b847-c7d78a7128be tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:46:24 user devstack@n-api.service[61473]: DEBUG nova.quota [None req-1f8c7802-7e2f-4aa9-b847-c7d78a7128be tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Getting quotas for project 15013c46167d404b865c441ba9bc12cb. Resources: {'instances', 'ram', 'cores'} {{(pid=61473) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 16:46:24 user devstack@n-api.service[61473]: DEBUG nova.quota [None req-1f8c7802-7e2f-4aa9-b847-c7d78a7128be tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Getting quotas for user 7854b1c9825048d5b56b2e3b09b1a007 and project 15013c46167d404b865c441ba9bc12cb. Resources: {'instances', 'ram', 'cores'} {{(pid=61473) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 16:46:24 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-1f8c7802-7e2f-4aa9-b847-c7d78a7128be tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Going to run 1 instances... {{(pid=61473) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 16:46:24 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-1f8c7802-7e2f-4aa9-b847-c7d78a7128be tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] [instance: 195dc6a3-4119-47a1-be3d-4cae7ccb918c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ab56c4b1-0117-43b0-84b6-28d06a23f182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61473) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 16:46:24 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-1f8c7802-7e2f-4aa9-b847-c7d78a7128be tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.820932 Apr 19 16:46:24 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 128/376] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 16:46:24 2023] POST /compute/v2.1/servers => generated 404 bytes in 822 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 16:46:24 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-4fa14fb6-60c4-4660-b673-51253f141c54 tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:46:24 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-4fa14fb6-60c4-4660-b673-51253f141c54 tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] [instance: 195dc6a3-4119-47a1-be3d-4cae7ccb918c] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:46:24 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_api:SELECT=2 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:46:24 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell1:SELECT=2 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:46:25 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-4fa14fb6-60c4-4660-b673-51253f141c54 tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7854b1c9825048d5b56b2e3b09b1a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15013c46167d404b865c441ba9bc12cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:46:25 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-4fa14fb6-60c4-4660-b673-51253f141c54 tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] 10.0.0.210 "GET /compute/v2.1/servers/195dc6a3-4119-47a1-be3d-4cae7ccb918c" status: 200 len: 1240 microversion: 2.1 time: 0.079892 Apr 19 16:46:25 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 126/377] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:46:24 2023] GET /compute/v2.1/servers/195dc6a3-4119-47a1-be3d-4cae7ccb918c => generated 1240 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:46:27 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [req-1336677f-2bdb-40ca-b1db-fea03ae5dd33 req-4863b964-b20c-4aa8-80ef-4ecf7291a302 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "195dc6a3-4119-47a1-be3d-4cae7ccb918c", "tag": "a9dcbf0d-e553-4893-ba3c-54a32cc82871"}]} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:46:27 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-1336677f-2bdb-40ca-b1db-fea03ae5dd33 req-4863b964-b20c-4aa8-80ef-4ecf7291a302 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:46:27 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-1336677f-2bdb-40ca-b1db-fea03ae5dd33 req-4863b964-b20c-4aa8-80ef-4ecf7291a302 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:46:27 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-1336677f-2bdb-40ca-b1db-fea03ae5dd33 req-4863b964-b20c-4aa8-80ef-4ecf7291a302 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:46:27 user devstack@n-api.service[61472]: INFO nova.api.openstack.compute.server_external_events [req-1336677f-2bdb-40ca-b1db-fea03ae5dd33 req-4863b964-b20c-4aa8-80ef-4ecf7291a302 service nova] Creating event network-changed:a9dcbf0d-e553-4893-ba3c-54a32cc82871 for instance 195dc6a3-4119-47a1-be3d-4cae7ccb918c on user Apr 19 16:46:27 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [req-1336677f-2bdb-40ca-b1db-fea03ae5dd33 req-4863b964-b20c-4aa8-80ef-4ecf7291a302 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028820 Apr 19 16:46:27 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 124/378] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:46:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:46:29 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-699489ad-1811-4cb8-8c5a-9d990444ce5a req-25958603-d641-4a47-896a-b10c7460dfc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "195dc6a3-4119-47a1-be3d-4cae7ccb918c", "name": "network-vif-plugged", "status": "completed", "tag": "a9dcbf0d-e553-4893-ba3c-54a32cc82871"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:46:29 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-699489ad-1811-4cb8-8c5a-9d990444ce5a req-25958603-d641-4a47-896a-b10c7460dfc3 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:46:29 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-699489ad-1811-4cb8-8c5a-9d990444ce5a req-25958603-d641-4a47-896a-b10c7460dfc3 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:46:29 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-699489ad-1811-4cb8-8c5a-9d990444ce5a req-25958603-d641-4a47-896a-b10c7460dfc3 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:46:29 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-699489ad-1811-4cb8-8c5a-9d990444ce5a req-25958603-d641-4a47-896a-b10c7460dfc3 service nova] Creating event network-vif-plugged:a9dcbf0d-e553-4893-ba3c-54a32cc82871 for instance 195dc6a3-4119-47a1-be3d-4cae7ccb918c on user Apr 19 16:46:29 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-699489ad-1811-4cb8-8c5a-9d990444ce5a req-25958603-d641-4a47-896a-b10c7460dfc3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030118 Apr 19 16:46:29 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 129/379] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:46:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:46:31 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [req-ff182fae-13bd-4911-b527-bcce6fa41b5c req-7db4ec3c-d8ca-405d-ab34-2a339745d007 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "195dc6a3-4119-47a1-be3d-4cae7ccb918c", "name": "network-vif-plugged", "status": "completed", "tag": "a9dcbf0d-e553-4893-ba3c-54a32cc82871"}]} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:46:31 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-ff182fae-13bd-4911-b527-bcce6fa41b5c req-7db4ec3c-d8ca-405d-ab34-2a339745d007 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:46:31 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-ff182fae-13bd-4911-b527-bcce6fa41b5c req-7db4ec3c-d8ca-405d-ab34-2a339745d007 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:46:31 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-ff182fae-13bd-4911-b527-bcce6fa41b5c req-7db4ec3c-d8ca-405d-ab34-2a339745d007 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:46:31 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-ff182fae-13bd-4911-b527-bcce6fa41b5c req-7db4ec3c-d8ca-405d-ab34-2a339745d007 service nova] Creating event network-vif-plugged:a9dcbf0d-e553-4893-ba3c-54a32cc82871 for instance 195dc6a3-4119-47a1-be3d-4cae7ccb918c on user Apr 19 16:46:31 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [req-ff182fae-13bd-4911-b527-bcce6fa41b5c req-7db4ec3c-d8ca-405d-ab34-2a339745d007 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034624 Apr 19 16:46:31 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 127/380] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:46:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:47:15 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell0:SELECT=4 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:47:15 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:47:15 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell1:SELECT=2 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:47:15 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-88767133-51f7-45f1-8ca0-264da922d7ef tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:47:15 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-88767133-51f7-45f1-8ca0-264da922d7ef tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] [instance: 195dc6a3-4119-47a1-be3d-4cae7ccb918c] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:47:15 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-88767133-51f7-45f1-8ca0-264da922d7ef tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:47:15 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-88767133-51f7-45f1-8ca0-264da922d7ef tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:47:15 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-88767133-51f7-45f1-8ca0-264da922d7ef tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:47:15 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-88767133-51f7-45f1-8ca0-264da922d7ef tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:47:15 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-88767133-51f7-45f1-8ca0-264da922d7ef tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:47:15 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-88767133-51f7-45f1-8ca0-264da922d7ef tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:47:15 user devstack@n-api.service[61472]: DEBUG nova.policy [None req-88767133-51f7-45f1-8ca0-264da922d7ef tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7854b1c9825048d5b56b2e3b09b1a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15013c46167d404b865c441ba9bc12cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61472) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:47:15 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-88767133-51f7-45f1-8ca0-264da922d7ef tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] 10.0.0.210 "GET /compute/v2.1/servers/195dc6a3-4119-47a1-be3d-4cae7ccb918c" status: 200 len: 1555 microversion: 2.1 time: 0.243756 Apr 19 16:47:15 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 125/381] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:47:15 2023] GET /compute/v2.1/servers/195dc6a3-4119-47a1-be3d-4cae7ccb918c => generated 1555 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:48:15 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell0:SELECT=2 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:48:15 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell0:SELECT=6 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:48:15 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:48:15 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell1:SELECT=4 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:48:15 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-c07d4798-4df0-48c6-bd70-ac6335b171c6 tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:48:15 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-c07d4798-4df0-48c6-bd70-ac6335b171c6 tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] [instance: 195dc6a3-4119-47a1-be3d-4cae7ccb918c] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:48:15 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-c07d4798-4df0-48c6-bd70-ac6335b171c6 tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:48:15 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-c07d4798-4df0-48c6-bd70-ac6335b171c6 tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:48:15 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-c07d4798-4df0-48c6-bd70-ac6335b171c6 tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:48:15 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-c07d4798-4df0-48c6-bd70-ac6335b171c6 tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:48:15 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-c07d4798-4df0-48c6-bd70-ac6335b171c6 tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:48:15 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-c07d4798-4df0-48c6-bd70-ac6335b171c6 tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:48:16 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-c07d4798-4df0-48c6-bd70-ac6335b171c6 tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] 10.0.0.210 "GET /compute/v2.1/servers/195dc6a3-4119-47a1-be3d-4cae7ccb918c/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.643854 Apr 19 16:48:16 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 130/382] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 16:48:15 2023] GET /compute/v2.1/servers/195dc6a3-4119-47a1-be3d-4cae7ccb918c/os-interface => generated 283 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:48:16 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell0:SELECT=2 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:48:16 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_api:SELECT=6 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:48:16 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell1:SELECT=2 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:48:16 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [req-5e9ec557-6bd0-4757-93d8-f31fc0d37eaf req-8ab75372-2fcf-4144-8a4d-7b3e3c279b37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "195dc6a3-4119-47a1-be3d-4cae7ccb918c", "tag": "a9dcbf0d-e553-4893-ba3c-54a32cc82871"}]} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:48:16 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-5e9ec557-6bd0-4757-93d8-f31fc0d37eaf req-8ab75372-2fcf-4144-8a4d-7b3e3c279b37 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:48:16 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-5e9ec557-6bd0-4757-93d8-f31fc0d37eaf req-8ab75372-2fcf-4144-8a4d-7b3e3c279b37 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:48:16 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-5e9ec557-6bd0-4757-93d8-f31fc0d37eaf req-8ab75372-2fcf-4144-8a4d-7b3e3c279b37 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:48:16 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-5e9ec557-6bd0-4757-93d8-f31fc0d37eaf req-8ab75372-2fcf-4144-8a4d-7b3e3c279b37 service nova] Creating event network-changed:a9dcbf0d-e553-4893-ba3c-54a32cc82871 for instance 195dc6a3-4119-47a1-be3d-4cae7ccb918c on user Apr 19 16:48:16 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [req-5e9ec557-6bd0-4757-93d8-f31fc0d37eaf req-8ab75372-2fcf-4144-8a4d-7b3e3c279b37 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039660 Apr 19 16:48:16 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 128/383] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:48:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:48:16 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_api:SELECT=2 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:48:16 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell1:SELECT=6 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:48:16 user devstack@n-api.service[61472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 16:48:16 user devstack@n-api.service[61472]: Wed Apr 19 16:48:16 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/195dc6a3-4119-47a1-be3d-4cae7ccb918c/action (ip 10.0.0.210) !!! Apr 19 16:48:16 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-c5563c2e-59eb-448c-b5db-d0595c2d4141 tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-1120387507"}} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:48:16 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-c5563c2e-59eb-448c-b5db-d0595c2d4141 tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] [instance: 195dc6a3-4119-47a1-be3d-4cae7ccb918c] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:48:16 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-c5563c2e-59eb-448c-b5db-d0595c2d4141 tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:48:16 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-c5563c2e-59eb-448c-b5db-d0595c2d4141 tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:48:16 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-c5563c2e-59eb-448c-b5db-d0595c2d4141 tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:48:16 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-c5563c2e-59eb-448c-b5db-d0595c2d4141 tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:48:16 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-c5563c2e-59eb-448c-b5db-d0595c2d4141 tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:48:16 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-c5563c2e-59eb-448c-b5db-d0595c2d4141 tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:48:18 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-c5563c2e-59eb-448c-b5db-d0595c2d4141 tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] 10.0.0.210 "POST /compute/v2.1/servers/195dc6a3-4119-47a1-be3d-4cae7ccb918c/action" status: 202 len: 0 microversion: 2.1 time: 1.202957 Apr 19 16:48:18 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 126/384] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 19 16:48:16 2023] POST /compute/v2.1/servers/195dc6a3-4119-47a1-be3d-4cae7ccb918c/action => generated 0 bytes in 1204 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 19 16:48:18 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-084628cf-0447-4fe4-ad05-7c87125707fb tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Calling method '.version_select at 0x7fd49711f0a0>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:48:18 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-084628cf-0447-4fe4-ad05-7c87125707fb tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] 10.0.0.210 "GET /compute/v2.1/images/4aac634f-c3c2-4cb2-96e6-a75be9a2d31e" status: 200 len: 1609 microversion: 2.1 time: 0.053708 Apr 19 16:48:18 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 131/385] 10.0.0.210 () {62 vars in 1310 bytes} [Wed Apr 19 16:48:18 2023] GET /compute/v2.1/images/4aac634f-c3c2-4cb2-96e6-a75be9a2d31e => generated 1609 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:49:08 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_api:SELECT=2 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:49:08 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell1:SELECT=2 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:49:08 user devstack@n-api.service[61471]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 19 16:49:08 user devstack@n-api.service[61471]: Wed Apr 19 16:49:08 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/images/4aac634f-c3c2-4cb2-96e6-a75be9a2d31e (ip 10.0.0.210) !!! Apr 19 16:49:08 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-967b8b21-5531-452c-9750-9af6ea49526e tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Calling method '.version_select at 0x7fd4970c5d80>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:49:08 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-967b8b21-5531-452c-9750-9af6ea49526e tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] 10.0.0.210 "GET /compute/v2.1/images/4aac634f-c3c2-4cb2-96e6-a75be9a2d31e" status: 200 len: 1723 microversion: 2.1 time: 0.197373 Apr 19 16:49:08 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 129/386] 10.0.0.210 () {62 vars in 1310 bytes} [Wed Apr 19 16:49:08 2023] GET /compute/v2.1/images/4aac634f-c3c2-4cb2-96e6-a75be9a2d31e => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:49:08 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_api:SELECT=2 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:49:08 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:49:08 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-7e368fd0-16a0-4a51-a16a-9a3db0c88a60 tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Calling method '.version_select at 0x7fd4970e2560>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:49:08 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-7e368fd0-16a0-4a51-a16a-9a3db0c88a60 tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] 10.0.0.210 "GET /compute/v2.1/images/4aac634f-c3c2-4cb2-96e6-a75be9a2d31e" status: 200 len: 1723 microversion: 2.1 time: 0.117791 Apr 19 16:49:08 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 127/387] 10.0.0.210 () {62 vars in 1310 bytes} [Wed Apr 19 16:49:08 2023] GET /compute/v2.1/images/4aac634f-c3c2-4cb2-96e6-a75be9a2d31e => generated 1723 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:49:08 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_api:SELECT=2 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:49:08 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell1:SELECT=4 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:49:08 user devstack@n-api.service[61473]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 19 16:49:08 user devstack@n-api.service[61473]: Wed Apr 19 16:49:08 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/195dc6a3-4119-47a1-be3d-4cae7ccb918c (ip 10.0.0.210) !!! Apr 19 16:49:08 user devstack@n-api.service[61473]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 19 16:49:08 user devstack@n-api.service[61473]: Wed Apr 19 16:49:08 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/195dc6a3-4119-47a1-be3d-4cae7ccb918c (ip 10.0.0.210) !!! Apr 19 16:49:08 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-543cc92a-a4b5-4478-9829-799dcfd6478c tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:49:08 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-543cc92a-a4b5-4478-9829-799dcfd6478c tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] [instance: 195dc6a3-4119-47a1-be3d-4cae7ccb918c] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:49:08 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-543cc92a-a4b5-4478-9829-799dcfd6478c tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:49:08 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-543cc92a-a4b5-4478-9829-799dcfd6478c tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:49:08 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-543cc92a-a4b5-4478-9829-799dcfd6478c tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:49:08 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-543cc92a-a4b5-4478-9829-799dcfd6478c tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:49:08 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-543cc92a-a4b5-4478-9829-799dcfd6478c tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:49:08 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-543cc92a-a4b5-4478-9829-799dcfd6478c tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:49:08 user devstack@n-api.service[61473]: DEBUG nova.policy [None req-543cc92a-a4b5-4478-9829-799dcfd6478c tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7854b1c9825048d5b56b2e3b09b1a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15013c46167d404b865c441ba9bc12cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61473) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:49:08 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-543cc92a-a4b5-4478-9829-799dcfd6478c tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] 10.0.0.210 "GET /compute/v2.1/servers/195dc6a3-4119-47a1-be3d-4cae7ccb918c" status: 200 len: 1674 microversion: 2.1 time: 0.310556 Apr 19 16:49:08 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 132/388] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:49:08 2023] GET /compute/v2.1/servers/195dc6a3-4119-47a1-be3d-4cae7ccb918c => generated 1674 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:50:09 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-99606062-98fb-4fb5-9cc0-f7b507008e0c tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:50:09 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-99606062-98fb-4fb5-9cc0-f7b507008e0c tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] [instance: 195dc6a3-4119-47a1-be3d-4cae7ccb918c] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:50:09 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-99606062-98fb-4fb5-9cc0-f7b507008e0c tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:50:09 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-99606062-98fb-4fb5-9cc0-f7b507008e0c tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:50:09 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-99606062-98fb-4fb5-9cc0-f7b507008e0c tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:50:09 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-99606062-98fb-4fb5-9cc0-f7b507008e0c tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:50:09 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-99606062-98fb-4fb5-9cc0-f7b507008e0c tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:50:09 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-99606062-98fb-4fb5-9cc0-f7b507008e0c tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:50:09 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-99606062-98fb-4fb5-9cc0-f7b507008e0c tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7854b1c9825048d5b56b2e3b09b1a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15013c46167d404b865c441ba9bc12cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:50:09 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-99606062-98fb-4fb5-9cc0-f7b507008e0c tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] 10.0.0.210 "GET /compute/v2.1/servers/195dc6a3-4119-47a1-be3d-4cae7ccb918c" status: 200 len: 1674 microversion: 2.1 time: 0.240717 Apr 19 16:50:09 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 130/389] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:50:09 2023] GET /compute/v2.1/servers/195dc6a3-4119-47a1-be3d-4cae7ccb918c => generated 1674 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:50:11 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-23fbc905-89c5-4cf1-8ed4-9acbcd85b786 tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Calling method '.version_select at 0x7fd4970e11b0>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:50:11 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-23fbc905-89c5-4cf1-8ed4-9acbcd85b786 tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/4aac634f-c3c2-4cb2-96e6-a75be9a2d31e" status: 204 len: 0 microversion: 2.1 time: 0.191904 Apr 19 16:50:11 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 128/390] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:50:11 2023] DELETE /compute/v2.1/images/4aac634f-c3c2-4cb2-96e6-a75be9a2d31e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 16:50:11 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_api:SELECT=2 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:50:11 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell1:SELECT=6 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:50:11 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-f29a1fef-48f7-41fd-b4de-7be53e2d534f tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:50:11 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-f29a1fef-48f7-41fd-b4de-7be53e2d534f tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] [instance: 195dc6a3-4119-47a1-be3d-4cae7ccb918c] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:50:11 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-f29a1fef-48f7-41fd-b4de-7be53e2d534f tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:50:11 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-f29a1fef-48f7-41fd-b4de-7be53e2d534f tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:50:11 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-f29a1fef-48f7-41fd-b4de-7be53e2d534f tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:50:11 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-f29a1fef-48f7-41fd-b4de-7be53e2d534f tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:50:11 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-f29a1fef-48f7-41fd-b4de-7be53e2d534f tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:50:11 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-f29a1fef-48f7-41fd-b4de-7be53e2d534f tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:50:11 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-f29a1fef-48f7-41fd-b4de-7be53e2d534f tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] [instance: 195dc6a3-4119-47a1-be3d-4cae7ccb918c] Going to try to terminate instance {{(pid=61473) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 16:50:11 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-f29a1fef-48f7-41fd-b4de-7be53e2d534f tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/195dc6a3-4119-47a1-be3d-4cae7ccb918c" status: 204 len: 0 microversion: 2.1 time: 0.125848 Apr 19 16:50:11 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 133/391] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 16:50:11 2023] DELETE /compute/v2.1/servers/195dc6a3-4119-47a1-be3d-4cae7ccb918c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 16:50:11 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-2925719a-f1e6-4ee6-a2b8-7cabd96f31bf tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:50:11 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-2925719a-f1e6-4ee6-a2b8-7cabd96f31bf tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] [instance: 195dc6a3-4119-47a1-be3d-4cae7ccb918c] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:50:11 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-2925719a-f1e6-4ee6-a2b8-7cabd96f31bf tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:50:11 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-2925719a-f1e6-4ee6-a2b8-7cabd96f31bf tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:50:11 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-2925719a-f1e6-4ee6-a2b8-7cabd96f31bf tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:50:11 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-2925719a-f1e6-4ee6-a2b8-7cabd96f31bf tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:50:11 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-2925719a-f1e6-4ee6-a2b8-7cabd96f31bf tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:50:11 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-2925719a-f1e6-4ee6-a2b8-7cabd96f31bf tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:50:11 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-2925719a-f1e6-4ee6-a2b8-7cabd96f31bf tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7854b1c9825048d5b56b2e3b09b1a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15013c46167d404b865c441ba9bc12cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:50:11 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-2925719a-f1e6-4ee6-a2b8-7cabd96f31bf tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] 10.0.0.210 "GET /compute/v2.1/servers/195dc6a3-4119-47a1-be3d-4cae7ccb918c" status: 200 len: 1680 microversion: 2.1 time: 0.168013 Apr 19 16:50:11 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 131/392] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:50:11 2023] GET /compute/v2.1/servers/195dc6a3-4119-47a1-be3d-4cae7ccb918c => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:50:11 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [req-807920bb-3a0f-4ae6-9f95-c48f74808fc8 req-72f4d295-854b-4efb-b587-df8641a8da34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "195dc6a3-4119-47a1-be3d-4cae7ccb918c", "name": "network-vif-unplugged", "status": "completed", "tag": "a9dcbf0d-e553-4893-ba3c-54a32cc82871"}]} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:50:11 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-807920bb-3a0f-4ae6-9f95-c48f74808fc8 req-72f4d295-854b-4efb-b587-df8641a8da34 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:50:11 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-807920bb-3a0f-4ae6-9f95-c48f74808fc8 req-72f4d295-854b-4efb-b587-df8641a8da34 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:50:11 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-807920bb-3a0f-4ae6-9f95-c48f74808fc8 req-72f4d295-854b-4efb-b587-df8641a8da34 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:50:11 user devstack@n-api.service[61472]: INFO nova.api.openstack.compute.server_external_events [req-807920bb-3a0f-4ae6-9f95-c48f74808fc8 req-72f4d295-854b-4efb-b587-df8641a8da34 service nova] Creating event network-vif-unplugged:a9dcbf0d-e553-4893-ba3c-54a32cc82871 for instance 195dc6a3-4119-47a1-be3d-4cae7ccb918c on user Apr 19 16:50:11 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [req-807920bb-3a0f-4ae6-9f95-c48f74808fc8 req-72f4d295-854b-4efb-b587-df8641a8da34 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091053 Apr 19 16:50:11 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 129/393] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:50:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:50:13 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-9a876955-5a68-4cdd-92cd-fa79ecb24197 req-43b3248e-ff21-46d8-ac6b-80ca5db51648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "195dc6a3-4119-47a1-be3d-4cae7ccb918c", "name": "network-vif-plugged", "status": "completed", "tag": "a9dcbf0d-e553-4893-ba3c-54a32cc82871"}, {"server_uuid": "195dc6a3-4119-47a1-be3d-4cae7ccb918c", "name": "network-vif-plugged", "status": "completed", "tag": "a9dcbf0d-e553-4893-ba3c-54a32cc82871"}, {"server_uuid": "195dc6a3-4119-47a1-be3d-4cae7ccb918c", "name": "network-vif-plugged", "status": "completed", "tag": "a9dcbf0d-e553-4893-ba3c-54a32cc82871"}, {"server_uuid": "195dc6a3-4119-47a1-be3d-4cae7ccb918c", "name": "network-vif-unplugged", "status": "completed", "tag": "a9dcbf0d-e553-4893-ba3c-54a32cc82871"}, {"server_uuid": "195dc6a3-4119-47a1-be3d-4cae7ccb918c", "name": "network-vif-plugged", "status": "completed", "tag": "a9dcbf0d-e553-4893-ba3c-54a32cc82871"}, {"server_uuid": "195dc6a3-4119-47a1-be3d-4cae7ccb918c", "name": "network-vif-deleted", "tag": "a9dcbf0d-e553-4893-ba3c-54a32cc82871"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:50:13 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-9a876955-5a68-4cdd-92cd-fa79ecb24197 req-43b3248e-ff21-46d8-ac6b-80ca5db51648 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:50:13 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-9a876955-5a68-4cdd-92cd-fa79ecb24197 req-43b3248e-ff21-46d8-ac6b-80ca5db51648 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:50:13 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-9a876955-5a68-4cdd-92cd-fa79ecb24197 req-43b3248e-ff21-46d8-ac6b-80ca5db51648 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:50:13 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-9a876955-5a68-4cdd-92cd-fa79ecb24197 req-43b3248e-ff21-46d8-ac6b-80ca5db51648 service nova] Creating event network-vif-plugged:a9dcbf0d-e553-4893-ba3c-54a32cc82871 for instance 195dc6a3-4119-47a1-be3d-4cae7ccb918c on user Apr 19 16:50:13 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-9a876955-5a68-4cdd-92cd-fa79ecb24197 req-43b3248e-ff21-46d8-ac6b-80ca5db51648 service nova] Creating event network-vif-plugged:a9dcbf0d-e553-4893-ba3c-54a32cc82871 for instance 195dc6a3-4119-47a1-be3d-4cae7ccb918c on user Apr 19 16:50:13 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-9a876955-5a68-4cdd-92cd-fa79ecb24197 req-43b3248e-ff21-46d8-ac6b-80ca5db51648 service nova] Creating event network-vif-plugged:a9dcbf0d-e553-4893-ba3c-54a32cc82871 for instance 195dc6a3-4119-47a1-be3d-4cae7ccb918c on user Apr 19 16:50:13 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-9a876955-5a68-4cdd-92cd-fa79ecb24197 req-43b3248e-ff21-46d8-ac6b-80ca5db51648 service nova] Creating event network-vif-unplugged:a9dcbf0d-e553-4893-ba3c-54a32cc82871 for instance 195dc6a3-4119-47a1-be3d-4cae7ccb918c on user Apr 19 16:50:13 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-9a876955-5a68-4cdd-92cd-fa79ecb24197 req-43b3248e-ff21-46d8-ac6b-80ca5db51648 service nova] Creating event network-vif-plugged:a9dcbf0d-e553-4893-ba3c-54a32cc82871 for instance 195dc6a3-4119-47a1-be3d-4cae7ccb918c on user Apr 19 16:50:13 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-9a876955-5a68-4cdd-92cd-fa79ecb24197 req-43b3248e-ff21-46d8-ac6b-80ca5db51648 service nova] Creating event network-vif-deleted:a9dcbf0d-e553-4893-ba3c-54a32cc82871 for instance 195dc6a3-4119-47a1-be3d-4cae7ccb918c on user Apr 19 16:50:13 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-9a876955-5a68-4cdd-92cd-fa79ecb24197 req-43b3248e-ff21-46d8-ac6b-80ca5db51648 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1040 microversion: 2.1 time: 0.031678 Apr 19 16:50:13 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 134/394] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:50:13 2023] POST /compute/v2.1/os-server-external-events => generated 1040 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:51:01 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-3b50ca87-197c-4a65-a9c2-30fa1da0f81c tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:51:01 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-3b50ca87-197c-4a65-a9c2-30fa1da0f81c tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] [instance: 195dc6a3-4119-47a1-be3d-4cae7ccb918c] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:51:01 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_api:SELECT=4 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:51:01 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell1:SELECT=12 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:51:01 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-3b50ca87-197c-4a65-a9c2-30fa1da0f81c tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:51:01 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-3b50ca87-197c-4a65-a9c2-30fa1da0f81c tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:51:01 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-3b50ca87-197c-4a65-a9c2-30fa1da0f81c tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:51:01 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-3b50ca87-197c-4a65-a9c2-30fa1da0f81c tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:51:01 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-3b50ca87-197c-4a65-a9c2-30fa1da0f81c tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:51:01 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-3b50ca87-197c-4a65-a9c2-30fa1da0f81c tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:51:01 user devstack@n-api.service[61471]: INFO nova.api.openstack.wsgi [None req-3b50ca87-197c-4a65-a9c2-30fa1da0f81c tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] HTTP exception thrown: Instance 195dc6a3-4119-47a1-be3d-4cae7ccb918c could not be found. Apr 19 16:51:01 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-3b50ca87-197c-4a65-a9c2-30fa1da0f81c tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Request method failure captured: Apr 19 16:51:01 user devstack@n-api.service[61471]: request: GET /compute/v2.1/servers/195dc6a3-4119-47a1-be3d-4cae7ccb918c HTTP/1.1 Apr 19 16:51:01 user devstack@n-api.service[61471]: Accept: application/json Apr 19 16:51:01 user devstack@n-api.service[61471]: Accept-Encoding: identity Apr 19 16:51:01 user devstack@n-api.service[61471]: Connection: close Apr 19 16:51:01 user devstack@n-api.service[61471]: Content-Length: 0 Apr 19 16:51:01 user devstack@n-api.service[61471]: Content-Type: application/json Apr 19 16:51:01 user devstack@n-api.service[61471]: Host: 10.0.0.210 Apr 19 16:51:01 user devstack@n-api.service[61471]: Openstack-System-Scope: None Apr 19 16:51:01 user devstack@n-api.service[61471]: User-Agent: python-urllib3/1.26.15 Apr 19 16:51:01 user devstack@n-api.service[61471]: X-Auth-Token: gAAAAABkQBresQMyx9E59qdJ9L5XM5mlu4YaAMlqrEQhSVwfHNhVoB82viNkINRQcOFdILKlMqv25wGCRJSP1KcNduumNIJtFMKqcSBXG_aI6MR7kjSIF58X2gTBNuRb-r3f3mpIrFb2QYPbaAJW2ZpgOP0CpIIC4KXaOn1yfpPget2CGZitpSE Apr 19 16:51:01 user devstack@n-api.service[61471]: X-Domain-Id: None Apr 19 16:51:01 user devstack@n-api.service[61471]: X-Domain-Name: None Apr 19 16:51:01 user devstack@n-api.service[61471]: X-Identity-Status: Confirmed Apr 19 16:51:01 user devstack@n-api.service[61471]: X-Is-Admin-Project: True Apr 19 16:51:01 user devstack@n-api.service[61471]: X-Project-Domain-Id: default Apr 19 16:51:01 user devstack@n-api.service[61471]: X-Project-Domain-Name: Default Apr 19 16:51:01 user devstack@n-api.service[61471]: X-Project-Id: 15013c46167d404b865c441ba9bc12cb Apr 19 16:51:01 user devstack@n-api.service[61471]: X-Project-Name: tempest-ServerStableDeviceRescueTest-924463680 Apr 19 16:51:01 user devstack@n-api.service[61471]: X-Role: member,reader Apr 19 16:51:01 user devstack@n-api.service[61471]: X-Roles: member,reader Apr 19 16:51:01 user devstack@n-api.service[61471]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/15013c46167d404b865c441ba9bc12cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/15013c46167d404b865c441ba9bc12cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/15013c46167d404b865c441ba9bc12cb"}]}] Apr 19 16:51:01 user devstack@n-api.service[61471]: X-Tenant: tempest-ServerStableDeviceRescueTest-924463680 Apr 19 16:51:01 user devstack@n-api.service[61471]: X-Tenant-Id: 15013c46167d404b865c441ba9bc12cb Apr 19 16:51:01 user devstack@n-api.service[61471]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-924463680 Apr 19 16:51:01 user devstack@n-api.service[61471]: X-User: tempest-ServerStableDeviceRescueTest-924463680-project-member Apr 19 16:51:01 user devstack@n-api.service[61471]: X-User-Domain-Id: default Apr 19 16:51:01 user devstack@n-api.service[61471]: X-User-Domain-Name: Default Apr 19 16:51:01 user devstack@n-api.service[61471]: X-User-Id: 7854b1c9825048d5b56b2e3b09b1a007 Apr 19 16:51:01 user devstack@n-api.service[61471]: X-User-Name: tempest-ServerStableDeviceRescueTest-924463680-project-member Apr 19 16:51:01 user devstack@n-api.service[61471]: method: > Apr 19 16:51:01 user devstack@n-api.service[61471]: exception: Instance 195dc6a3-4119-47a1-be3d-4cae7ccb918c could not be found. Apr 19 16:51:01 user devstack@n-api.service[61471]: action_args: {'id': '195dc6a3-4119-47a1-be3d-4cae7ccb918c'} Apr 19 16:51:01 user devstack@n-api.service[61471]: {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:51:01 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:51:01 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:51:01 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:51:01 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:51:01 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:51:01 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:51:01 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:51:01 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:51:01 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:51:01 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 195dc6a3-4119-47a1-be3d-4cae7ccb918c could not be found. Apr 19 16:51:01 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:51:01 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:51:01 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:51:01 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:51:01 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:51:01 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:51:01 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:51:01 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:51:01 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:51:01 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:51:01 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 16:51:01 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 16:51:01 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:51:01 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:51:01 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:51:01 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:51:01 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 195dc6a3-4119-47a1-be3d-4cae7ccb918c could not be found. Apr 19 16:51:01 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:51:01 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:51:01 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:51:01 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:51:01 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:51:01 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:51:01 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:51:01 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:51:01 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 195dc6a3-4119-47a1-be3d-4cae7ccb918c could not be found. Apr 19 16:51:01 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 16:51:01 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-3b50ca87-197c-4a65-a9c2-30fa1da0f81c tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Returning 404 to user: Instance 195dc6a3-4119-47a1-be3d-4cae7ccb918c could not be found. {{(pid=61471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:51:01 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-3b50ca87-197c-4a65-a9c2-30fa1da0f81c tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] 10.0.0.210 "GET /compute/v2.1/servers/195dc6a3-4119-47a1-be3d-4cae7ccb918c" status: 404 len: 111 microversion: 2.1 time: 0.030738 Apr 19 16:51:01 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 132/395] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:51:01 2023] GET /compute/v2.1/servers/195dc6a3-4119-47a1-be3d-4cae7ccb918c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 16:51:01 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_api:SELECT=2 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:51:01 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell1:SELECT=2 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:51:01 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-e4d191bb-dcad-4160-844f-8717750e3fbf tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] Calling method '.version_select at 0x7fd4970e1120>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:51:01 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-e4d191bb-dcad-4160-844f-8717750e3fbf tempest-ServerStableDeviceRescueTest-924463680 tempest-ServerStableDeviceRescueTest-924463680-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1475830126" status: 202 len: 0 microversion: 2.1 time: 0.028343 Apr 19 16:51:01 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 130/396] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 19 16:51:01 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1475830126 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 16:51:13 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:51:13 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:51:14 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-5e923fec-9ab6-4e51-97b6-510fc24e2655 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1454926964", "imageRef": "ab56c4b1-0117-43b0-84b6-28d06a23f182", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:51:14 user devstack@n-api.service[61473]: DEBUG nova.network.neutron [None req-5e923fec-9ab6-4e51-97b6-510fc24e2655 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] validate_networks() for [('6ab81d76-e0d9-4e1d-ad43-4eac45172c4f', None, None, None, None, None)] {{(pid=61473) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 16:51:14 user devstack@n-api.service[61473]: DEBUG nova.virt.hardware [None req-5e923fec-9ab6-4e51-97b6-510fc24e2655 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Flavor limits 0:0:0 {{(pid=61473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 16:51:14 user devstack@n-api.service[61473]: DEBUG nova.virt.hardware [None req-5e923fec-9ab6-4e51-97b6-510fc24e2655 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Image limits 0:0:0 {{(pid=61473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 16:51:14 user devstack@n-api.service[61473]: DEBUG nova.virt.hardware [None req-5e923fec-9ab6-4e51-97b6-510fc24e2655 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Flavor pref 0:0:0 {{(pid=61473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 16:51:14 user devstack@n-api.service[61473]: DEBUG nova.virt.hardware [None req-5e923fec-9ab6-4e51-97b6-510fc24e2655 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Image pref 0:0:0 {{(pid=61473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 16:51:14 user devstack@n-api.service[61473]: DEBUG nova.virt.hardware [None req-5e923fec-9ab6-4e51-97b6-510fc24e2655 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 16:51:14 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-5e923fec-9ab6-4e51-97b6-510fc24e2655 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:51:14 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-5e923fec-9ab6-4e51-97b6-510fc24e2655 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:51:14 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-5e923fec-9ab6-4e51-97b6-510fc24e2655 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:51:14 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-5e923fec-9ab6-4e51-97b6-510fc24e2655 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:51:14 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-5e923fec-9ab6-4e51-97b6-510fc24e2655 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:51:14 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-5e923fec-9ab6-4e51-97b6-510fc24e2655 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:51:14 user devstack@n-api.service[61473]: DEBUG nova.quota [None req-5e923fec-9ab6-4e51-97b6-510fc24e2655 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Getting quotas for project 10332fab5ad040f2b272de6b3ae1d60e. Resources: {'instances', 'ram', 'cores'} {{(pid=61473) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 16:51:14 user devstack@n-api.service[61473]: DEBUG nova.quota [None req-5e923fec-9ab6-4e51-97b6-510fc24e2655 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Getting quotas for user 0341ea23d7be440599547b803ea16b73 and project 10332fab5ad040f2b272de6b3ae1d60e. Resources: {'instances', 'ram', 'cores'} {{(pid=61473) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 16:51:14 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-5e923fec-9ab6-4e51-97b6-510fc24e2655 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Going to run 1 instances... {{(pid=61473) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 16:51:14 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-5e923fec-9ab6-4e51-97b6-510fc24e2655 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] [instance: f5cb7b32-dcc7-499e-bff0-8f6ae19bd1d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ab56c4b1-0117-43b0-84b6-28d06a23f182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61473) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 16:51:14 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-5e923fec-9ab6-4e51-97b6-510fc24e2655 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.677785 Apr 19 16:51:14 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 135/397] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 16:51:13 2023] POST /compute/v2.1/servers => generated 381 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 16:51:14 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-48db0877-e1c7-4f59-b770-41383893a9b5 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:51:14 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-48db0877-e1c7-4f59-b770-41383893a9b5 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] [instance: f5cb7b32-dcc7-499e-bff0-8f6ae19bd1d4] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:51:14 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_api:SELECT=2 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:51:14 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell1:SELECT=2 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:51:14 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-48db0877-e1c7-4f59-b770-41383893a9b5 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0341ea23d7be440599547b803ea16b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10332fab5ad040f2b272de6b3ae1d60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:51:14 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-48db0877-e1c7-4f59-b770-41383893a9b5 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f5cb7b32-dcc7-499e-bff0-8f6ae19bd1d4" status: 200 len: 1216 microversion: 2.1 time: 0.074469 Apr 19 16:51:14 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 133/398] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:51:14 2023] GET /compute/v2.1/servers/f5cb7b32-dcc7-499e-bff0-8f6ae19bd1d4 => generated 1216 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:51:14 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:51:14 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-b69a515a-96ff-4257-abbf-83f52ec9fa2d tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-89461688", "imageRef": "ab56c4b1-0117-43b0-84b6-28d06a23f182", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:51:14 user devstack@n-api.service[61472]: DEBUG nova.network.neutron [None req-b69a515a-96ff-4257-abbf-83f52ec9fa2d tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] validate_networks() for [('6ab81d76-e0d9-4e1d-ad43-4eac45172c4f', None, None, None, None, None)] {{(pid=61472) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 16:51:15 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-b69a515a-96ff-4257-abbf-83f52ec9fa2d tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Flavor limits 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 16:51:15 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-b69a515a-96ff-4257-abbf-83f52ec9fa2d tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Image limits 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 16:51:15 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-b69a515a-96ff-4257-abbf-83f52ec9fa2d tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Flavor pref 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 16:51:15 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-b69a515a-96ff-4257-abbf-83f52ec9fa2d tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Image pref 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 16:51:15 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-b69a515a-96ff-4257-abbf-83f52ec9fa2d tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 16:51:15 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-b69a515a-96ff-4257-abbf-83f52ec9fa2d tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:51:15 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-b69a515a-96ff-4257-abbf-83f52ec9fa2d tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:51:15 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-b69a515a-96ff-4257-abbf-83f52ec9fa2d tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:51:15 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-b69a515a-96ff-4257-abbf-83f52ec9fa2d tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:51:15 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-b69a515a-96ff-4257-abbf-83f52ec9fa2d tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:51:15 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-b69a515a-96ff-4257-abbf-83f52ec9fa2d tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:51:15 user devstack@n-api.service[61472]: DEBUG nova.quota [None req-b69a515a-96ff-4257-abbf-83f52ec9fa2d tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Getting quotas for project 10332fab5ad040f2b272de6b3ae1d60e. Resources: {'instances', 'ram', 'cores'} {{(pid=61472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 16:51:15 user devstack@n-api.service[61472]: DEBUG nova.quota [None req-b69a515a-96ff-4257-abbf-83f52ec9fa2d tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Getting quotas for user 0341ea23d7be440599547b803ea16b73 and project 10332fab5ad040f2b272de6b3ae1d60e. Resources: {'instances', 'ram', 'cores'} {{(pid=61472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 16:51:15 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-b69a515a-96ff-4257-abbf-83f52ec9fa2d tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Going to run 1 instances... {{(pid=61472) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 16:51:15 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-b69a515a-96ff-4257-abbf-83f52ec9fa2d tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] [instance: 7d4f732e-989b-48e4-a937-7eca9cabe703] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ab56c4b1-0117-43b0-84b6-28d06a23f182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 16:51:15 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-b69a515a-96ff-4257-abbf-83f52ec9fa2d tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.752022 Apr 19 16:51:15 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 131/399] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 16:51:14 2023] POST /compute/v2.1/servers => generated 381 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 16:51:15 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-0429d8f4-1f2f-4981-bbf5-d5d168f7512f tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:51:15 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-0429d8f4-1f2f-4981-bbf5-d5d168f7512f tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] [instance: 7d4f732e-989b-48e4-a937-7eca9cabe703] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:51:15 user devstack@n-api.service[61473]: DEBUG nova.policy [None req-0429d8f4-1f2f-4981-bbf5-d5d168f7512f tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0341ea23d7be440599547b803ea16b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10332fab5ad040f2b272de6b3ae1d60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61473) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:51:15 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-0429d8f4-1f2f-4981-bbf5-d5d168f7512f tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d4f732e-989b-48e4-a937-7eca9cabe703" status: 200 len: 1214 microversion: 2.1 time: 0.060231 Apr 19 16:51:15 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 136/400] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:51:15 2023] GET /compute/v2.1/servers/7d4f732e-989b-48e4-a937-7eca9cabe703 => generated 1214 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:51:17 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [req-91cc5858-da37-4b90-9f95-897a4d797c8a req-4d05422f-957f-4fc8-916b-9be955f7f909 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5cb7b32-dcc7-499e-bff0-8f6ae19bd1d4", "tag": "ad9e0bc6-bf77-4011-8f02-2b79c30c8a67"}]} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:51:17 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-91cc5858-da37-4b90-9f95-897a4d797c8a req-4d05422f-957f-4fc8-916b-9be955f7f909 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:51:17 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-91cc5858-da37-4b90-9f95-897a4d797c8a req-4d05422f-957f-4fc8-916b-9be955f7f909 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:51:17 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-91cc5858-da37-4b90-9f95-897a4d797c8a req-4d05422f-957f-4fc8-916b-9be955f7f909 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:51:17 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-91cc5858-da37-4b90-9f95-897a4d797c8a req-4d05422f-957f-4fc8-916b-9be955f7f909 service nova] Creating event network-changed:ad9e0bc6-bf77-4011-8f02-2b79c30c8a67 for instance f5cb7b32-dcc7-499e-bff0-8f6ae19bd1d4 on user Apr 19 16:51:17 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [req-91cc5858-da37-4b90-9f95-897a4d797c8a req-4d05422f-957f-4fc8-916b-9be955f7f909 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034661 Apr 19 16:51:17 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 134/401] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:51:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:51:18 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [req-82bb5a5a-8b07-4bc8-a491-81e574ca9f9e req-c1bdc8c7-822a-41e3-971e-1a039fa32fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d4f732e-989b-48e4-a937-7eca9cabe703", "tag": "9dd696ae-d26e-4232-9b60-258c15edfa0d"}]} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:51:18 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-82bb5a5a-8b07-4bc8-a491-81e574ca9f9e req-c1bdc8c7-822a-41e3-971e-1a039fa32fc2 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:51:18 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-82bb5a5a-8b07-4bc8-a491-81e574ca9f9e req-c1bdc8c7-822a-41e3-971e-1a039fa32fc2 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:51:18 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-82bb5a5a-8b07-4bc8-a491-81e574ca9f9e req-c1bdc8c7-822a-41e3-971e-1a039fa32fc2 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:51:18 user devstack@n-api.service[61472]: INFO nova.api.openstack.compute.server_external_events [req-82bb5a5a-8b07-4bc8-a491-81e574ca9f9e req-c1bdc8c7-822a-41e3-971e-1a039fa32fc2 service nova] Creating event network-changed:9dd696ae-d26e-4232-9b60-258c15edfa0d for instance 7d4f732e-989b-48e4-a937-7eca9cabe703 on user Apr 19 16:51:18 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [req-82bb5a5a-8b07-4bc8-a491-81e574ca9f9e req-c1bdc8c7-822a-41e3-971e-1a039fa32fc2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.241919 Apr 19 16:51:18 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 132/402] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:51:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:51:19 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-224fe6f1-d9cb-47a3-9a6a-b15d6632f2a0 req-6a423114-08a6-4a05-a62f-17caeb27e1a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5cb7b32-dcc7-499e-bff0-8f6ae19bd1d4", "name": "network-vif-plugged", "status": "completed", "tag": "ad9e0bc6-bf77-4011-8f02-2b79c30c8a67"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:51:19 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-224fe6f1-d9cb-47a3-9a6a-b15d6632f2a0 req-6a423114-08a6-4a05-a62f-17caeb27e1a6 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:51:19 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-224fe6f1-d9cb-47a3-9a6a-b15d6632f2a0 req-6a423114-08a6-4a05-a62f-17caeb27e1a6 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:51:19 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-224fe6f1-d9cb-47a3-9a6a-b15d6632f2a0 req-6a423114-08a6-4a05-a62f-17caeb27e1a6 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:51:19 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-224fe6f1-d9cb-47a3-9a6a-b15d6632f2a0 req-6a423114-08a6-4a05-a62f-17caeb27e1a6 service nova] Creating event network-vif-plugged:ad9e0bc6-bf77-4011-8f02-2b79c30c8a67 for instance f5cb7b32-dcc7-499e-bff0-8f6ae19bd1d4 on user Apr 19 16:51:19 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-224fe6f1-d9cb-47a3-9a6a-b15d6632f2a0 req-6a423114-08a6-4a05-a62f-17caeb27e1a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084544 Apr 19 16:51:19 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 137/403] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:51:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:51:20 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [req-7e34d1b4-753c-4102-b71d-6b1814d8b495 req-e467e762-c43b-4d15-b4d9-75b648c28c70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d4f732e-989b-48e4-a937-7eca9cabe703", "name": "network-vif-plugged", "status": "completed", "tag": "9dd696ae-d26e-4232-9b60-258c15edfa0d"}]} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:51:20 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-7e34d1b4-753c-4102-b71d-6b1814d8b495 req-e467e762-c43b-4d15-b4d9-75b648c28c70 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:51:20 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-7e34d1b4-753c-4102-b71d-6b1814d8b495 req-e467e762-c43b-4d15-b4d9-75b648c28c70 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:51:20 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-7e34d1b4-753c-4102-b71d-6b1814d8b495 req-e467e762-c43b-4d15-b4d9-75b648c28c70 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:51:20 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-7e34d1b4-753c-4102-b71d-6b1814d8b495 req-e467e762-c43b-4d15-b4d9-75b648c28c70 service nova] Creating event network-vif-plugged:9dd696ae-d26e-4232-9b60-258c15edfa0d for instance 7d4f732e-989b-48e4-a937-7eca9cabe703 on user Apr 19 16:51:20 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [req-7e34d1b4-753c-4102-b71d-6b1814d8b495 req-e467e762-c43b-4d15-b4d9-75b648c28c70 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028967 Apr 19 16:51:20 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 135/404] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:51:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:51:21 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [req-8231b838-118f-4d0b-b7f0-5b871523c272 req-18fa4b0e-1cd0-4c95-a2b6-8da60546d0fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5cb7b32-dcc7-499e-bff0-8f6ae19bd1d4", "name": "network-vif-plugged", "status": "completed", "tag": "ad9e0bc6-bf77-4011-8f02-2b79c30c8a67"}]} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:51:21 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-8231b838-118f-4d0b-b7f0-5b871523c272 req-18fa4b0e-1cd0-4c95-a2b6-8da60546d0fe service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:51:21 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-8231b838-118f-4d0b-b7f0-5b871523c272 req-18fa4b0e-1cd0-4c95-a2b6-8da60546d0fe service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:51:21 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-8231b838-118f-4d0b-b7f0-5b871523c272 req-18fa4b0e-1cd0-4c95-a2b6-8da60546d0fe service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:51:21 user devstack@n-api.service[61472]: INFO nova.api.openstack.compute.server_external_events [req-8231b838-118f-4d0b-b7f0-5b871523c272 req-18fa4b0e-1cd0-4c95-a2b6-8da60546d0fe service nova] Creating event network-vif-plugged:ad9e0bc6-bf77-4011-8f02-2b79c30c8a67 for instance f5cb7b32-dcc7-499e-bff0-8f6ae19bd1d4 on user Apr 19 16:51:21 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [req-8231b838-118f-4d0b-b7f0-5b871523c272 req-18fa4b0e-1cd0-4c95-a2b6-8da60546d0fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027193 Apr 19 16:51:21 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 133/405] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:51:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:51:22 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-249402db-ea57-4bc9-aca5-186defeddf10 req-b3040688-de91-4316-bb21-7b9f4ecdb164 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d4f732e-989b-48e4-a937-7eca9cabe703", "name": "network-vif-plugged", "status": "completed", "tag": "9dd696ae-d26e-4232-9b60-258c15edfa0d"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:51:22 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-249402db-ea57-4bc9-aca5-186defeddf10 req-b3040688-de91-4316-bb21-7b9f4ecdb164 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:51:22 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-249402db-ea57-4bc9-aca5-186defeddf10 req-b3040688-de91-4316-bb21-7b9f4ecdb164 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:51:22 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-249402db-ea57-4bc9-aca5-186defeddf10 req-b3040688-de91-4316-bb21-7b9f4ecdb164 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:51:22 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-249402db-ea57-4bc9-aca5-186defeddf10 req-b3040688-de91-4316-bb21-7b9f4ecdb164 service nova] Creating event network-vif-plugged:9dd696ae-d26e-4232-9b60-258c15edfa0d for instance 7d4f732e-989b-48e4-a937-7eca9cabe703 on user Apr 19 16:51:22 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-249402db-ea57-4bc9-aca5-186defeddf10 req-b3040688-de91-4316-bb21-7b9f4ecdb164 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033538 Apr 19 16:51:22 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 138/406] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:51:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:52:05 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell0:SELECT=2 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:52:05 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_api:SELECT=8 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:52:05 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell1:SELECT=4 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:52:05 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-75fbf248-61d3-40b7-ab9f-8abb2dd2f6cb tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:52:05 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-75fbf248-61d3-40b7-ab9f-8abb2dd2f6cb tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] [instance: 7d4f732e-989b-48e4-a937-7eca9cabe703] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:52:05 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-75fbf248-61d3-40b7-ab9f-8abb2dd2f6cb tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:52:05 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-75fbf248-61d3-40b7-ab9f-8abb2dd2f6cb tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:52:05 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-75fbf248-61d3-40b7-ab9f-8abb2dd2f6cb tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:52:05 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-75fbf248-61d3-40b7-ab9f-8abb2dd2f6cb tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:52:05 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-75fbf248-61d3-40b7-ab9f-8abb2dd2f6cb tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:52:05 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-75fbf248-61d3-40b7-ab9f-8abb2dd2f6cb tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:52:06 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-75fbf248-61d3-40b7-ab9f-8abb2dd2f6cb tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0341ea23d7be440599547b803ea16b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10332fab5ad040f2b272de6b3ae1d60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:52:06 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-75fbf248-61d3-40b7-ab9f-8abb2dd2f6cb tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d4f732e-989b-48e4-a937-7eca9cabe703" status: 200 len: 1501 microversion: 2.1 time: 0.634780 Apr 19 16:52:06 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 136/407] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:52:05 2023] GET /compute/v2.1/servers/7d4f732e-989b-48e4-a937-7eca9cabe703 => generated 1501 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:53:06 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell0:SELECT=2 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:53:06 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell0:SELECT=6 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:53:06 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:53:06 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell1:SELECT=6 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:53:06 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-4fa482ec-0e36-4095-bfee-6ab5a07ffeba tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:53:06 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-4fa482ec-0e36-4095-bfee-6ab5a07ffeba tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] [instance: 7d4f732e-989b-48e4-a937-7eca9cabe703] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:53:06 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-4fa482ec-0e36-4095-bfee-6ab5a07ffeba tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:53:06 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-4fa482ec-0e36-4095-bfee-6ab5a07ffeba tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:53:06 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-4fa482ec-0e36-4095-bfee-6ab5a07ffeba tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:53:06 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-4fa482ec-0e36-4095-bfee-6ab5a07ffeba tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:53:06 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-4fa482ec-0e36-4095-bfee-6ab5a07ffeba tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:53:06 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-4fa482ec-0e36-4095-bfee-6ab5a07ffeba tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:53:06 user devstack@n-api.service[61472]: DEBUG nova.objects.instance [None req-4fa482ec-0e36-4095-bfee-6ab5a07ffeba tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lazy-loading 'flavor' on Instance uuid 7d4f732e-989b-48e4-a937-7eca9cabe703 {{(pid=61472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 19 16:53:06 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-4fa482ec-0e36-4095-bfee-6ab5a07ffeba tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7d4f732e-989b-48e4-a937-7eca9cabe703/action" status: 200 len: 32 microversion: 2.1 time: 0.164949 Apr 19 16:53:06 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 134/408] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 19 16:53:06 2023] POST /compute/v2.1/servers/7d4f732e-989b-48e4-a937-7eca9cabe703/action => generated 32 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 19 16:53:06 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-39e168ba-ac7a-4b07-b958-c64d5fa82a5d tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:53:06 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-39e168ba-ac7a-4b07-b958-c64d5fa82a5d tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] [instance: 7d4f732e-989b-48e4-a937-7eca9cabe703] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:53:06 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell0:SELECT=2 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:53:06 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell0:SELECT=8 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:53:06 user devstack@n-api.service[61473]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 16:53:06 user devstack@n-api.service[61473]: Wed Apr 19 16:53:06 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7d4f732e-989b-48e4-a937-7eca9cabe703 (ip 10.0.0.210) !!! Apr 19 16:53:06 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:53:06 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell1:SELECT=6 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:53:06 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-39e168ba-ac7a-4b07-b958-c64d5fa82a5d tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:53:06 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-39e168ba-ac7a-4b07-b958-c64d5fa82a5d tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:53:06 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-39e168ba-ac7a-4b07-b958-c64d5fa82a5d tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:53:06 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-39e168ba-ac7a-4b07-b958-c64d5fa82a5d tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:53:06 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-39e168ba-ac7a-4b07-b958-c64d5fa82a5d tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:53:06 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-39e168ba-ac7a-4b07-b958-c64d5fa82a5d tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:53:06 user devstack@n-api.service[61473]: DEBUG nova.policy [None req-39e168ba-ac7a-4b07-b958-c64d5fa82a5d tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0341ea23d7be440599547b803ea16b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10332fab5ad040f2b272de6b3ae1d60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61473) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:53:06 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-39e168ba-ac7a-4b07-b958-c64d5fa82a5d tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d4f732e-989b-48e4-a937-7eca9cabe703" status: 200 len: 1507 microversion: 2.1 time: 0.401027 Apr 19 16:53:06 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 139/409] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:53:06 2023] GET /compute/v2.1/servers/7d4f732e-989b-48e4-a937-7eca9cabe703 => generated 1507 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:53:07 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_api:SELECT=2 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:53:07 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell1:SELECT=6 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:53:07 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [req-91bc5da9-3540-469b-86bb-a9cf62b58fee req-57c284f0-6a31-45a3-a3d9-1ce32f9db45b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d4f732e-989b-48e4-a937-7eca9cabe703", "name": "network-vif-unplugged", "status": "completed", "tag": "9dd696ae-d26e-4232-9b60-258c15edfa0d"}]} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:53:07 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-91bc5da9-3540-469b-86bb-a9cf62b58fee req-57c284f0-6a31-45a3-a3d9-1ce32f9db45b service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:53:07 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-91bc5da9-3540-469b-86bb-a9cf62b58fee req-57c284f0-6a31-45a3-a3d9-1ce32f9db45b service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:53:07 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-91bc5da9-3540-469b-86bb-a9cf62b58fee req-57c284f0-6a31-45a3-a3d9-1ce32f9db45b service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:53:07 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-91bc5da9-3540-469b-86bb-a9cf62b58fee req-57c284f0-6a31-45a3-a3d9-1ce32f9db45b service nova] Creating event network-vif-unplugged:9dd696ae-d26e-4232-9b60-258c15edfa0d for instance 7d4f732e-989b-48e4-a937-7eca9cabe703 on user Apr 19 16:53:07 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [req-91bc5da9-3540-469b-86bb-a9cf62b58fee req-57c284f0-6a31-45a3-a3d9-1ce32f9db45b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038816 Apr 19 16:53:07 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 137/410] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:53:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:53:09 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [req-30146d8d-d5b4-45aa-8492-74b121d4577d req-31ffec04-b857-4628-bf4e-19d5e9fec73e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d4f732e-989b-48e4-a937-7eca9cabe703", "name": "network-vif-plugged", "status": "completed", "tag": "9dd696ae-d26e-4232-9b60-258c15edfa0d"}]} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:53:09 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-30146d8d-d5b4-45aa-8492-74b121d4577d req-31ffec04-b857-4628-bf4e-19d5e9fec73e service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:53:09 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-30146d8d-d5b4-45aa-8492-74b121d4577d req-31ffec04-b857-4628-bf4e-19d5e9fec73e service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:53:09 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-30146d8d-d5b4-45aa-8492-74b121d4577d req-31ffec04-b857-4628-bf4e-19d5e9fec73e service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:53:09 user devstack@n-api.service[61472]: INFO nova.api.openstack.compute.server_external_events [req-30146d8d-d5b4-45aa-8492-74b121d4577d req-31ffec04-b857-4628-bf4e-19d5e9fec73e service nova] Creating event network-vif-plugged:9dd696ae-d26e-4232-9b60-258c15edfa0d for instance 7d4f732e-989b-48e4-a937-7eca9cabe703 on user Apr 19 16:53:09 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [req-30146d8d-d5b4-45aa-8492-74b121d4577d req-31ffec04-b857-4628-bf4e-19d5e9fec73e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031928 Apr 19 16:53:09 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 135/411] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:53:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:53:11 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-0a38e956-c072-4a2c-a6e4-3fc56017df2d req-53bf303d-ba25-487b-9f55-1a639e385317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d4f732e-989b-48e4-a937-7eca9cabe703", "name": "network-vif-plugged", "status": "completed", "tag": "9dd696ae-d26e-4232-9b60-258c15edfa0d"}, {"server_uuid": "7d4f732e-989b-48e4-a937-7eca9cabe703", "name": "network-vif-plugged", "status": "completed", "tag": "9dd696ae-d26e-4232-9b60-258c15edfa0d"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:53:11 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-0a38e956-c072-4a2c-a6e4-3fc56017df2d req-53bf303d-ba25-487b-9f55-1a639e385317 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:53:11 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-0a38e956-c072-4a2c-a6e4-3fc56017df2d req-53bf303d-ba25-487b-9f55-1a639e385317 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:53:11 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-0a38e956-c072-4a2c-a6e4-3fc56017df2d req-53bf303d-ba25-487b-9f55-1a639e385317 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:53:11 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-0a38e956-c072-4a2c-a6e4-3fc56017df2d req-53bf303d-ba25-487b-9f55-1a639e385317 service nova] Creating event network-vif-plugged:9dd696ae-d26e-4232-9b60-258c15edfa0d for instance 7d4f732e-989b-48e4-a937-7eca9cabe703 on user Apr 19 16:53:11 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-0a38e956-c072-4a2c-a6e4-3fc56017df2d req-53bf303d-ba25-487b-9f55-1a639e385317 service nova] Creating event network-vif-plugged:9dd696ae-d26e-4232-9b60-258c15edfa0d for instance 7d4f732e-989b-48e4-a937-7eca9cabe703 on user Apr 19 16:53:11 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-0a38e956-c072-4a2c-a6e4-3fc56017df2d req-53bf303d-ba25-487b-9f55-1a639e385317 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031481 Apr 19 16:53:11 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 140/412] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:53:11 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 16:53:56 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell1:SELECT=2 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:53:56 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_api:SELECT=2 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:53:56 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-e5efcbe9-c941-4f9e-8dad-1e83421b8779 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:53:56 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-e5efcbe9-c941-4f9e-8dad-1e83421b8779 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] [instance: 7d4f732e-989b-48e4-a937-7eca9cabe703] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:53:56 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-e5efcbe9-c941-4f9e-8dad-1e83421b8779 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:53:56 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-e5efcbe9-c941-4f9e-8dad-1e83421b8779 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:53:56 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-e5efcbe9-c941-4f9e-8dad-1e83421b8779 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:53:56 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-e5efcbe9-c941-4f9e-8dad-1e83421b8779 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:53:56 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-e5efcbe9-c941-4f9e-8dad-1e83421b8779 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:53:56 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-e5efcbe9-c941-4f9e-8dad-1e83421b8779 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:53:57 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-e5efcbe9-c941-4f9e-8dad-1e83421b8779 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0341ea23d7be440599547b803ea16b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10332fab5ad040f2b272de6b3ae1d60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:53:57 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-e5efcbe9-c941-4f9e-8dad-1e83421b8779 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d4f732e-989b-48e4-a937-7eca9cabe703" status: 200 len: 1487 microversion: 2.1 time: 0.314762 Apr 19 16:53:57 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 138/413] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:53:56 2023] GET /compute/v2.1/servers/7d4f732e-989b-48e4-a937-7eca9cabe703 => generated 1487 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:54:57 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_api:SELECT=4 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:54:57 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:54:57 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-2f648709-519b-46d4-8495-3470a39a5e20 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:54:57 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-2f648709-519b-46d4-8495-3470a39a5e20 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] [instance: f5cb7b32-dcc7-499e-bff0-8f6ae19bd1d4] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:54:57 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-2f648709-519b-46d4-8495-3470a39a5e20 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:54:57 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-2f648709-519b-46d4-8495-3470a39a5e20 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:54:57 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-2f648709-519b-46d4-8495-3470a39a5e20 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:54:57 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-2f648709-519b-46d4-8495-3470a39a5e20 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:54:57 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-2f648709-519b-46d4-8495-3470a39a5e20 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:54:57 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-2f648709-519b-46d4-8495-3470a39a5e20 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:54:57 user devstack@n-api.service[61472]: DEBUG nova.policy [None req-2f648709-519b-46d4-8495-3470a39a5e20 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0341ea23d7be440599547b803ea16b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10332fab5ad040f2b272de6b3ae1d60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61472) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:54:57 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-2f648709-519b-46d4-8495-3470a39a5e20 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f5cb7b32-dcc7-499e-bff0-8f6ae19bd1d4" status: 200 len: 1503 microversion: 2.1 time: 0.338492 Apr 19 16:54:57 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 136/414] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:54:57 2023] GET /compute/v2.1/servers/f5cb7b32-dcc7-499e-bff0-8f6ae19bd1d4 => generated 1503 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:56:00 user devstack@n-api.service[61473]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 16:56:00 user devstack@n-api.service[61473]: Wed Apr 19 16:56:00 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7d4f732e-989b-48e4-a937-7eca9cabe703 (ip 10.0.0.210) !!! Apr 19 16:56:00 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_api:SELECT=4 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:56:00 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell1:SELECT=8 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:56:00 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-9553d63f-74fb-4151-9d69-fe29750bfad7 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:56:00 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-9553d63f-74fb-4151-9d69-fe29750bfad7 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] [instance: 7d4f732e-989b-48e4-a937-7eca9cabe703] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:56:00 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-9553d63f-74fb-4151-9d69-fe29750bfad7 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:56:00 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-9553d63f-74fb-4151-9d69-fe29750bfad7 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:56:00 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-9553d63f-74fb-4151-9d69-fe29750bfad7 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:56:00 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-9553d63f-74fb-4151-9d69-fe29750bfad7 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:56:00 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-9553d63f-74fb-4151-9d69-fe29750bfad7 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:56:00 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-9553d63f-74fb-4151-9d69-fe29750bfad7 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:56:00 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-9553d63f-74fb-4151-9d69-fe29750bfad7 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] [instance: 7d4f732e-989b-48e4-a937-7eca9cabe703] Going to try to terminate instance {{(pid=61473) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 16:56:00 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-9553d63f-74fb-4151-9d69-fe29750bfad7 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7d4f732e-989b-48e4-a937-7eca9cabe703" status: 204 len: 0 microversion: 2.1 time: 0.141801 Apr 19 16:56:00 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 141/415] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 16:56:00 2023] DELETE /compute/v2.1/servers/7d4f732e-989b-48e4-a937-7eca9cabe703 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 16:56:00 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_api:SELECT=2 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:56:00 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell1:SELECT=6 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:56:00 user devstack@n-api.service[61471]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 16:56:00 user devstack@n-api.service[61471]: Wed Apr 19 16:56:00 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7d4f732e-989b-48e4-a937-7eca9cabe703 (ip 10.0.0.210) !!! Apr 19 16:56:00 user devstack@n-api.service[61471]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 16:56:00 user devstack@n-api.service[61471]: Wed Apr 19 16:56:00 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7d4f732e-989b-48e4-a937-7eca9cabe703 (ip 10.0.0.210) !!! Apr 19 16:56:00 user devstack@n-api.service[61471]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 16:56:00 user devstack@n-api.service[61471]: Wed Apr 19 16:56:00 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7d4f732e-989b-48e4-a937-7eca9cabe703 (ip 10.0.0.210) !!! Apr 19 16:56:00 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-08bb101d-8911-4191-8a7e-82ee6fa5f0a9 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:56:00 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-08bb101d-8911-4191-8a7e-82ee6fa5f0a9 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] [instance: 7d4f732e-989b-48e4-a937-7eca9cabe703] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:56:00 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-08bb101d-8911-4191-8a7e-82ee6fa5f0a9 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:56:00 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-08bb101d-8911-4191-8a7e-82ee6fa5f0a9 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:56:00 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-08bb101d-8911-4191-8a7e-82ee6fa5f0a9 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:56:00 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-08bb101d-8911-4191-8a7e-82ee6fa5f0a9 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:56:00 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-08bb101d-8911-4191-8a7e-82ee6fa5f0a9 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:56:00 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-08bb101d-8911-4191-8a7e-82ee6fa5f0a9 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:56:01 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_api:SELECT=2 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:56:01 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell1:SELECT=6 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:56:01 user devstack@n-api.service[61472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 16:56:01 user devstack@n-api.service[61472]: Wed Apr 19 16:56:01 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 19 16:56:01 user devstack@n-api.service[61472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 16:56:01 user devstack@n-api.service[61472]: Wed Apr 19 16:56:01 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 19 16:56:01 user devstack@n-api.service[61472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 16:56:01 user devstack@n-api.service[61472]: Wed Apr 19 16:56:01 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 19 16:56:01 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [req-70095445-5f21-416a-9f91-f3ed45c37d26 req-54ae23cc-6170-4b02-9fd1-2653f283014c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d4f732e-989b-48e4-a937-7eca9cabe703", "name": "network-vif-unplugged", "status": "completed", "tag": "9dd696ae-d26e-4232-9b60-258c15edfa0d"}]} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:56:01 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-70095445-5f21-416a-9f91-f3ed45c37d26 req-54ae23cc-6170-4b02-9fd1-2653f283014c service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:56:01 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-70095445-5f21-416a-9f91-f3ed45c37d26 req-54ae23cc-6170-4b02-9fd1-2653f283014c service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:56:01 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-70095445-5f21-416a-9f91-f3ed45c37d26 req-54ae23cc-6170-4b02-9fd1-2653f283014c service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:56:01 user devstack@n-api.service[61472]: INFO nova.api.openstack.compute.server_external_events [req-70095445-5f21-416a-9f91-f3ed45c37d26 req-54ae23cc-6170-4b02-9fd1-2653f283014c service nova] Creating event network-vif-unplugged:9dd696ae-d26e-4232-9b60-258c15edfa0d for instance 7d4f732e-989b-48e4-a937-7eca9cabe703 on user Apr 19 16:56:01 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [req-70095445-5f21-416a-9f91-f3ed45c37d26 req-54ae23cc-6170-4b02-9fd1-2653f283014c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045075 Apr 19 16:56:01 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 137/416] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:56:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:56:01 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-08bb101d-8911-4191-8a7e-82ee6fa5f0a9 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0341ea23d7be440599547b803ea16b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10332fab5ad040f2b272de6b3ae1d60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:56:01 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-08bb101d-8911-4191-8a7e-82ee6fa5f0a9 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d4f732e-989b-48e4-a937-7eca9cabe703" status: 200 len: 1493 microversion: 2.1 time: 0.518731 Apr 19 16:56:01 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 139/417] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:56:00 2023] GET /compute/v2.1/servers/7d4f732e-989b-48e4-a937-7eca9cabe703 => generated 1493 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:56:03 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-61f913e1-8492-4a7b-b250-ba93aa909941 req-78ae34a5-4fd5-418b-8d1d-d2305e807589 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d4f732e-989b-48e4-a937-7eca9cabe703", "name": "network-vif-plugged", "status": "completed", "tag": "9dd696ae-d26e-4232-9b60-258c15edfa0d"}, {"server_uuid": "7d4f732e-989b-48e4-a937-7eca9cabe703", "name": "network-vif-deleted", "tag": "9dd696ae-d26e-4232-9b60-258c15edfa0d"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:56:03 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-61f913e1-8492-4a7b-b250-ba93aa909941 req-78ae34a5-4fd5-418b-8d1d-d2305e807589 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:56:03 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-61f913e1-8492-4a7b-b250-ba93aa909941 req-78ae34a5-4fd5-418b-8d1d-d2305e807589 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:56:03 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-61f913e1-8492-4a7b-b250-ba93aa909941 req-78ae34a5-4fd5-418b-8d1d-d2305e807589 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:56:03 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-61f913e1-8492-4a7b-b250-ba93aa909941 req-78ae34a5-4fd5-418b-8d1d-d2305e807589 service nova] Creating event network-vif-plugged:9dd696ae-d26e-4232-9b60-258c15edfa0d for instance 7d4f732e-989b-48e4-a937-7eca9cabe703 on user Apr 19 16:56:03 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-61f913e1-8492-4a7b-b250-ba93aa909941 req-78ae34a5-4fd5-418b-8d1d-d2305e807589 service nova] Creating event network-vif-deleted:9dd696ae-d26e-4232-9b60-258c15edfa0d for instance 7d4f732e-989b-48e4-a937-7eca9cabe703 on user Apr 19 16:56:03 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-61f913e1-8492-4a7b-b250-ba93aa909941 req-78ae34a5-4fd5-418b-8d1d-d2305e807589 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030681 Apr 19 16:56:03 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 142/418] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:56:03 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:56:51 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_api:SELECT=2 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:56:51 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell1:SELECT=2 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:56:51 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-41b0b8bb-5f0a-471b-82e5-331803dc8730 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:56:51 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-41b0b8bb-5f0a-471b-82e5-331803dc8730 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] [instance: 7d4f732e-989b-48e4-a937-7eca9cabe703] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:56:51 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-41b0b8bb-5f0a-471b-82e5-331803dc8730 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:56:51 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-41b0b8bb-5f0a-471b-82e5-331803dc8730 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:56:51 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-41b0b8bb-5f0a-471b-82e5-331803dc8730 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:56:51 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-41b0b8bb-5f0a-471b-82e5-331803dc8730 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:56:51 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-41b0b8bb-5f0a-471b-82e5-331803dc8730 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:56:51 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-41b0b8bb-5f0a-471b-82e5-331803dc8730 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:56:51 user devstack@n-api.service[61472]: INFO nova.api.openstack.wsgi [None req-41b0b8bb-5f0a-471b-82e5-331803dc8730 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] HTTP exception thrown: Instance 7d4f732e-989b-48e4-a937-7eca9cabe703 could not be found. Apr 19 16:56:51 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-41b0b8bb-5f0a-471b-82e5-331803dc8730 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Request method failure captured: Apr 19 16:56:51 user devstack@n-api.service[61472]: request: GET /compute/v2.1/servers/7d4f732e-989b-48e4-a937-7eca9cabe703 HTTP/1.1 Apr 19 16:56:51 user devstack@n-api.service[61472]: Accept: application/json Apr 19 16:56:51 user devstack@n-api.service[61472]: Accept-Encoding: identity Apr 19 16:56:51 user devstack@n-api.service[61472]: Connection: close Apr 19 16:56:51 user devstack@n-api.service[61472]: Content-Length: 0 Apr 19 16:56:51 user devstack@n-api.service[61472]: Content-Type: application/json Apr 19 16:56:51 user devstack@n-api.service[61472]: Host: 10.0.0.210 Apr 19 16:56:51 user devstack@n-api.service[61472]: Openstack-System-Scope: None Apr 19 16:56:51 user devstack@n-api.service[61472]: User-Agent: python-urllib3/1.26.15 Apr 19 16:56:51 user devstack@n-api.service[61472]: X-Auth-Token: gAAAAABkQBwBGPwgCGaAkd8FYb0XBsUJ_AAaORR--6zQdNCNxYs76R6HY7MZFotC4Kio0g8hNnfNzSNFOG6ccwCG78sOsY8wNLuvLSTpQpQTE4v3xbAt1Iv2-hD-p4hxgbPPZDzTEWmO6LEbHjfdy6CBv1n2Y87Hjm3dVxR_dBiSX5Lw50oBm0o Apr 19 16:56:51 user devstack@n-api.service[61472]: X-Domain-Id: None Apr 19 16:56:51 user devstack@n-api.service[61472]: X-Domain-Name: None Apr 19 16:56:51 user devstack@n-api.service[61472]: X-Identity-Status: Confirmed Apr 19 16:56:51 user devstack@n-api.service[61472]: X-Is-Admin-Project: True Apr 19 16:56:51 user devstack@n-api.service[61472]: X-Project-Domain-Id: default Apr 19 16:56:51 user devstack@n-api.service[61472]: X-Project-Domain-Name: Default Apr 19 16:56:51 user devstack@n-api.service[61472]: X-Project-Id: 10332fab5ad040f2b272de6b3ae1d60e Apr 19 16:56:51 user devstack@n-api.service[61472]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1873267746 Apr 19 16:56:51 user devstack@n-api.service[61472]: X-Role: member,reader Apr 19 16:56:51 user devstack@n-api.service[61472]: X-Roles: member,reader Apr 19 16:56:51 user devstack@n-api.service[61472]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/10332fab5ad040f2b272de6b3ae1d60e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/10332fab5ad040f2b272de6b3ae1d60e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/10332fab5ad040f2b272de6b3ae1d60e"}]}] Apr 19 16:56:51 user devstack@n-api.service[61472]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1873267746 Apr 19 16:56:51 user devstack@n-api.service[61472]: X-Tenant-Id: 10332fab5ad040f2b272de6b3ae1d60e Apr 19 16:56:51 user devstack@n-api.service[61472]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1873267746 Apr 19 16:56:51 user devstack@n-api.service[61472]: X-User: tempest-ServerRescueNegativeTestJSON-1873267746-project-member Apr 19 16:56:51 user devstack@n-api.service[61472]: X-User-Domain-Id: default Apr 19 16:56:51 user devstack@n-api.service[61472]: X-User-Domain-Name: Default Apr 19 16:56:51 user devstack@n-api.service[61472]: X-User-Id: 0341ea23d7be440599547b803ea16b73 Apr 19 16:56:51 user devstack@n-api.service[61472]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1873267746-project-member Apr 19 16:56:51 user devstack@n-api.service[61472]: method: > Apr 19 16:56:51 user devstack@n-api.service[61472]: exception: Instance 7d4f732e-989b-48e4-a937-7eca9cabe703 could not be found. Apr 19 16:56:51 user devstack@n-api.service[61472]: action_args: {'id': '7d4f732e-989b-48e4-a937-7eca9cabe703'} Apr 19 16:56:51 user devstack@n-api.service[61472]: {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:56:51 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:56:51 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:56:51 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:56:51 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:56:51 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:56:51 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:56:51 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:56:51 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:56:51 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:56:51 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d4f732e-989b-48e4-a937-7eca9cabe703 could not be found. Apr 19 16:56:51 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:56:51 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:56:51 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:56:51 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:56:51 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:56:51 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:56:51 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:56:51 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:56:51 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:56:51 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:56:51 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 16:56:51 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 16:56:51 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:56:51 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:56:51 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:56:51 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:56:51 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d4f732e-989b-48e4-a937-7eca9cabe703 could not be found. Apr 19 16:56:51 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:56:51 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:56:51 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:56:51 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:56:51 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:56:51 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:56:51 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:56:51 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:56:51 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d4f732e-989b-48e4-a937-7eca9cabe703 could not be found. Apr 19 16:56:51 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 16:56:51 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-41b0b8bb-5f0a-471b-82e5-331803dc8730 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Returning 404 to user: Instance 7d4f732e-989b-48e4-a937-7eca9cabe703 could not be found. {{(pid=61472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:56:51 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-41b0b8bb-5f0a-471b-82e5-331803dc8730 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d4f732e-989b-48e4-a937-7eca9cabe703" status: 404 len: 111 microversion: 2.1 time: 0.118488 Apr 19 16:56:51 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 138/419] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:56:51 2023] GET /compute/v2.1/servers/7d4f732e-989b-48e4-a937-7eca9cabe703 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 16:56:51 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_api:SELECT=2 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:56:51 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell1:SELECT=6 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:56:51 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-decd1e87-2b55-484a-bdc2-e2ac01cebfeb tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:56:51 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-decd1e87-2b55-484a-bdc2-e2ac01cebfeb tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] [instance: f5cb7b32-dcc7-499e-bff0-8f6ae19bd1d4] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:56:51 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-decd1e87-2b55-484a-bdc2-e2ac01cebfeb tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:56:51 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-decd1e87-2b55-484a-bdc2-e2ac01cebfeb tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:56:51 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-decd1e87-2b55-484a-bdc2-e2ac01cebfeb tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:56:51 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-decd1e87-2b55-484a-bdc2-e2ac01cebfeb tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:56:51 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-decd1e87-2b55-484a-bdc2-e2ac01cebfeb tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:56:51 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-decd1e87-2b55-484a-bdc2-e2ac01cebfeb tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:56:51 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-decd1e87-2b55-484a-bdc2-e2ac01cebfeb tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] [instance: f5cb7b32-dcc7-499e-bff0-8f6ae19bd1d4] Going to try to terminate instance {{(pid=61471) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 16:56:51 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-decd1e87-2b55-484a-bdc2-e2ac01cebfeb tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f5cb7b32-dcc7-499e-bff0-8f6ae19bd1d4" status: 204 len: 0 microversion: 2.1 time: 0.111162 Apr 19 16:56:51 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 140/420] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 16:56:51 2023] DELETE /compute/v2.1/servers/f5cb7b32-dcc7-499e-bff0-8f6ae19bd1d4 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 16:56:51 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-e94cd1e7-ee2f-4510-910f-bd1574d03307 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:56:51 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-e94cd1e7-ee2f-4510-910f-bd1574d03307 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] [instance: f5cb7b32-dcc7-499e-bff0-8f6ae19bd1d4] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:56:51 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:56:51 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:56:51 user devstack@n-api.service[61473]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 19 16:56:51 user devstack@n-api.service[61473]: Wed Apr 19 16:56:51 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f5cb7b32-dcc7-499e-bff0-8f6ae19bd1d4 (ip 10.0.0.210) !!! Apr 19 16:56:51 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-e94cd1e7-ee2f-4510-910f-bd1574d03307 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:56:51 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-e94cd1e7-ee2f-4510-910f-bd1574d03307 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:56:51 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-e94cd1e7-ee2f-4510-910f-bd1574d03307 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:56:51 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-e94cd1e7-ee2f-4510-910f-bd1574d03307 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:56:51 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-e94cd1e7-ee2f-4510-910f-bd1574d03307 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:56:51 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-e94cd1e7-ee2f-4510-910f-bd1574d03307 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:56:51 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [req-38730246-45ca-4f65-9d21-761c8f6158f9 req-f403f065-4468-42d5-92a6-37e8d21b5c09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5cb7b32-dcc7-499e-bff0-8f6ae19bd1d4", "name": "network-vif-unplugged", "status": "completed", "tag": "ad9e0bc6-bf77-4011-8f02-2b79c30c8a67"}]} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:56:51 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-38730246-45ca-4f65-9d21-761c8f6158f9 req-f403f065-4468-42d5-92a6-37e8d21b5c09 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:56:51 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-38730246-45ca-4f65-9d21-761c8f6158f9 req-f403f065-4468-42d5-92a6-37e8d21b5c09 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:56:51 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-38730246-45ca-4f65-9d21-761c8f6158f9 req-f403f065-4468-42d5-92a6-37e8d21b5c09 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:56:51 user devstack@n-api.service[61472]: INFO nova.api.openstack.compute.server_external_events [req-38730246-45ca-4f65-9d21-761c8f6158f9 req-f403f065-4468-42d5-92a6-37e8d21b5c09 service nova] Creating event network-vif-unplugged:ad9e0bc6-bf77-4011-8f02-2b79c30c8a67 for instance f5cb7b32-dcc7-499e-bff0-8f6ae19bd1d4 on user Apr 19 16:56:51 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [req-38730246-45ca-4f65-9d21-761c8f6158f9 req-f403f065-4468-42d5-92a6-37e8d21b5c09 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081660 Apr 19 16:56:51 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 139/421] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:56:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:56:51 user devstack@n-api.service[61473]: DEBUG nova.policy [None req-e94cd1e7-ee2f-4510-910f-bd1574d03307 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0341ea23d7be440599547b803ea16b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10332fab5ad040f2b272de6b3ae1d60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61473) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:56:51 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-e94cd1e7-ee2f-4510-910f-bd1574d03307 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f5cb7b32-dcc7-499e-bff0-8f6ae19bd1d4" status: 200 len: 1509 microversion: 2.1 time: 0.313275 Apr 19 16:56:51 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 143/422] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:56:51 2023] GET /compute/v2.1/servers/f5cb7b32-dcc7-499e-bff0-8f6ae19bd1d4 => generated 1509 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:56:53 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [req-93a307db-3b7a-4ac0-92b2-e186bc83f005 req-35d6b83c-c031-4aef-8570-0d47c74d02d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5cb7b32-dcc7-499e-bff0-8f6ae19bd1d4", "name": "network-vif-deleted", "tag": "ad9e0bc6-bf77-4011-8f02-2b79c30c8a67"}]} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:56:53 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-93a307db-3b7a-4ac0-92b2-e186bc83f005 req-35d6b83c-c031-4aef-8570-0d47c74d02d0 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:56:53 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-93a307db-3b7a-4ac0-92b2-e186bc83f005 req-35d6b83c-c031-4aef-8570-0d47c74d02d0 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:56:53 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-93a307db-3b7a-4ac0-92b2-e186bc83f005 req-35d6b83c-c031-4aef-8570-0d47c74d02d0 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:56:53 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-93a307db-3b7a-4ac0-92b2-e186bc83f005 req-35d6b83c-c031-4aef-8570-0d47c74d02d0 service nova] Creating event network-vif-deleted:ad9e0bc6-bf77-4011-8f02-2b79c30c8a67 for instance f5cb7b32-dcc7-499e-bff0-8f6ae19bd1d4 on user Apr 19 16:56:53 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [req-93a307db-3b7a-4ac0-92b2-e186bc83f005 req-35d6b83c-c031-4aef-8570-0d47c74d02d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093754 Apr 19 16:56:53 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 141/423] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:56:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:56:54 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [req-3321de4b-32fb-4bc0-9162-759d87662cf2 req-2f18fc44-7a89-4785-ab8c-1af51f046eb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5cb7b32-dcc7-499e-bff0-8f6ae19bd1d4", "name": "network-vif-plugged", "status": "completed", "tag": "ad9e0bc6-bf77-4011-8f02-2b79c30c8a67"}]} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:56:54 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-3321de4b-32fb-4bc0-9162-759d87662cf2 req-2f18fc44-7a89-4785-ab8c-1af51f046eb8 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:56:54 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-3321de4b-32fb-4bc0-9162-759d87662cf2 req-2f18fc44-7a89-4785-ab8c-1af51f046eb8 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:56:54 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-3321de4b-32fb-4bc0-9162-759d87662cf2 req-2f18fc44-7a89-4785-ab8c-1af51f046eb8 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:56:54 user devstack@n-api.service[61472]: INFO nova.api.openstack.compute.server_external_events [req-3321de4b-32fb-4bc0-9162-759d87662cf2 req-2f18fc44-7a89-4785-ab8c-1af51f046eb8 service nova] Creating event network-vif-plugged:ad9e0bc6-bf77-4011-8f02-2b79c30c8a67 for instance f5cb7b32-dcc7-499e-bff0-8f6ae19bd1d4 on user Apr 19 16:56:54 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [req-3321de4b-32fb-4bc0-9162-759d87662cf2 req-2f18fc44-7a89-4785-ab8c-1af51f046eb8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029166 Apr 19 16:56:54 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 140/424] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:56:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:57:42 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-c485ff2c-e351-4214-81b3-552b44c58be9 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:57:42 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-c485ff2c-e351-4214-81b3-552b44c58be9 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] [instance: f5cb7b32-dcc7-499e-bff0-8f6ae19bd1d4] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:57:42 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_api:SELECT=2 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:57:42 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell1:SELECT=6 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:57:42 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-c485ff2c-e351-4214-81b3-552b44c58be9 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:57:42 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-c485ff2c-e351-4214-81b3-552b44c58be9 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:57:42 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-c485ff2c-e351-4214-81b3-552b44c58be9 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:57:42 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-c485ff2c-e351-4214-81b3-552b44c58be9 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:57:42 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-c485ff2c-e351-4214-81b3-552b44c58be9 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:57:42 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-c485ff2c-e351-4214-81b3-552b44c58be9 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:57:42 user devstack@n-api.service[61473]: INFO nova.api.openstack.wsgi [None req-c485ff2c-e351-4214-81b3-552b44c58be9 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] HTTP exception thrown: Instance f5cb7b32-dcc7-499e-bff0-8f6ae19bd1d4 could not be found. Apr 19 16:57:42 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-c485ff2c-e351-4214-81b3-552b44c58be9 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Request method failure captured: Apr 19 16:57:42 user devstack@n-api.service[61473]: request: GET /compute/v2.1/servers/f5cb7b32-dcc7-499e-bff0-8f6ae19bd1d4 HTTP/1.1 Apr 19 16:57:42 user devstack@n-api.service[61473]: Accept: application/json Apr 19 16:57:42 user devstack@n-api.service[61473]: Accept-Encoding: identity Apr 19 16:57:42 user devstack@n-api.service[61473]: Connection: close Apr 19 16:57:42 user devstack@n-api.service[61473]: Content-Length: 0 Apr 19 16:57:42 user devstack@n-api.service[61473]: Content-Type: application/json Apr 19 16:57:42 user devstack@n-api.service[61473]: Host: 10.0.0.210 Apr 19 16:57:42 user devstack@n-api.service[61473]: Openstack-System-Scope: None Apr 19 16:57:42 user devstack@n-api.service[61473]: User-Agent: python-urllib3/1.26.15 Apr 19 16:57:42 user devstack@n-api.service[61473]: X-Auth-Token: gAAAAABkQBwBGPwgCGaAkd8FYb0XBsUJ_AAaORR--6zQdNCNxYs76R6HY7MZFotC4Kio0g8hNnfNzSNFOG6ccwCG78sOsY8wNLuvLSTpQpQTE4v3xbAt1Iv2-hD-p4hxgbPPZDzTEWmO6LEbHjfdy6CBv1n2Y87Hjm3dVxR_dBiSX5Lw50oBm0o Apr 19 16:57:42 user devstack@n-api.service[61473]: X-Domain-Id: None Apr 19 16:57:42 user devstack@n-api.service[61473]: X-Domain-Name: None Apr 19 16:57:42 user devstack@n-api.service[61473]: X-Identity-Status: Confirmed Apr 19 16:57:42 user devstack@n-api.service[61473]: X-Is-Admin-Project: True Apr 19 16:57:42 user devstack@n-api.service[61473]: X-Project-Domain-Id: default Apr 19 16:57:42 user devstack@n-api.service[61473]: X-Project-Domain-Name: Default Apr 19 16:57:42 user devstack@n-api.service[61473]: X-Project-Id: 10332fab5ad040f2b272de6b3ae1d60e Apr 19 16:57:42 user devstack@n-api.service[61473]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1873267746 Apr 19 16:57:42 user devstack@n-api.service[61473]: X-Role: member,reader Apr 19 16:57:42 user devstack@n-api.service[61473]: X-Roles: member,reader Apr 19 16:57:42 user devstack@n-api.service[61473]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/10332fab5ad040f2b272de6b3ae1d60e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/10332fab5ad040f2b272de6b3ae1d60e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/10332fab5ad040f2b272de6b3ae1d60e"}]}] Apr 19 16:57:42 user devstack@n-api.service[61473]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1873267746 Apr 19 16:57:42 user devstack@n-api.service[61473]: X-Tenant-Id: 10332fab5ad040f2b272de6b3ae1d60e Apr 19 16:57:42 user devstack@n-api.service[61473]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1873267746 Apr 19 16:57:42 user devstack@n-api.service[61473]: X-User: tempest-ServerRescueNegativeTestJSON-1873267746-project-member Apr 19 16:57:42 user devstack@n-api.service[61473]: X-User-Domain-Id: default Apr 19 16:57:42 user devstack@n-api.service[61473]: X-User-Domain-Name: Default Apr 19 16:57:42 user devstack@n-api.service[61473]: X-User-Id: 0341ea23d7be440599547b803ea16b73 Apr 19 16:57:42 user devstack@n-api.service[61473]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1873267746-project-member Apr 19 16:57:42 user devstack@n-api.service[61473]: method: > Apr 19 16:57:42 user devstack@n-api.service[61473]: exception: Instance f5cb7b32-dcc7-499e-bff0-8f6ae19bd1d4 could not be found. Apr 19 16:57:42 user devstack@n-api.service[61473]: action_args: {'id': 'f5cb7b32-dcc7-499e-bff0-8f6ae19bd1d4'} Apr 19 16:57:42 user devstack@n-api.service[61473]: {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:57:42 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:57:42 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:57:42 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:57:42 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:57:42 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:57:42 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:57:42 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:57:42 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:57:42 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:57:42 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5cb7b32-dcc7-499e-bff0-8f6ae19bd1d4 could not be found. Apr 19 16:57:42 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:57:42 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:57:42 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:57:42 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:57:42 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:57:42 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:57:42 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:57:42 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:57:42 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:57:42 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:57:42 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 16:57:42 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 16:57:42 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:57:42 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:57:42 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:57:42 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:57:42 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5cb7b32-dcc7-499e-bff0-8f6ae19bd1d4 could not be found. Apr 19 16:57:42 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:57:42 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:57:42 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:57:42 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:57:42 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:57:42 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:57:42 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:57:42 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:57:42 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5cb7b32-dcc7-499e-bff0-8f6ae19bd1d4 could not be found. Apr 19 16:57:42 user devstack@n-api.service[61473]: ERROR nova.api.openstack.wsgi Apr 19 16:57:42 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-c485ff2c-e351-4214-81b3-552b44c58be9 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] Returning 404 to user: Instance f5cb7b32-dcc7-499e-bff0-8f6ae19bd1d4 could not be found. {{(pid=61473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:57:42 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-c485ff2c-e351-4214-81b3-552b44c58be9 tempest-ServerRescueNegativeTestJSON-1873267746 tempest-ServerRescueNegativeTestJSON-1873267746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f5cb7b32-dcc7-499e-bff0-8f6ae19bd1d4" status: 404 len: 111 microversion: 2.1 time: 0.031818 Apr 19 16:57:42 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 144/425] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:57:42 2023] GET /compute/v2.1/servers/f5cb7b32-dcc7-499e-bff0-8f6ae19bd1d4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 16:58:06 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:58:06 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:58:06 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-890ea010-0fbe-4e56-8341-90032da51bac tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Action: 'create', calling method: .version_select at 0x7fd4971f1fc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-81040995", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOphvWPqtEtQAO/y2ceEnAPsIngdpoEvmOcE8jy7OXV4m29A1Kx+XdiosH8kNj+PSCrpMmrovehk90ZGfiGPVanZkUzzEOEL/QZM7905DJab8AamTENpWWuSY9iL2qw5Rg=="}} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:58:06 user devstack@n-api.service[61471]: DEBUG nova.quota [None req-890ea010-0fbe-4e56-8341-90032da51bac tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Getting quotas for project 96ffbf89dd8d4009b88800012f708cde. Resources: {'key_pairs'} {{(pid=61471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 16:58:06 user devstack@n-api.service[61471]: DEBUG nova.quota [None req-890ea010-0fbe-4e56-8341-90032da51bac tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Getting quotas for user 6329dea7be684d3faf681e7da2ee3728 and project 96ffbf89dd8d4009b88800012f708cde. Resources: {'key_pairs'} {{(pid=61471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 16:58:06 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-890ea010-0fbe-4e56-8341-90032da51bac tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.054477 Apr 19 16:58:06 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 142/426] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 16:58:06 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:58:06 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_api:SELECT=6 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:58:06 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell1:SELECT=6 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:58:06 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-7b8cf2b0-350c-4d0e-b207-27f04659a567 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-628996102", "imageRef": "6e22978c-2da6-487d-894c-432bc22fd0aa", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-81040995", "networks": [{"uuid": "e2855b40-37c3-40d9-9962-94e75f189757"}]}} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:58:06 user devstack@n-api.service[61472]: DEBUG nova.network.neutron [None req-7b8cf2b0-350c-4d0e-b207-27f04659a567 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] validate_networks() for [('e2855b40-37c3-40d9-9962-94e75f189757', None, None, None, None, None)] {{(pid=61472) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 16:58:07 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-7b8cf2b0-350c-4d0e-b207-27f04659a567 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Flavor limits 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 16:58:07 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-7b8cf2b0-350c-4d0e-b207-27f04659a567 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Image limits 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 16:58:07 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-7b8cf2b0-350c-4d0e-b207-27f04659a567 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Flavor pref 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 16:58:07 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-7b8cf2b0-350c-4d0e-b207-27f04659a567 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Image pref 0:0:0 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 16:58:07 user devstack@n-api.service[61472]: DEBUG nova.virt.hardware [None req-7b8cf2b0-350c-4d0e-b207-27f04659a567 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 16:58:07 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-7b8cf2b0-350c-4d0e-b207-27f04659a567 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:58:07 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-7b8cf2b0-350c-4d0e-b207-27f04659a567 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:58:07 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-7b8cf2b0-350c-4d0e-b207-27f04659a567 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:58:07 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-7b8cf2b0-350c-4d0e-b207-27f04659a567 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:58:07 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-7b8cf2b0-350c-4d0e-b207-27f04659a567 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:58:07 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-7b8cf2b0-350c-4d0e-b207-27f04659a567 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:58:07 user devstack@n-api.service[61472]: DEBUG nova.quota [None req-7b8cf2b0-350c-4d0e-b207-27f04659a567 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Getting quotas for project 96ffbf89dd8d4009b88800012f708cde. Resources: {'instances', 'ram', 'cores'} {{(pid=61472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 16:58:07 user devstack@n-api.service[61472]: DEBUG nova.quota [None req-7b8cf2b0-350c-4d0e-b207-27f04659a567 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Getting quotas for user 6329dea7be684d3faf681e7da2ee3728 and project 96ffbf89dd8d4009b88800012f708cde. Resources: {'instances', 'ram', 'cores'} {{(pid=61472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 16:58:07 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-7b8cf2b0-350c-4d0e-b207-27f04659a567 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Going to run 1 instances... {{(pid=61472) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 16:58:07 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-7b8cf2b0-350c-4d0e-b207-27f04659a567 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] [instance: cd0d3f52-5e87-4f6b-9ca5-069e9b2f48b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e22978c-2da6-487d-894c-432bc22fd0aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 16:58:07 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-7b8cf2b0-350c-4d0e-b207-27f04659a567 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.682997 Apr 19 16:58:07 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 141/427] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 16:58:06 2023] POST /compute/v2.1/servers => generated 378 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 16:58:07 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-81b5686f-74b1-49bd-b300-3b245299965c tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:58:07 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-81b5686f-74b1-49bd-b300-3b245299965c tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] [instance: cd0d3f52-5e87-4f6b-9ca5-069e9b2f48b3] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:58:07 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_api:SELECT=2 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:58:07 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell1:SELECT=2 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:58:07 user devstack@n-api.service[61473]: DEBUG nova.policy [None req-81b5686f-74b1-49bd-b300-3b245299965c tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6329dea7be684d3faf681e7da2ee3728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ffbf89dd8d4009b88800012f708cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61473) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:58:07 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-81b5686f-74b1-49bd-b300-3b245299965c tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd0d3f52-5e87-4f6b-9ca5-069e9b2f48b3" status: 200 len: 1250 microversion: 2.1 time: 0.068166 Apr 19 16:58:07 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 145/428] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:58:07 2023] GET /compute/v2.1/servers/cd0d3f52-5e87-4f6b-9ca5-069e9b2f48b3 => generated 1250 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:58:09 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [req-2edf036e-27da-4ea2-a211-1630a4a58777 req-c942441f-528d-4245-b14b-560fc91df087 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd0d3f52-5e87-4f6b-9ca5-069e9b2f48b3", "tag": "8cf165f6-ebcf-4667-9006-dfd9377df5f2"}]} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:58:09 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-2edf036e-27da-4ea2-a211-1630a4a58777 req-c942441f-528d-4245-b14b-560fc91df087 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:58:09 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-2edf036e-27da-4ea2-a211-1630a4a58777 req-c942441f-528d-4245-b14b-560fc91df087 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:58:09 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-2edf036e-27da-4ea2-a211-1630a4a58777 req-c942441f-528d-4245-b14b-560fc91df087 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:58:09 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-2edf036e-27da-4ea2-a211-1630a4a58777 req-c942441f-528d-4245-b14b-560fc91df087 service nova] Creating event network-changed:8cf165f6-ebcf-4667-9006-dfd9377df5f2 for instance cd0d3f52-5e87-4f6b-9ca5-069e9b2f48b3 on user Apr 19 16:58:09 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [req-2edf036e-27da-4ea2-a211-1630a4a58777 req-c942441f-528d-4245-b14b-560fc91df087 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034014 Apr 19 16:58:09 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 143/429] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:58:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:58:11 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [req-fc44e2f0-f8a8-4db9-b6a9-7a2dac700059 req-76a83f80-2abc-4dda-bb8b-327ffdbf9a17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd0d3f52-5e87-4f6b-9ca5-069e9b2f48b3", "name": "network-vif-plugged", "status": "completed", "tag": "8cf165f6-ebcf-4667-9006-dfd9377df5f2"}]} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:58:11 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-fc44e2f0-f8a8-4db9-b6a9-7a2dac700059 req-76a83f80-2abc-4dda-bb8b-327ffdbf9a17 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:58:11 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-fc44e2f0-f8a8-4db9-b6a9-7a2dac700059 req-76a83f80-2abc-4dda-bb8b-327ffdbf9a17 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:58:11 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-fc44e2f0-f8a8-4db9-b6a9-7a2dac700059 req-76a83f80-2abc-4dda-bb8b-327ffdbf9a17 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:58:11 user devstack@n-api.service[61472]: INFO nova.api.openstack.compute.server_external_events [req-fc44e2f0-f8a8-4db9-b6a9-7a2dac700059 req-76a83f80-2abc-4dda-bb8b-327ffdbf9a17 service nova] Creating event network-vif-plugged:8cf165f6-ebcf-4667-9006-dfd9377df5f2 for instance cd0d3f52-5e87-4f6b-9ca5-069e9b2f48b3 on user Apr 19 16:58:11 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [req-fc44e2f0-f8a8-4db9-b6a9-7a2dac700059 req-76a83f80-2abc-4dda-bb8b-327ffdbf9a17 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032959 Apr 19 16:58:11 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 142/430] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:58:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:58:13 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-cf3e685b-a26c-4e4e-9f00-ca7b542f0a01 req-041196b1-0898-4c00-b489-4305d86c79c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd0d3f52-5e87-4f6b-9ca5-069e9b2f48b3", "name": "network-vif-plugged", "status": "completed", "tag": "8cf165f6-ebcf-4667-9006-dfd9377df5f2"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 16:58:13 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-cf3e685b-a26c-4e4e-9f00-ca7b542f0a01 req-041196b1-0898-4c00-b489-4305d86c79c6 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:58:13 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-cf3e685b-a26c-4e4e-9f00-ca7b542f0a01 req-041196b1-0898-4c00-b489-4305d86c79c6 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:58:13 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-cf3e685b-a26c-4e4e-9f00-ca7b542f0a01 req-041196b1-0898-4c00-b489-4305d86c79c6 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:58:13 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-cf3e685b-a26c-4e4e-9f00-ca7b542f0a01 req-041196b1-0898-4c00-b489-4305d86c79c6 service nova] Creating event network-vif-plugged:8cf165f6-ebcf-4667-9006-dfd9377df5f2 for instance cd0d3f52-5e87-4f6b-9ca5-069e9b2f48b3 on user Apr 19 16:58:13 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-cf3e685b-a26c-4e4e-9f00-ca7b542f0a01 req-041196b1-0898-4c00-b489-4305d86c79c6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030576 Apr 19 16:58:13 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 146/431] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 16:58:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:58:57 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell0:SELECT=4 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:58:57 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:58:57 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell1:SELECT=2 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:58:57 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-51491e0f-1ff7-486f-9875-b7a4cd7ed282 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:58:57 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-51491e0f-1ff7-486f-9875-b7a4cd7ed282 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] [instance: cd0d3f52-5e87-4f6b-9ca5-069e9b2f48b3] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:58:57 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-51491e0f-1ff7-486f-9875-b7a4cd7ed282 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:58:57 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-51491e0f-1ff7-486f-9875-b7a4cd7ed282 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:58:57 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-51491e0f-1ff7-486f-9875-b7a4cd7ed282 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:58:57 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-51491e0f-1ff7-486f-9875-b7a4cd7ed282 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:58:57 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-51491e0f-1ff7-486f-9875-b7a4cd7ed282 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:58:57 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-51491e0f-1ff7-486f-9875-b7a4cd7ed282 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:58:57 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-51491e0f-1ff7-486f-9875-b7a4cd7ed282 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6329dea7be684d3faf681e7da2ee3728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ffbf89dd8d4009b88800012f708cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:58:57 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-51491e0f-1ff7-486f-9875-b7a4cd7ed282 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd0d3f52-5e87-4f6b-9ca5-069e9b2f48b3" status: 200 len: 1535 microversion: 2.1 time: 0.237839 Apr 19 16:58:57 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 144/432] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:58:57 2023] GET /compute/v2.1/servers/cd0d3f52-5e87-4f6b-9ca5-069e9b2f48b3 => generated 1535 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:59:57 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell0:SELECT=2 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:59:57 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell0:SELECT=6 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:59:57 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:59:57 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell1:SELECT=4 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:59:57 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-42035d3d-b7c1-48a0-a08d-980a8d393b5d tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:59:57 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-42035d3d-b7c1-48a0-a08d-980a8d393b5d tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] [instance: cd0d3f52-5e87-4f6b-9ca5-069e9b2f48b3] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:59:57 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-42035d3d-b7c1-48a0-a08d-980a8d393b5d tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:59:57 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-42035d3d-b7c1-48a0-a08d-980a8d393b5d tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:59:57 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-42035d3d-b7c1-48a0-a08d-980a8d393b5d tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:59:57 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-42035d3d-b7c1-48a0-a08d-980a8d393b5d tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:59:57 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-42035d3d-b7c1-48a0-a08d-980a8d393b5d tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:59:57 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-42035d3d-b7c1-48a0-a08d-980a8d393b5d tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:59:58 user devstack@n-api.service[61472]: DEBUG nova.policy [None req-42035d3d-b7c1-48a0-a08d-980a8d393b5d tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6329dea7be684d3faf681e7da2ee3728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ffbf89dd8d4009b88800012f708cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61472) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:59:58 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-42035d3d-b7c1-48a0-a08d-980a8d393b5d tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd0d3f52-5e87-4f6b-9ca5-069e9b2f48b3" status: 200 len: 1535 microversion: 2.1 time: 0.370151 Apr 19 16:59:58 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 143/433] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:59:57 2023] GET /compute/v2.1/servers/cd0d3f52-5e87-4f6b-9ca5-069e9b2f48b3 => generated 1535 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 16:59:58 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell0:SELECT=2 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:59:58 user devstack@n-api.service[61473]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 16:59:58 user devstack@n-api.service[61473]: Wed Apr 19 16:59:58 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 19 16:59:58 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_api:SELECT=6 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:59:58 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell1:SELECT=2 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:59:58 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-b77d12d4-7cae-4165-8b53-5152e1334a86 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:59:58 user devstack@n-api.service[61473]: DEBUG nova.policy [None req-b77d12d4-7cae-4165-8b53-5152e1334a86 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6329dea7be684d3faf681e7da2ee3728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ffbf89dd8d4009b88800012f708cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61473) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:59:58 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-b77d12d4-7cae-4165-8b53-5152e1334a86 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Searching by: {'deleted': False, 'project_id': '96ffbf89dd8d4009b88800012f708cde'} {{(pid=61473) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 19 16:59:58 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-b77d12d4-7cae-4165-8b53-5152e1334a86 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:59:58 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-b77d12d4-7cae-4165-8b53-5152e1334a86 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:59:58 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-b77d12d4-7cae-4165-8b53-5152e1334a86 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:59:58 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-b77d12d4-7cae-4165-8b53-5152e1334a86 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:59:58 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-b77d12d4-7cae-4165-8b53-5152e1334a86 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:59:58 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-b77d12d4-7cae-4165-8b53-5152e1334a86 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:59:58 user devstack@n-api.service[61473]: DEBUG nova.compute.multi_cell_list [None req-b77d12d4-7cae-4165-8b53-5152e1334a86 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61473) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 19 16:59:58 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-b77d12d4-7cae-4165-8b53-5152e1334a86 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.204958 Apr 19 16:59:58 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 147/434] 10.0.0.210 () {62 vars in 1202 bytes} [Wed Apr 19 16:59:58 2023] GET /compute/v2.1/servers => generated 340 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 16:59:58 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_api:SELECT=2 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:59:58 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell1:SELECT=6 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:59:58 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-a8213268-35bc-4af3-be48-c2901fd2ea83 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:59:58 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-a8213268-35bc-4af3-be48-c2901fd2ea83 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] [instance: cd0d3f52-5e87-4f6b-9ca5-069e9b2f48b3] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:59:58 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-a8213268-35bc-4af3-be48-c2901fd2ea83 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:59:58 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-a8213268-35bc-4af3-be48-c2901fd2ea83 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:59:58 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-a8213268-35bc-4af3-be48-c2901fd2ea83 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:59:58 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-a8213268-35bc-4af3-be48-c2901fd2ea83 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:59:58 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-a8213268-35bc-4af3-be48-c2901fd2ea83 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:59:58 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-a8213268-35bc-4af3-be48-c2901fd2ea83 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:59:58 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-a8213268-35bc-4af3-be48-c2901fd2ea83 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6329dea7be684d3faf681e7da2ee3728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ffbf89dd8d4009b88800012f708cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 16:59:58 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-a8213268-35bc-4af3-be48-c2901fd2ea83 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd0d3f52-5e87-4f6b-9ca5-069e9b2f48b3" status: 200 len: 1535 microversion: 2.1 time: 0.218162 Apr 19 16:59:58 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 145/435] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:59:58 2023] GET /compute/v2.1/servers/cd0d3f52-5e87-4f6b-9ca5-069e9b2f48b3 => generated 1535 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 17:00:00 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-88988b68-a2f2-4a93-84ec-5aebf1563f0c tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 17:00:00 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-88988b68-a2f2-4a93-84ec-5aebf1563f0c tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] [instance: cd0d3f52-5e87-4f6b-9ca5-069e9b2f48b3] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 17:00:00 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-88988b68-a2f2-4a93-84ec-5aebf1563f0c tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 17:00:00 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-88988b68-a2f2-4a93-84ec-5aebf1563f0c tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 17:00:00 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-88988b68-a2f2-4a93-84ec-5aebf1563f0c tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 17:00:00 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-88988b68-a2f2-4a93-84ec-5aebf1563f0c tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 17:00:00 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-88988b68-a2f2-4a93-84ec-5aebf1563f0c tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 17:00:00 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-88988b68-a2f2-4a93-84ec-5aebf1563f0c tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 17:00:00 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-88988b68-a2f2-4a93-84ec-5aebf1563f0c tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] [instance: cd0d3f52-5e87-4f6b-9ca5-069e9b2f48b3] Going to try to terminate instance {{(pid=61472) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 17:00:00 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-88988b68-a2f2-4a93-84ec-5aebf1563f0c tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cd0d3f52-5e87-4f6b-9ca5-069e9b2f48b3" status: 204 len: 0 microversion: 2.1 time: 0.106838 Apr 19 17:00:00 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 144/436] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 17:00:00 2023] DELETE /compute/v2.1/servers/cd0d3f52-5e87-4f6b-9ca5-069e9b2f48b3 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 17:00:00 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-2e4d4044-9aad-49ac-883c-443e75e1d734 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 17:00:00 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-2e4d4044-9aad-49ac-883c-443e75e1d734 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] [instance: cd0d3f52-5e87-4f6b-9ca5-069e9b2f48b3] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 17:00:00 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-2e4d4044-9aad-49ac-883c-443e75e1d734 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 17:00:00 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-2e4d4044-9aad-49ac-883c-443e75e1d734 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 17:00:00 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-2e4d4044-9aad-49ac-883c-443e75e1d734 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 17:00:00 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-2e4d4044-9aad-49ac-883c-443e75e1d734 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 17:00:00 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-2e4d4044-9aad-49ac-883c-443e75e1d734 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 17:00:00 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-2e4d4044-9aad-49ac-883c-443e75e1d734 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 17:00:00 user devstack@n-api.service[61473]: DEBUG nova.policy [None req-2e4d4044-9aad-49ac-883c-443e75e1d734 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6329dea7be684d3faf681e7da2ee3728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ffbf89dd8d4009b88800012f708cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61473) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 17:00:00 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-2e4d4044-9aad-49ac-883c-443e75e1d734 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd0d3f52-5e87-4f6b-9ca5-069e9b2f48b3" status: 200 len: 1541 microversion: 2.1 time: 0.179550 Apr 19 17:00:00 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 148/437] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 17:00:00 2023] GET /compute/v2.1/servers/cd0d3f52-5e87-4f6b-9ca5-069e9b2f48b3 => generated 1541 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 17:00:00 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [req-620725fa-5881-4fbb-aeb5-64f6c08ff437 req-be8b3cda-0217-4c2e-b34c-63f925305816 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd0d3f52-5e87-4f6b-9ca5-069e9b2f48b3", "name": "network-vif-unplugged", "status": "completed", "tag": "8cf165f6-ebcf-4667-9006-dfd9377df5f2"}]} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 17:00:00 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-620725fa-5881-4fbb-aeb5-64f6c08ff437 req-be8b3cda-0217-4c2e-b34c-63f925305816 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 17:00:00 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-620725fa-5881-4fbb-aeb5-64f6c08ff437 req-be8b3cda-0217-4c2e-b34c-63f925305816 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 17:00:00 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-620725fa-5881-4fbb-aeb5-64f6c08ff437 req-be8b3cda-0217-4c2e-b34c-63f925305816 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 17:00:00 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-620725fa-5881-4fbb-aeb5-64f6c08ff437 req-be8b3cda-0217-4c2e-b34c-63f925305816 service nova] Creating event network-vif-unplugged:8cf165f6-ebcf-4667-9006-dfd9377df5f2 for instance cd0d3f52-5e87-4f6b-9ca5-069e9b2f48b3 on user Apr 19 17:00:00 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [req-620725fa-5881-4fbb-aeb5-64f6c08ff437 req-be8b3cda-0217-4c2e-b34c-63f925305816 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030792 Apr 19 17:00:00 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 146/438] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 17:00:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 17:00:01 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [req-444f362f-fc5c-4791-adfd-821d0577ef23 req-1b50e816-be03-4543-98f7-7e93c29e436a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd0d3f52-5e87-4f6b-9ca5-069e9b2f48b3", "name": "network-vif-deleted", "tag": "8cf165f6-ebcf-4667-9006-dfd9377df5f2"}]} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 17:00:01 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-444f362f-fc5c-4791-adfd-821d0577ef23 req-1b50e816-be03-4543-98f7-7e93c29e436a service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 17:00:01 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-444f362f-fc5c-4791-adfd-821d0577ef23 req-1b50e816-be03-4543-98f7-7e93c29e436a service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 17:00:01 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-444f362f-fc5c-4791-adfd-821d0577ef23 req-1b50e816-be03-4543-98f7-7e93c29e436a service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 17:00:01 user devstack@n-api.service[61472]: INFO nova.api.openstack.compute.server_external_events [req-444f362f-fc5c-4791-adfd-821d0577ef23 req-1b50e816-be03-4543-98f7-7e93c29e436a service nova] Creating event network-vif-deleted:8cf165f6-ebcf-4667-9006-dfd9377df5f2 for instance cd0d3f52-5e87-4f6b-9ca5-069e9b2f48b3 on user Apr 19 17:00:01 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [req-444f362f-fc5c-4791-adfd-821d0577ef23 req-1b50e816-be03-4543-98f7-7e93c29e436a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029506 Apr 19 17:00:01 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 145/439] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 17:00:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 17:00:02 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-b3268886-2557-4a5c-bf35-d3a0f4bbe9a2 req-a2c0de6c-56b7-454a-8f5b-f2ba1633147d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd0d3f52-5e87-4f6b-9ca5-069e9b2f48b3", "name": "network-vif-plugged", "status": "completed", "tag": "8cf165f6-ebcf-4667-9006-dfd9377df5f2"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 17:00:02 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-b3268886-2557-4a5c-bf35-d3a0f4bbe9a2 req-a2c0de6c-56b7-454a-8f5b-f2ba1633147d service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 17:00:02 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-b3268886-2557-4a5c-bf35-d3a0f4bbe9a2 req-a2c0de6c-56b7-454a-8f5b-f2ba1633147d service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 17:00:02 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-b3268886-2557-4a5c-bf35-d3a0f4bbe9a2 req-a2c0de6c-56b7-454a-8f5b-f2ba1633147d service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 17:00:02 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-b3268886-2557-4a5c-bf35-d3a0f4bbe9a2 req-a2c0de6c-56b7-454a-8f5b-f2ba1633147d service nova] Creating event network-vif-plugged:8cf165f6-ebcf-4667-9006-dfd9377df5f2 for instance cd0d3f52-5e87-4f6b-9ca5-069e9b2f48b3 on user Apr 19 17:00:02 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-b3268886-2557-4a5c-bf35-d3a0f4bbe9a2 req-a2c0de6c-56b7-454a-8f5b-f2ba1633147d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033493 Apr 19 17:00:02 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 149/440] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 17:00:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 17:00:50 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_api:SELECT=4 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 17:00:50 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell1:SELECT=8 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 17:00:50 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-843ec66c-60d5-4115-84a3-3f278b4b310a tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 17:00:50 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-843ec66c-60d5-4115-84a3-3f278b4b310a tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] [instance: cd0d3f52-5e87-4f6b-9ca5-069e9b2f48b3] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 17:00:50 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-843ec66c-60d5-4115-84a3-3f278b4b310a tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 17:00:50 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-843ec66c-60d5-4115-84a3-3f278b4b310a tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 17:00:50 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-843ec66c-60d5-4115-84a3-3f278b4b310a tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 17:00:50 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-843ec66c-60d5-4115-84a3-3f278b4b310a tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 17:00:50 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-843ec66c-60d5-4115-84a3-3f278b4b310a tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 17:00:50 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-843ec66c-60d5-4115-84a3-3f278b4b310a tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 17:00:50 user devstack@n-api.service[61471]: INFO nova.api.openstack.wsgi [None req-843ec66c-60d5-4115-84a3-3f278b4b310a tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] HTTP exception thrown: Instance cd0d3f52-5e87-4f6b-9ca5-069e9b2f48b3 could not be found. Apr 19 17:00:50 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-843ec66c-60d5-4115-84a3-3f278b4b310a tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Request method failure captured: Apr 19 17:00:50 user devstack@n-api.service[61471]: request: GET /compute/v2.1/servers/cd0d3f52-5e87-4f6b-9ca5-069e9b2f48b3 HTTP/1.1 Apr 19 17:00:50 user devstack@n-api.service[61471]: Accept: application/json Apr 19 17:00:50 user devstack@n-api.service[61471]: Accept-Encoding: identity Apr 19 17:00:50 user devstack@n-api.service[61471]: Connection: close Apr 19 17:00:50 user devstack@n-api.service[61471]: Content-Length: 0 Apr 19 17:00:50 user devstack@n-api.service[61471]: Content-Type: application/json Apr 19 17:00:50 user devstack@n-api.service[61471]: Host: 10.0.0.210 Apr 19 17:00:50 user devstack@n-api.service[61471]: Openstack-System-Scope: None Apr 19 17:00:50 user devstack@n-api.service[61471]: User-Agent: python-urllib3/1.26.15 Apr 19 17:00:50 user devstack@n-api.service[61471]: X-Auth-Token: gAAAAABkQB2WFRu31AdV3LfG8k1RsovUarN_-ahwYCdQZoTPSo76f3YxzZWNTFrq0DHOx0hbABFLTyHH6-a2jkGmDbb5yUqiiwPb3l2PTjrDZUpLMZmJT6s9CpjJxh0nyXJp8nR0KIOgegB5CBNF5S7Ze0CR0fjDzmD22AlxHAGhYDO-D-tRmCE Apr 19 17:00:50 user devstack@n-api.service[61471]: X-Domain-Id: None Apr 19 17:00:50 user devstack@n-api.service[61471]: X-Domain-Name: None Apr 19 17:00:50 user devstack@n-api.service[61471]: X-Identity-Status: Confirmed Apr 19 17:00:50 user devstack@n-api.service[61471]: X-Is-Admin-Project: True Apr 19 17:00:50 user devstack@n-api.service[61471]: X-Project-Domain-Id: default Apr 19 17:00:50 user devstack@n-api.service[61471]: X-Project-Domain-Name: Default Apr 19 17:00:50 user devstack@n-api.service[61471]: X-Project-Id: 96ffbf89dd8d4009b88800012f708cde Apr 19 17:00:50 user devstack@n-api.service[61471]: X-Project-Name: tempest-TestMinimumBasicScenario-588229521 Apr 19 17:00:50 user devstack@n-api.service[61471]: X-Role: member,reader Apr 19 17:00:50 user devstack@n-api.service[61471]: X-Roles: member,reader Apr 19 17:00:50 user devstack@n-api.service[61471]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/96ffbf89dd8d4009b88800012f708cde"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/96ffbf89dd8d4009b88800012f708cde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/96ffbf89dd8d4009b88800012f708cde"}]}] Apr 19 17:00:50 user devstack@n-api.service[61471]: X-Tenant: tempest-TestMinimumBasicScenario-588229521 Apr 19 17:00:50 user devstack@n-api.service[61471]: X-Tenant-Id: 96ffbf89dd8d4009b88800012f708cde Apr 19 17:00:50 user devstack@n-api.service[61471]: X-Tenant-Name: tempest-TestMinimumBasicScenario-588229521 Apr 19 17:00:50 user devstack@n-api.service[61471]: X-User: tempest-TestMinimumBasicScenario-588229521-project-member Apr 19 17:00:50 user devstack@n-api.service[61471]: X-User-Domain-Id: default Apr 19 17:00:50 user devstack@n-api.service[61471]: X-User-Domain-Name: Default Apr 19 17:00:50 user devstack@n-api.service[61471]: X-User-Id: 6329dea7be684d3faf681e7da2ee3728 Apr 19 17:00:50 user devstack@n-api.service[61471]: X-User-Name: tempest-TestMinimumBasicScenario-588229521-project-member Apr 19 17:00:50 user devstack@n-api.service[61471]: method: > Apr 19 17:00:50 user devstack@n-api.service[61471]: exception: Instance cd0d3f52-5e87-4f6b-9ca5-069e9b2f48b3 could not be found. Apr 19 17:00:50 user devstack@n-api.service[61471]: action_args: {'id': 'cd0d3f52-5e87-4f6b-9ca5-069e9b2f48b3'} Apr 19 17:00:50 user devstack@n-api.service[61471]: {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 17:00:50 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 17:00:50 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 17:00:50 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 17:00:50 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 17:00:50 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 17:00:50 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 17:00:50 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 17:00:50 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 17:00:50 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 17:00:50 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd0d3f52-5e87-4f6b-9ca5-069e9b2f48b3 could not be found. Apr 19 17:00:50 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 17:00:50 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 17:00:50 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 17:00:50 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 17:00:50 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 17:00:50 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 17:00:50 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 17:00:50 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 17:00:50 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 17:00:50 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 17:00:50 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 17:00:50 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 17:00:50 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 17:00:50 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 17:00:50 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 17:00:50 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 17:00:50 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd0d3f52-5e87-4f6b-9ca5-069e9b2f48b3 could not be found. Apr 19 17:00:50 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 17:00:50 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 17:00:50 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 17:00:50 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 17:00:50 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 17:00:50 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 17:00:50 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 17:00:50 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 17:00:50 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd0d3f52-5e87-4f6b-9ca5-069e9b2f48b3 could not be found. Apr 19 17:00:50 user devstack@n-api.service[61471]: ERROR nova.api.openstack.wsgi Apr 19 17:00:50 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-843ec66c-60d5-4115-84a3-3f278b4b310a tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Returning 404 to user: Instance cd0d3f52-5e87-4f6b-9ca5-069e9b2f48b3 could not be found. {{(pid=61471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 17:00:50 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-843ec66c-60d5-4115-84a3-3f278b4b310a tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd0d3f52-5e87-4f6b-9ca5-069e9b2f48b3" status: 404 len: 111 microversion: 2.1 time: 0.037244 Apr 19 17:00:50 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 147/441] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 17:00:50 2023] GET /compute/v2.1/servers/cd0d3f52-5e87-4f6b-9ca5-069e9b2f48b3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 17:00:50 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 17:00:50 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 17:00:50 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-b383c4c6-1a5f-4c1b-9ec9-c8141f9d1ee9 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Calling method '.version_select at 0x7fd4970e35b0>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 17:00:50 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-b383c4c6-1a5f-4c1b-9ec9-c8141f9d1ee9 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-81040995" status: 202 len: 0 microversion: 2.1 time: 0.033551 Apr 19 17:00:50 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 146/442] 10.0.0.210 () {62 vars in 1343 bytes} [Wed Apr 19 17:00:50 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-81040995 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 17:00:52 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell0:SELECT=2 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 17:00:52 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_api:SELECT=6 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 17:00:52 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell1:SELECT=16 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 17:00:52 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-2d906a69-abc1-4e8b-a07c-b90da419cce3 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Action: 'create', calling method: .version_select at 0x7fd497076290>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1011995284", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcmZ2/1fZq4IURZz36QhYbRdYeKZxet7t1qYgdLEMW7JW3NCX2n6tYttbp73JcrzCBvGkLNnhBlaUG8Go2BTvsNUipkT0enL5BN3+xl7+Y2FM1XIvwBseTMt+71rYbqVw=="}} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 17:00:52 user devstack@n-api.service[61473]: DEBUG nova.quota [None req-2d906a69-abc1-4e8b-a07c-b90da419cce3 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Getting quotas for project 96ffbf89dd8d4009b88800012f708cde. Resources: {'key_pairs'} {{(pid=61473) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 17:00:52 user devstack@n-api.service[61473]: DEBUG nova.quota [None req-2d906a69-abc1-4e8b-a07c-b90da419cce3 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Getting quotas for user 6329dea7be684d3faf681e7da2ee3728 and project 96ffbf89dd8d4009b88800012f708cde. Resources: {'key_pairs'} {{(pid=61473) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 17:00:52 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-2d906a69-abc1-4e8b-a07c-b90da419cce3 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.056820 Apr 19 17:00:52 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 150/443] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 17:00:52 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 17:00:52 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-462b502c-2766-4a3d-b50d-961b4acacc3d tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-282422571", "imageRef": "93f3a38d-884e-46d5-aa3c-ed412789e994", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1011995284", "networks": [{"uuid": "e2855b40-37c3-40d9-9962-94e75f189757"}]}} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 17:00:52 user devstack@n-api.service[61471]: DEBUG nova.network.neutron [None req-462b502c-2766-4a3d-b50d-961b4acacc3d tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] validate_networks() for [('e2855b40-37c3-40d9-9962-94e75f189757', None, None, None, None, None)] {{(pid=61471) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 17:00:53 user devstack@n-api.service[61471]: DEBUG nova.virt.hardware [None req-462b502c-2766-4a3d-b50d-961b4acacc3d tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Flavor limits 0:0:0 {{(pid=61471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 17:00:53 user devstack@n-api.service[61471]: DEBUG nova.virt.hardware [None req-462b502c-2766-4a3d-b50d-961b4acacc3d tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Image limits 0:0:0 {{(pid=61471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 17:00:53 user devstack@n-api.service[61471]: DEBUG nova.virt.hardware [None req-462b502c-2766-4a3d-b50d-961b4acacc3d tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Flavor pref 0:0:0 {{(pid=61471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 17:00:53 user devstack@n-api.service[61471]: DEBUG nova.virt.hardware [None req-462b502c-2766-4a3d-b50d-961b4acacc3d tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Image pref 0:0:0 {{(pid=61471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 17:00:53 user devstack@n-api.service[61471]: DEBUG nova.virt.hardware [None req-462b502c-2766-4a3d-b50d-961b4acacc3d tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 17:00:53 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-462b502c-2766-4a3d-b50d-961b4acacc3d tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 17:00:53 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-462b502c-2766-4a3d-b50d-961b4acacc3d tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 17:00:53 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-462b502c-2766-4a3d-b50d-961b4acacc3d tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 17:00:53 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-462b502c-2766-4a3d-b50d-961b4acacc3d tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 17:00:53 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-462b502c-2766-4a3d-b50d-961b4acacc3d tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 17:00:53 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-462b502c-2766-4a3d-b50d-961b4acacc3d tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 17:00:53 user devstack@n-api.service[61471]: DEBUG nova.quota [None req-462b502c-2766-4a3d-b50d-961b4acacc3d tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Getting quotas for project 96ffbf89dd8d4009b88800012f708cde. Resources: {'instances', 'ram', 'cores'} {{(pid=61471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 17:00:53 user devstack@n-api.service[61471]: DEBUG nova.quota [None req-462b502c-2766-4a3d-b50d-961b4acacc3d tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Getting quotas for user 6329dea7be684d3faf681e7da2ee3728 and project 96ffbf89dd8d4009b88800012f708cde. Resources: {'instances', 'ram', 'cores'} {{(pid=61471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 17:00:53 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-462b502c-2766-4a3d-b50d-961b4acacc3d tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Going to run 1 instances... {{(pid=61471) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 17:00:53 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-462b502c-2766-4a3d-b50d-961b4acacc3d tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] [instance: b1c91200-9512-4dda-859d-ff9ebc5c446e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='93f3a38d-884e-46d5-aa3c-ed412789e994',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61471) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 17:00:53 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-462b502c-2766-4a3d-b50d-961b4acacc3d tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.597376 Apr 19 17:00:53 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 148/444] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 17:00:52 2023] POST /compute/v2.1/servers => generated 378 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 17:00:53 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-7ef4f9e0-94d1-40ac-9b7e-f03b2340b6fa tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 17:00:53 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-7ef4f9e0-94d1-40ac-9b7e-f03b2340b6fa tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] [instance: b1c91200-9512-4dda-859d-ff9ebc5c446e] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 17:00:53 user devstack@n-api.service[61472]: DEBUG nova.policy [None req-7ef4f9e0-94d1-40ac-9b7e-f03b2340b6fa tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6329dea7be684d3faf681e7da2ee3728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ffbf89dd8d4009b88800012f708cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61472) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 17:00:53 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-7ef4f9e0-94d1-40ac-9b7e-f03b2340b6fa tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b1c91200-9512-4dda-859d-ff9ebc5c446e" status: 200 len: 1252 microversion: 2.1 time: 0.067170 Apr 19 17:00:53 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 147/445] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 17:00:53 2023] GET /compute/v2.1/servers/b1c91200-9512-4dda-859d-ff9ebc5c446e => generated 1252 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 17:00:55 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-381047ca-2656-4f6d-8f67-734127206981 req-b440c6e6-25ce-49c1-bfd3-87f508a4f0af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1c91200-9512-4dda-859d-ff9ebc5c446e", "tag": "6c10cf3a-5590-413f-b656-751024d5dbe2"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 17:00:55 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-381047ca-2656-4f6d-8f67-734127206981 req-b440c6e6-25ce-49c1-bfd3-87f508a4f0af service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 17:00:55 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-381047ca-2656-4f6d-8f67-734127206981 req-b440c6e6-25ce-49c1-bfd3-87f508a4f0af service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 17:00:55 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-381047ca-2656-4f6d-8f67-734127206981 req-b440c6e6-25ce-49c1-bfd3-87f508a4f0af service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 17:00:55 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-381047ca-2656-4f6d-8f67-734127206981 req-b440c6e6-25ce-49c1-bfd3-87f508a4f0af service nova] Creating event network-changed:6c10cf3a-5590-413f-b656-751024d5dbe2 for instance b1c91200-9512-4dda-859d-ff9ebc5c446e on user Apr 19 17:00:55 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-381047ca-2656-4f6d-8f67-734127206981 req-b440c6e6-25ce-49c1-bfd3-87f508a4f0af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028538 Apr 19 17:00:55 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 151/446] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 17:00:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 17:00:58 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [req-827acb6b-6707-4880-9fe3-4be3b5a1d1d1 req-99cdd54f-28ab-4b84-af81-bfe7ac555ef0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1c91200-9512-4dda-859d-ff9ebc5c446e", "name": "network-vif-plugged", "status": "completed", "tag": "6c10cf3a-5590-413f-b656-751024d5dbe2"}]} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 17:00:58 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-827acb6b-6707-4880-9fe3-4be3b5a1d1d1 req-99cdd54f-28ab-4b84-af81-bfe7ac555ef0 service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 17:00:58 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-827acb6b-6707-4880-9fe3-4be3b5a1d1d1 req-99cdd54f-28ab-4b84-af81-bfe7ac555ef0 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 17:00:58 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-827acb6b-6707-4880-9fe3-4be3b5a1d1d1 req-99cdd54f-28ab-4b84-af81-bfe7ac555ef0 service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 17:00:58 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-827acb6b-6707-4880-9fe3-4be3b5a1d1d1 req-99cdd54f-28ab-4b84-af81-bfe7ac555ef0 service nova] Creating event network-vif-plugged:6c10cf3a-5590-413f-b656-751024d5dbe2 for instance b1c91200-9512-4dda-859d-ff9ebc5c446e on user Apr 19 17:00:58 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [req-827acb6b-6707-4880-9fe3-4be3b5a1d1d1 req-99cdd54f-28ab-4b84-af81-bfe7ac555ef0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036536 Apr 19 17:00:58 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 149/447] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 17:00:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 17:01:00 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [req-5db0165e-b301-4bb1-9d48-30c8069e5e8f req-86803076-128e-4001-972b-118db2d159dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1c91200-9512-4dda-859d-ff9ebc5c446e", "name": "network-vif-plugged", "status": "completed", "tag": "6c10cf3a-5590-413f-b656-751024d5dbe2"}]} {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 17:01:00 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-5db0165e-b301-4bb1-9d48-30c8069e5e8f req-86803076-128e-4001-972b-118db2d159dc service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 17:01:00 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-5db0165e-b301-4bb1-9d48-30c8069e5e8f req-86803076-128e-4001-972b-118db2d159dc service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 17:01:00 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [req-5db0165e-b301-4bb1-9d48-30c8069e5e8f req-86803076-128e-4001-972b-118db2d159dc service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 17:01:00 user devstack@n-api.service[61472]: INFO nova.api.openstack.compute.server_external_events [req-5db0165e-b301-4bb1-9d48-30c8069e5e8f req-86803076-128e-4001-972b-118db2d159dc service nova] Creating event network-vif-plugged:6c10cf3a-5590-413f-b656-751024d5dbe2 for instance b1c91200-9512-4dda-859d-ff9ebc5c446e on user Apr 19 17:01:00 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [req-5db0165e-b301-4bb1-9d48-30c8069e5e8f req-86803076-128e-4001-972b-118db2d159dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030735 Apr 19 17:01:00 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 148/448] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 17:01:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 17:01:43 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell0:SELECT=4 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 17:01:43 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 17:01:43 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell1:SELECT=2 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 17:01:43 user devstack@n-api.service[61473]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 17:01:43 user devstack@n-api.service[61473]: Wed Apr 19 17:01:43 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b1c91200-9512-4dda-859d-ff9ebc5c446e (ip 10.0.0.210) !!! Apr 19 17:01:43 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-2661e788-bfa2-4b2c-bc97-68693e949b21 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 17:01:43 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-2661e788-bfa2-4b2c-bc97-68693e949b21 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] [instance: b1c91200-9512-4dda-859d-ff9ebc5c446e] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 17:01:43 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-2661e788-bfa2-4b2c-bc97-68693e949b21 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 17:01:43 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-2661e788-bfa2-4b2c-bc97-68693e949b21 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 17:01:43 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-2661e788-bfa2-4b2c-bc97-68693e949b21 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 17:01:43 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-2661e788-bfa2-4b2c-bc97-68693e949b21 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 17:01:43 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-2661e788-bfa2-4b2c-bc97-68693e949b21 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 17:01:43 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-2661e788-bfa2-4b2c-bc97-68693e949b21 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 17:01:43 user devstack@n-api.service[61473]: DEBUG nova.policy [None req-2661e788-bfa2-4b2c-bc97-68693e949b21 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6329dea7be684d3faf681e7da2ee3728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ffbf89dd8d4009b88800012f708cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61473) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 17:01:43 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-2661e788-bfa2-4b2c-bc97-68693e949b21 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b1c91200-9512-4dda-859d-ff9ebc5c446e" status: 200 len: 1536 microversion: 2.1 time: 0.230863 Apr 19 17:01:43 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 152/449] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 17:01:43 2023] GET /compute/v2.1/servers/b1c91200-9512-4dda-859d-ff9ebc5c446e => generated 1536 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 17:02:43 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell0:SELECT=2 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 17:02:43 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell0:SELECT=6 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 17:02:43 user devstack@n-api.service[61471]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 17:02:43 user devstack@n-api.service[61471]: Wed Apr 19 17:02:43 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b1c91200-9512-4dda-859d-ff9ebc5c446e (ip 10.0.0.210) !!! Apr 19 17:02:43 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 17:02:43 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell1:SELECT=6 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 17:02:43 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-b6471209-acd9-4f8c-8b1e-b5634d54d9cf tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 17:02:43 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-b6471209-acd9-4f8c-8b1e-b5634d54d9cf tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] [instance: b1c91200-9512-4dda-859d-ff9ebc5c446e] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 17:02:43 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-b6471209-acd9-4f8c-8b1e-b5634d54d9cf tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 17:02:43 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-b6471209-acd9-4f8c-8b1e-b5634d54d9cf tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 17:02:43 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-b6471209-acd9-4f8c-8b1e-b5634d54d9cf tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 17:02:43 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-b6471209-acd9-4f8c-8b1e-b5634d54d9cf tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 17:02:43 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-b6471209-acd9-4f8c-8b1e-b5634d54d9cf tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 17:02:43 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-b6471209-acd9-4f8c-8b1e-b5634d54d9cf tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 17:02:44 user devstack@n-api.service[61471]: DEBUG nova.policy [None req-b6471209-acd9-4f8c-8b1e-b5634d54d9cf tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6329dea7be684d3faf681e7da2ee3728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ffbf89dd8d4009b88800012f708cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61471) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 17:02:44 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-b6471209-acd9-4f8c-8b1e-b5634d54d9cf tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b1c91200-9512-4dda-859d-ff9ebc5c446e" status: 200 len: 1536 microversion: 2.1 time: 0.334924 Apr 19 17:02:44 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 150/450] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 17:02:43 2023] GET /compute/v2.1/servers/b1c91200-9512-4dda-859d-ff9ebc5c446e => generated 1536 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 17:02:44 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell0:SELECT=2 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 17:02:44 user devstack@n-api.service[61472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 17:02:44 user devstack@n-api.service[61472]: Wed Apr 19 17:02:44 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 19 17:02:44 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 17:02:44 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell1:SELECT=2 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 17:02:44 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-29a55967-1a1c-4a58-babd-b890ad4a0bc6 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 17:02:44 user devstack@n-api.service[61472]: DEBUG nova.policy [None req-29a55967-1a1c-4a58-babd-b890ad4a0bc6 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6329dea7be684d3faf681e7da2ee3728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ffbf89dd8d4009b88800012f708cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61472) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 17:02:44 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-29a55967-1a1c-4a58-babd-b890ad4a0bc6 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Searching by: {'deleted': False, 'project_id': '96ffbf89dd8d4009b88800012f708cde'} {{(pid=61472) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 19 17:02:44 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-29a55967-1a1c-4a58-babd-b890ad4a0bc6 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 17:02:44 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-29a55967-1a1c-4a58-babd-b890ad4a0bc6 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 17:02:44 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-29a55967-1a1c-4a58-babd-b890ad4a0bc6 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 17:02:44 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-29a55967-1a1c-4a58-babd-b890ad4a0bc6 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 17:02:44 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-29a55967-1a1c-4a58-babd-b890ad4a0bc6 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 17:02:44 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-29a55967-1a1c-4a58-babd-b890ad4a0bc6 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 17:02:44 user devstack@n-api.service[61472]: DEBUG nova.compute.multi_cell_list [None req-29a55967-1a1c-4a58-babd-b890ad4a0bc6 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61472) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 19 17:02:44 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-29a55967-1a1c-4a58-babd-b890ad4a0bc6 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.194476 Apr 19 17:02:44 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 149/451] 10.0.0.210 () {62 vars in 1202 bytes} [Wed Apr 19 17:02:44 2023] GET /compute/v2.1/servers => generated 340 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 17:02:44 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-456186ea-9cdd-4bcd-b9d7-9cb832bf5271 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Calling method '>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 17:02:44 user devstack@n-api.service[61473]: DEBUG nova.compute.api [None req-456186ea-9cdd-4bcd-b9d7-9cb832bf5271 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] [instance: b1c91200-9512-4dda-859d-ff9ebc5c446e] Fetching instance by UUID {{(pid=61473) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 17:02:44 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_api:SELECT=2 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 17:02:44 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell1:SELECT=6 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 17:02:44 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-456186ea-9cdd-4bcd-b9d7-9cb832bf5271 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 17:02:44 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-456186ea-9cdd-4bcd-b9d7-9cb832bf5271 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 17:02:44 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-456186ea-9cdd-4bcd-b9d7-9cb832bf5271 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 17:02:44 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-456186ea-9cdd-4bcd-b9d7-9cb832bf5271 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 17:02:44 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-456186ea-9cdd-4bcd-b9d7-9cb832bf5271 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 17:02:44 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [None req-456186ea-9cdd-4bcd-b9d7-9cb832bf5271 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 17:02:44 user devstack@n-api.service[61473]: DEBUG nova.policy [None req-456186ea-9cdd-4bcd-b9d7-9cb832bf5271 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6329dea7be684d3faf681e7da2ee3728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ffbf89dd8d4009b88800012f708cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61473) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 17:02:44 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-456186ea-9cdd-4bcd-b9d7-9cb832bf5271 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b1c91200-9512-4dda-859d-ff9ebc5c446e" status: 200 len: 1536 microversion: 2.1 time: 0.210399 Apr 19 17:02:44 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 153/452] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 17:02:44 2023] GET /compute/v2.1/servers/b1c91200-9512-4dda-859d-ff9ebc5c446e => generated 1536 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 17:02:46 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-77b7808a-aeaf-4150-b823-c22d6a6f9c3f tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Calling method '>' {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 17:02:46 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-77b7808a-aeaf-4150-b823-c22d6a6f9c3f tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] [instance: b1c91200-9512-4dda-859d-ff9ebc5c446e] Fetching instance by UUID {{(pid=61471) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 17:02:46 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-77b7808a-aeaf-4150-b823-c22d6a6f9c3f tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 17:02:46 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-77b7808a-aeaf-4150-b823-c22d6a6f9c3f tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 17:02:46 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-77b7808a-aeaf-4150-b823-c22d6a6f9c3f tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 17:02:46 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-77b7808a-aeaf-4150-b823-c22d6a6f9c3f tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 17:02:46 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-77b7808a-aeaf-4150-b823-c22d6a6f9c3f tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 17:02:46 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [None req-77b7808a-aeaf-4150-b823-c22d6a6f9c3f tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 17:02:46 user devstack@n-api.service[61471]: DEBUG nova.compute.api [None req-77b7808a-aeaf-4150-b823-c22d6a6f9c3f tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] [instance: b1c91200-9512-4dda-859d-ff9ebc5c446e] Going to try to terminate instance {{(pid=61471) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 17:02:46 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-77b7808a-aeaf-4150-b823-c22d6a6f9c3f tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b1c91200-9512-4dda-859d-ff9ebc5c446e" status: 204 len: 0 microversion: 2.1 time: 0.135631 Apr 19 17:02:46 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 151/453] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 17:02:46 2023] DELETE /compute/v2.1/servers/b1c91200-9512-4dda-859d-ff9ebc5c446e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 17:02:46 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-67493069-9863-49cb-84de-dbc735601fa8 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 17:02:46 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-67493069-9863-49cb-84de-dbc735601fa8 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] [instance: b1c91200-9512-4dda-859d-ff9ebc5c446e] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 17:02:46 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-67493069-9863-49cb-84de-dbc735601fa8 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 17:02:46 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-67493069-9863-49cb-84de-dbc735601fa8 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 17:02:46 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-67493069-9863-49cb-84de-dbc735601fa8 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 17:02:46 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-67493069-9863-49cb-84de-dbc735601fa8 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 17:02:46 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-67493069-9863-49cb-84de-dbc735601fa8 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 17:02:46 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-67493069-9863-49cb-84de-dbc735601fa8 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 17:02:46 user devstack@n-api.service[61472]: DEBUG nova.policy [None req-67493069-9863-49cb-84de-dbc735601fa8 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6329dea7be684d3faf681e7da2ee3728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ffbf89dd8d4009b88800012f708cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61472) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 17:02:46 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-67493069-9863-49cb-84de-dbc735601fa8 tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b1c91200-9512-4dda-859d-ff9ebc5c446e" status: 200 len: 1542 microversion: 2.1 time: 0.267751 Apr 19 17:02:46 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 150/454] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 17:02:46 2023] GET /compute/v2.1/servers/b1c91200-9512-4dda-859d-ff9ebc5c446e => generated 1542 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 17:02:46 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [req-16c564ed-16ea-4495-b7c5-be4f632a83b5 req-3a670926-2865-4e08-b8e9-3faa0ab9a7fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1c91200-9512-4dda-859d-ff9ebc5c446e", "name": "network-vif-unplugged", "status": "completed", "tag": "6c10cf3a-5590-413f-b656-751024d5dbe2"}]} {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 17:02:46 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-16c564ed-16ea-4495-b7c5-be4f632a83b5 req-3a670926-2865-4e08-b8e9-3faa0ab9a7fb service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 17:02:46 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-16c564ed-16ea-4495-b7c5-be4f632a83b5 req-3a670926-2865-4e08-b8e9-3faa0ab9a7fb service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 17:02:46 user devstack@n-api.service[61473]: DEBUG oslo_concurrency.lockutils [req-16c564ed-16ea-4495-b7c5-be4f632a83b5 req-3a670926-2865-4e08-b8e9-3faa0ab9a7fb service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61473) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 17:02:46 user devstack@n-api.service[61473]: INFO nova.api.openstack.compute.server_external_events [req-16c564ed-16ea-4495-b7c5-be4f632a83b5 req-3a670926-2865-4e08-b8e9-3faa0ab9a7fb service nova] Creating event network-vif-unplugged:6c10cf3a-5590-413f-b656-751024d5dbe2 for instance b1c91200-9512-4dda-859d-ff9ebc5c446e on user Apr 19 17:02:46 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [req-16c564ed-16ea-4495-b7c5-be4f632a83b5 req-3a670926-2865-4e08-b8e9-3faa0ab9a7fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.124389 Apr 19 17:02:46 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 154/455] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 17:02:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 17:02:48 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [req-b8dbdab9-040f-495a-80ca-59f2026fbdd1 req-39dfaa90-7a77-4512-829b-7d4df01d89ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1c91200-9512-4dda-859d-ff9ebc5c446e", "name": "network-vif-plugged", "status": "completed", "tag": "6c10cf3a-5590-413f-b656-751024d5dbe2"}, {"server_uuid": "b1c91200-9512-4dda-859d-ff9ebc5c446e", "name": "network-vif-deleted", "tag": "6c10cf3a-5590-413f-b656-751024d5dbe2"}]} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 17:02:48 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-b8dbdab9-040f-495a-80ca-59f2026fbdd1 req-39dfaa90-7a77-4512-829b-7d4df01d89ba service nova] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 17:02:48 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-b8dbdab9-040f-495a-80ca-59f2026fbdd1 req-39dfaa90-7a77-4512-829b-7d4df01d89ba service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 17:02:48 user devstack@n-api.service[61471]: DEBUG oslo_concurrency.lockutils [req-b8dbdab9-040f-495a-80ca-59f2026fbdd1 req-39dfaa90-7a77-4512-829b-7d4df01d89ba service nova] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61471) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 17:02:48 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-b8dbdab9-040f-495a-80ca-59f2026fbdd1 req-39dfaa90-7a77-4512-829b-7d4df01d89ba service nova] Creating event network-vif-plugged:6c10cf3a-5590-413f-b656-751024d5dbe2 for instance b1c91200-9512-4dda-859d-ff9ebc5c446e on user Apr 19 17:02:48 user devstack@n-api.service[61471]: INFO nova.api.openstack.compute.server_external_events [req-b8dbdab9-040f-495a-80ca-59f2026fbdd1 req-39dfaa90-7a77-4512-829b-7d4df01d89ba service nova] Creating event network-vif-deleted:6c10cf3a-5590-413f-b656-751024d5dbe2 for instance b1c91200-9512-4dda-859d-ff9ebc5c446e on user Apr 19 17:02:48 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [req-b8dbdab9-040f-495a-80ca-59f2026fbdd1 req-39dfaa90-7a77-4512-829b-7d4df01d89ba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029218 Apr 19 17:02:48 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 152/456] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 17:02:48 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 17:03:36 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell0:SELECT=2 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 17:03:36 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_api:SELECT=4 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 17:03:36 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell1:SELECT=14 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 17:03:36 user devstack@n-api.service[61472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 19 17:03:36 user devstack@n-api.service[61472]: Wed Apr 19 17:03:36 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b1c91200-9512-4dda-859d-ff9ebc5c446e (ip 10.0.0.210) !!! Apr 19 17:03:36 user devstack@n-api.service[61472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 19 17:03:36 user devstack@n-api.service[61472]: Wed Apr 19 17:03:36 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b1c91200-9512-4dda-859d-ff9ebc5c446e (ip 10.0.0.210) !!! Apr 19 17:03:36 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-cee935f4-868d-4764-b2a6-8121ce531e0a tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Calling method '>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 17:03:36 user devstack@n-api.service[61472]: DEBUG nova.compute.api [None req-cee935f4-868d-4764-b2a6-8121ce531e0a tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] [instance: b1c91200-9512-4dda-859d-ff9ebc5c446e] Fetching instance by UUID {{(pid=61472) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 17:03:36 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-cee935f4-868d-4764-b2a6-8121ce531e0a tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 17:03:36 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-cee935f4-868d-4764-b2a6-8121ce531e0a tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 17:03:36 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-cee935f4-868d-4764-b2a6-8121ce531e0a tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 17:03:36 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-cee935f4-868d-4764-b2a6-8121ce531e0a tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Acquiring lock "529680e7-3be5-45cb-be5e-d097b6f534fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 17:03:36 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-cee935f4-868d-4764-b2a6-8121ce531e0a tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 17:03:36 user devstack@n-api.service[61472]: DEBUG oslo_concurrency.lockutils [None req-cee935f4-868d-4764-b2a6-8121ce531e0a tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Lock "529680e7-3be5-45cb-be5e-d097b6f534fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61472) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 17:03:36 user devstack@n-api.service[61472]: INFO nova.api.openstack.wsgi [None req-cee935f4-868d-4764-b2a6-8121ce531e0a tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] HTTP exception thrown: Instance b1c91200-9512-4dda-859d-ff9ebc5c446e could not be found. Apr 19 17:03:36 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-cee935f4-868d-4764-b2a6-8121ce531e0a tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Request method failure captured: Apr 19 17:03:36 user devstack@n-api.service[61472]: request: GET /compute/v2.1/servers/b1c91200-9512-4dda-859d-ff9ebc5c446e HTTP/1.1 Apr 19 17:03:36 user devstack@n-api.service[61472]: Accept: application/json Apr 19 17:03:36 user devstack@n-api.service[61472]: Accept-Encoding: identity Apr 19 17:03:36 user devstack@n-api.service[61472]: Connection: close Apr 19 17:03:36 user devstack@n-api.service[61472]: Content-Length: 0 Apr 19 17:03:36 user devstack@n-api.service[61472]: Content-Type: application/json Apr 19 17:03:36 user devstack@n-api.service[61472]: Host: 10.0.0.210 Apr 19 17:03:36 user devstack@n-api.service[61472]: Openstack-System-Scope: None Apr 19 17:03:36 user devstack@n-api.service[61472]: User-Agent: python-urllib3/1.26.15 Apr 19 17:03:36 user devstack@n-api.service[61472]: X-Auth-Token: gAAAAABkQB2WFRu31AdV3LfG8k1RsovUarN_-ahwYCdQZoTPSo76f3YxzZWNTFrq0DHOx0hbABFLTyHH6-a2jkGmDbb5yUqiiwPb3l2PTjrDZUpLMZmJT6s9CpjJxh0nyXJp8nR0KIOgegB5CBNF5S7Ze0CR0fjDzmD22AlxHAGhYDO-D-tRmCE Apr 19 17:03:36 user devstack@n-api.service[61472]: X-Domain-Id: None Apr 19 17:03:36 user devstack@n-api.service[61472]: X-Domain-Name: None Apr 19 17:03:36 user devstack@n-api.service[61472]: X-Identity-Status: Confirmed Apr 19 17:03:36 user devstack@n-api.service[61472]: X-Is-Admin-Project: True Apr 19 17:03:36 user devstack@n-api.service[61472]: X-Project-Domain-Id: default Apr 19 17:03:36 user devstack@n-api.service[61472]: X-Project-Domain-Name: Default Apr 19 17:03:36 user devstack@n-api.service[61472]: X-Project-Id: 96ffbf89dd8d4009b88800012f708cde Apr 19 17:03:36 user devstack@n-api.service[61472]: X-Project-Name: tempest-TestMinimumBasicScenario-588229521 Apr 19 17:03:36 user devstack@n-api.service[61472]: X-Role: member,reader Apr 19 17:03:36 user devstack@n-api.service[61472]: X-Roles: member,reader Apr 19 17:03:36 user devstack@n-api.service[61472]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/96ffbf89dd8d4009b88800012f708cde"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/96ffbf89dd8d4009b88800012f708cde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/96ffbf89dd8d4009b88800012f708cde"}]}] Apr 19 17:03:36 user devstack@n-api.service[61472]: X-Tenant: tempest-TestMinimumBasicScenario-588229521 Apr 19 17:03:36 user devstack@n-api.service[61472]: X-Tenant-Id: 96ffbf89dd8d4009b88800012f708cde Apr 19 17:03:36 user devstack@n-api.service[61472]: X-Tenant-Name: tempest-TestMinimumBasicScenario-588229521 Apr 19 17:03:36 user devstack@n-api.service[61472]: X-User: tempest-TestMinimumBasicScenario-588229521-project-member Apr 19 17:03:36 user devstack@n-api.service[61472]: X-User-Domain-Id: default Apr 19 17:03:36 user devstack@n-api.service[61472]: X-User-Domain-Name: Default Apr 19 17:03:36 user devstack@n-api.service[61472]: X-User-Id: 6329dea7be684d3faf681e7da2ee3728 Apr 19 17:03:36 user devstack@n-api.service[61472]: X-User-Name: tempest-TestMinimumBasicScenario-588229521-project-member Apr 19 17:03:36 user devstack@n-api.service[61472]: method: > Apr 19 17:03:36 user devstack@n-api.service[61472]: exception: Instance b1c91200-9512-4dda-859d-ff9ebc5c446e could not be found. Apr 19 17:03:36 user devstack@n-api.service[61472]: action_args: {'id': 'b1c91200-9512-4dda-859d-ff9ebc5c446e'} Apr 19 17:03:36 user devstack@n-api.service[61472]: {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 17:03:36 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 17:03:36 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 17:03:36 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 17:03:36 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 17:03:36 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 17:03:36 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 17:03:36 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 17:03:36 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 17:03:36 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 17:03:36 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1c91200-9512-4dda-859d-ff9ebc5c446e could not be found. Apr 19 17:03:36 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 17:03:36 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 17:03:36 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 17:03:36 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 17:03:36 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 17:03:36 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 17:03:36 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 17:03:36 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 17:03:36 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 17:03:36 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 17:03:36 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 17:03:36 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 17:03:36 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 17:03:36 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 17:03:36 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 17:03:36 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 17:03:36 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1c91200-9512-4dda-859d-ff9ebc5c446e could not be found. Apr 19 17:03:36 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 17:03:36 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 17:03:36 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 17:03:36 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 17:03:36 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 17:03:36 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 17:03:36 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 17:03:36 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 17:03:36 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1c91200-9512-4dda-859d-ff9ebc5c446e could not be found. Apr 19 17:03:36 user devstack@n-api.service[61472]: ERROR nova.api.openstack.wsgi Apr 19 17:03:36 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-cee935f4-868d-4764-b2a6-8121ce531e0a tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Returning 404 to user: Instance b1c91200-9512-4dda-859d-ff9ebc5c446e could not be found. {{(pid=61472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 17:03:36 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-cee935f4-868d-4764-b2a6-8121ce531e0a tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b1c91200-9512-4dda-859d-ff9ebc5c446e" status: 404 len: 111 microversion: 2.1 time: 0.118171 Apr 19 17:03:36 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 151/457] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 17:03:36 2023] GET /compute/v2.1/servers/b1c91200-9512-4dda-859d-ff9ebc5c446e => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 17:03:36 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_api:SELECT=4 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 17:03:36 user devstack@n-api.service[61473]: DEBUG dbcounter [-] [61473] Writing DB stats nova_cell1:SELECT=8 {{(pid=61473) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 17:03:36 user devstack@n-api.service[61473]: DEBUG nova.api.openstack.wsgi [None req-99d75cd3-f03f-44e7-91ae-c69fd331b60c tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] Calling method '.version_select at 0x7fd4970771c0>' {{(pid=61473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 17:03:36 user devstack@n-api.service[61473]: INFO nova.api.openstack.requestlog [None req-99d75cd3-f03f-44e7-91ae-c69fd331b60c tempest-TestMinimumBasicScenario-588229521 tempest-TestMinimumBasicScenario-588229521-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1011995284" status: 202 len: 0 microversion: 2.1 time: 0.033375 Apr 19 17:03:36 user devstack@n-api.service[61473]: [pid: 61473|app: 0|req: 155/458] 10.0.0.210 () {62 vars in 1349 bytes} [Wed Apr 19 17:03:36 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1011995284 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 17:03:57 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 17:03:57 user devstack@n-api.service[61471]: DEBUG dbcounter [-] [61471] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61471) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 17:03:57 user devstack@n-api.service[61471]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 17:03:57 user devstack@n-api.service[61471]: Wed Apr 19 17:03:57 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.0.0.210) !!! Apr 19 17:03:57 user devstack@n-api.service[61471]: DEBUG nova.api.openstack.wsgi [None req-284ed413-149f-4b08-be1e-a01a08fb54aa tempest-TestStampPattern-1018566020 tempest-TestStampPattern-1018566020-project-member] Action: 'create', calling method: .version_select at 0x7fd496f14430>, body: {"keypair": {"name": "tempest-TestStampPattern-1117096701", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxNWABHOgZUukUl8qiH+qBFuVoVSMevhCi1HACJkvh4yYdXrT54FZxMgNduZNJPgB8oKRH8qf9xADoaITox8jXeLbrSH+gWgNhPU9ecxPVo1nE2CKG2M9Ez74YjdoILfQ=="}} {{(pid=61471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 17:03:57 user devstack@n-api.service[61471]: DEBUG nova.quota [None req-284ed413-149f-4b08-be1e-a01a08fb54aa tempest-TestStampPattern-1018566020 tempest-TestStampPattern-1018566020-project-member] Getting quotas for project a91f6c7febb34c77b3271f07de00d15a. Resources: {'key_pairs'} {{(pid=61471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 17:03:57 user devstack@n-api.service[61471]: DEBUG nova.quota [None req-284ed413-149f-4b08-be1e-a01a08fb54aa tempest-TestStampPattern-1018566020 tempest-TestStampPattern-1018566020-project-member] Getting quotas for user 101268708bee4f009c9a66bf8b98de7e and project a91f6c7febb34c77b3271f07de00d15a. Resources: {'key_pairs'} {{(pid=61471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 17:03:57 user devstack@n-api.service[61471]: INFO nova.api.openstack.requestlog [None req-284ed413-149f-4b08-be1e-a01a08fb54aa tempest-TestStampPattern-1018566020 tempest-TestStampPattern-1018566020-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.256518 Apr 19 17:03:57 user devstack@n-api.service[61471]: [pid: 61471|app: 0|req: 153/459] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 17:03:57 2023] POST /compute/v2.1/os-keypairs => generated 395 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 17:04:00 user devstack@n-api.service[61472]: DEBUG nova.api.openstack.wsgi [None req-7d2895f8-4f9e-4c53-984e-3a5d68cc5269 tempest-TestStampPattern-1018566020 tempest-TestStampPattern-1018566020-project-member] Calling method '.version_select at 0x7fd4970e35b0>' {{(pid=61472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 17:04:00 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_api:SELECT=2 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 17:04:00 user devstack@n-api.service[61472]: DEBUG dbcounter [-] [61472] Writing DB stats nova_cell1:SELECT=2 {{(pid=61472) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 17:04:00 user devstack@n-api.service[61472]: INFO nova.api.openstack.requestlog [None req-7d2895f8-4f9e-4c53-984e-3a5d68cc5269 tempest-TestStampPattern-1018566020 tempest-TestStampPattern-1018566020-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1117096701" status: 202 len: 0 microversion: 2.1 time: 0.026542 Apr 19 17:04:00 user devstack@n-api.service[61472]: [pid: 61472|app: 0|req: 152/460] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 19 17:04:00 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1117096701 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)