Apr 19 14:44:15 user devstack@n-api.service[61252]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 19 14:44:15 user devstack@n-api.service[61252]: *** Starting uWSGI 2.0.20-debian (64bit) on [Wed Apr 19 14:44:15 2023] *** Apr 19 14:44:15 user devstack@n-api.service[61252]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 19 14:44:15 user devstack@n-api.service[61252]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 19 14:44:15 user devstack@n-api.service[61252]: nodename: user Apr 19 14:44:15 user devstack@n-api.service[61252]: machine: x86_64 Apr 19 14:44:15 user devstack@n-api.service[61252]: clock source: unix Apr 19 14:44:15 user devstack@n-api.service[61252]: pcre jit disabled Apr 19 14:44:15 user devstack@n-api.service[61252]: detected number of CPU cores: 12 Apr 19 14:44:15 user devstack@n-api.service[61252]: current working directory: / Apr 19 14:44:15 user devstack@n-api.service[61252]: detected binary path: /usr/bin/uwsgi-core Apr 19 14:44:15 user devstack@n-api.service[61252]: your processes number limit is 63637 Apr 19 14:44:15 user devstack@n-api.service[61252]: your memory page size is 4096 bytes Apr 19 14:44:15 user devstack@n-api.service[61252]: detected max file descriptor number: 2048 Apr 19 14:44:15 user devstack@n-api.service[61252]: lock engine: pthread robust mutexes Apr 19 14:44:15 user devstack@n-api.service[61252]: thunder lock: enabled Apr 19 14:44:15 user devstack@n-api.service[61252]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 19 14:44:15 user devstack@n-api.service[61252]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 19 14:44:15 user devstack@n-api.service[61252]: Python main interpreter initialized at 0x564d96518990 Apr 19 14:44:15 user devstack@n-api.service[61252]: python threads support enabled Apr 19 14:44:15 user devstack@n-api.service[61252]: your server socket listen backlog is limited to 100 connections Apr 19 14:44:15 user devstack@n-api.service[61252]: your mercy for graceful operations on workers is 90 seconds Apr 19 14:44:15 user devstack@n-api.service[61252]: mapped 537436 bytes (524 KB) for 3 cores Apr 19 14:44:15 user devstack@n-api.service[61252]: *** Operational MODE: preforking *** Apr 19 14:44:15 user devstack@n-api.service[61252]: *** uWSGI is running in multiple interpreter mode *** Apr 19 14:44:15 user devstack@n-api.service[61252]: spawned uWSGI master process (pid: 61252) Apr 19 14:44:15 user devstack@n-api.service[61252]: spawned uWSGI worker 1 (pid: 61253, cores: 1) Apr 19 14:44:15 user devstack@n-api.service[61252]: spawned uWSGI worker 2 (pid: 61254, cores: 1) Apr 19 14:44:15 user devstack@n-api.service[61252]: spawned uWSGI worker 3 (pid: 61255, cores: 1) Apr 19 14:44:15 user devstack@n-api.service[61252]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 19 14:44:16 user devstack@n-api.service[61253]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 19 14:44:16 user devstack@n-api.service[61255]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 19 14:44:16 user devstack@n-api.service[61254]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 19 14:44:19 user devstack@n-api.service[61255]: live_migration_uri is deprecated for removal in favor of two other options that Apr 19 14:44:19 user devstack@n-api.service[61255]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 19 14:44:19 user devstack@n-api.service[61255]: and ``live_migration_inbound_addr`` respectively. Apr 19 14:44:19 user devstack@n-api.service[61255]: ). Its value may be silently ignored in the future. Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 19 14:44:19 user devstack@n-api.service[61253]: live_migration_uri is deprecated for removal in favor of two other options that Apr 19 14:44:19 user devstack@n-api.service[61253]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 19 14:44:19 user devstack@n-api.service[61253]: and ``live_migration_inbound_addr`` respectively. Apr 19 14:44:19 user devstack@n-api.service[61253]: ). Its value may be silently ignored in the future. Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61255) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61253) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 19 14:44:19 user devstack@n-api.service[61254]: live_migration_uri is deprecated for removal in favor of two other options that Apr 19 14:44:19 user devstack@n-api.service[61254]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 19 14:44:19 user devstack@n-api.service[61254]: and ``live_migration_inbound_addr`` respectively. Apr 19 14:44:19 user devstack@n-api.service[61254]: ). Its value may be silently ignored in the future. Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: INFO dbcounter [None req-1197ac4f-d730-451b-9168-475206c25e69 None None] Registered counter for database nova_api Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: INFO dbcounter [None req-163f1ce8-c317-420e-a4b7-84cf7fc68bf6 None None] Registered counter for database nova_api Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG oslo_db.sqlalchemy.engines [None req-1197ac4f-d730-451b-9168-475206c25e69 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61255) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writer thread running {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG oslo_db.sqlalchemy.engines [None req-163f1ce8-c317-420e-a4b7-84cf7fc68bf6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61253) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writer thread running {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 14:44:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61254) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG nova.context [None req-1197ac4f-d730-451b-9168-475206c25e69 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),294c8cd7-7972-4e5f-a789-800b7d5aa37d(cell1) {{(pid=61255) load_cells /opt/stack/nova/nova/context.py:464}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-1197ac4f-d730-451b-9168-475206c25e69 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-1197ac4f-d730-451b-9168-475206c25e69 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-1197ac4f-d730-451b-9168-475206c25e69 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:44:19 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-1197ac4f-d730-451b-9168-475206c25e69 None None] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:44:20 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-1197ac4f-d730-451b-9168-475206c25e69 None None] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:44:20 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-1197ac4f-d730-451b-9168-475206c25e69 None None] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:44:20 user devstack@n-api.service[61255]: INFO dbcounter [None req-1197ac4f-d730-451b-9168-475206c25e69 None None] Registered counter for database nova_cell0 Apr 19 14:44:20 user devstack@n-api.service[61253]: DEBUG nova.context [None req-163f1ce8-c317-420e-a4b7-84cf7fc68bf6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),294c8cd7-7972-4e5f-a789-800b7d5aa37d(cell1) {{(pid=61253) load_cells /opt/stack/nova/nova/context.py:464}} Apr 19 14:44:20 user devstack@n-api.service[61255]: INFO dbcounter [None req-1197ac4f-d730-451b-9168-475206c25e69 None None] Registered counter for database nova_cell1 Apr 19 14:44:20 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-163f1ce8-c317-420e-a4b7-84cf7fc68bf6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:44:20 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-163f1ce8-c317-420e-a4b7-84cf7fc68bf6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:44:20 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-163f1ce8-c317-420e-a4b7-84cf7fc68bf6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:44:20 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-163f1ce8-c317-420e-a4b7-84cf7fc68bf6 None None] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:44:20 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-163f1ce8-c317-420e-a4b7-84cf7fc68bf6 None None] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:44:20 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-163f1ce8-c317-420e-a4b7-84cf7fc68bf6 None None] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:44:20 user devstack@n-api.service[61255]: DEBUG oslo_db.sqlalchemy.engines [None req-1197ac4f-d730-451b-9168-475206c25e69 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61255) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 14:44:20 user devstack@n-api.service[61253]: INFO dbcounter [None req-163f1ce8-c317-420e-a4b7-84cf7fc68bf6 None None] Registered counter for database nova_cell0 Apr 19 14:44:20 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writer thread running {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 14:44:20 user devstack@n-api.service[61253]: INFO dbcounter [None req-163f1ce8-c317-420e-a4b7-84cf7fc68bf6 None None] Registered counter for database nova_cell1 Apr 19 14:44:20 user devstack@n-api.service[61253]: DEBUG oslo_db.sqlalchemy.engines [None req-163f1ce8-c317-420e-a4b7-84cf7fc68bf6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61253) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 14:44:20 user devstack@n-api.service[61253]: DEBUG oslo_db.sqlalchemy.engines [None req-163f1ce8-c317-420e-a4b7-84cf7fc68bf6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61253) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 14:44:20 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writer thread running {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 14:44:20 user devstack@n-api.service[61254]: INFO dbcounter [None req-ebafd08f-1e04-4916-bad5-edee33bf9867 None None] Registered counter for database nova_api Apr 19 14:44:20 user devstack@n-api.service[61254]: DEBUG oslo_db.sqlalchemy.engines [None req-ebafd08f-1e04-4916-bad5-edee33bf9867 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61254) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 14:44:20 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writer thread running {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 14:44:20 user devstack@n-api.service[61255]: DEBUG oslo_db.sqlalchemy.engines [None req-1197ac4f-d730-451b-9168-475206c25e69 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61255) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 14:44:20 user devstack@n-api.service[61254]: DEBUG nova.context [None req-ebafd08f-1e04-4916-bad5-edee33bf9867 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),294c8cd7-7972-4e5f-a789-800b7d5aa37d(cell1) {{(pid=61254) load_cells /opt/stack/nova/nova/context.py:464}} Apr 19 14:44:20 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writer thread running {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 14:44:20 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-ebafd08f-1e04-4916-bad5-edee33bf9867 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:44:20 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-ebafd08f-1e04-4916-bad5-edee33bf9867 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:44:20 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-ebafd08f-1e04-4916-bad5-edee33bf9867 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:44:20 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-ebafd08f-1e04-4916-bad5-edee33bf9867 None None] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:44:20 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-ebafd08f-1e04-4916-bad5-edee33bf9867 None None] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:44:20 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-ebafd08f-1e04-4916-bad5-edee33bf9867 None None] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:44:20 user devstack@n-api.service[61255]: INFO dbcounter [None req-1197ac4f-d730-451b-9168-475206c25e69 None None] Registered counter for database nova_cell0 Apr 19 14:44:20 user devstack@n-api.service[61254]: INFO dbcounter [None req-ebafd08f-1e04-4916-bad5-edee33bf9867 None None] Registered counter for database nova_cell0 Apr 19 14:44:20 user devstack@n-api.service[61254]: INFO dbcounter [None req-ebafd08f-1e04-4916-bad5-edee33bf9867 None None] Registered counter for database nova_cell1 Apr 19 14:44:20 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writer thread running {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 14:44:20 user devstack@n-api.service[61255]: DEBUG oslo_db.sqlalchemy.engines [None req-1197ac4f-d730-451b-9168-475206c25e69 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61255) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 14:44:20 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writer thread running {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 14:44:20 user devstack@n-api.service[61254]: DEBUG oslo_db.sqlalchemy.engines [None req-ebafd08f-1e04-4916-bad5-edee33bf9867 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61254) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 14:44:20 user devstack@n-api.service[61253]: INFO dbcounter [None req-163f1ce8-c317-420e-a4b7-84cf7fc68bf6 None None] Registered counter for database nova_cell0 Apr 19 14:44:20 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writer thread running {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 14:44:20 user devstack@n-api.service[61254]: DEBUG oslo_db.sqlalchemy.engines [None req-ebafd08f-1e04-4916-bad5-edee33bf9867 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61254) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 14:44:20 user devstack@n-api.service[61253]: DEBUG oslo_db.sqlalchemy.engines [None req-163f1ce8-c317-420e-a4b7-84cf7fc68bf6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61253) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 14:44:20 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writer thread running {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 14:44:20 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writer thread running {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 14:44:20 user devstack@n-api.service[61254]: INFO dbcounter [None req-ebafd08f-1e04-4916-bad5-edee33bf9867 None None] Registered counter for database nova_cell0 Apr 19 14:44:20 user devstack@n-api.service[61254]: DEBUG oslo_db.sqlalchemy.engines [None req-ebafd08f-1e04-4916-bad5-edee33bf9867 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61254) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 14:44:20 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writer thread running {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 14:44:20 user devstack@n-api.service[61255]: WARNING keystonemiddleware.auth_token [None req-1197ac4f-d730-451b-9168-475206c25e69 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 19 14:44:20 user devstack@n-api.service[61255]: WARNING keystonemiddleware.auth_token [None req-1197ac4f-d730-451b-9168-475206c25e69 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 19 14:44:20 user devstack@n-api.service[61253]: WARNING keystonemiddleware.auth_token [None req-163f1ce8-c317-420e-a4b7-84cf7fc68bf6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 19 14:44:20 user devstack@n-api.service[61253]: WARNING keystonemiddleware.auth_token [None req-163f1ce8-c317-420e-a4b7-84cf7fc68bf6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 19 14:44:20 user devstack@n-api.service[61254]: WARNING keystonemiddleware.auth_token [None req-ebafd08f-1e04-4916-bad5-edee33bf9867 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 19 14:44:20 user devstack@n-api.service[61254]: WARNING keystonemiddleware.auth_token [None req-ebafd08f-1e04-4916-bad5-edee33bf9867 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 19 14:44:20 user devstack@n-api.service[61255]: WARNING keystonemiddleware.auth_token [None req-1197ac4f-d730-451b-9168-475206c25e69 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 19 14:44:20 user devstack@n-api.service[61255]: WARNING keystonemiddleware.auth_token [None req-1197ac4f-d730-451b-9168-475206c25e69 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 19 14:44:20 user devstack@n-api.service[61255]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564d96518990 pid: 61255 (default app) Apr 19 14:44:20 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-1197ac4f-d730-451b-9168-475206c25e69 None None] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:44:20 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-1197ac4f-d730-451b-9168-475206c25e69 None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001616 Apr 19 14:44:20 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Wed Apr 19 14:44:20 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:44:20 user devstack@n-api.service[61253]: WARNING keystonemiddleware.auth_token [None req-163f1ce8-c317-420e-a4b7-84cf7fc68bf6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 19 14:44:20 user devstack@n-api.service[61253]: WARNING keystonemiddleware.auth_token [None req-163f1ce8-c317-420e-a4b7-84cf7fc68bf6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 19 14:44:20 user devstack@n-api.service[61253]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564d96518990 pid: 61253 (default app) Apr 19 14:44:20 user devstack@n-api.service[61254]: WARNING keystonemiddleware.auth_token [None req-ebafd08f-1e04-4916-bad5-edee33bf9867 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 19 14:44:20 user devstack@n-api.service[61254]: WARNING keystonemiddleware.auth_token [None req-ebafd08f-1e04-4916-bad5-edee33bf9867 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 19 14:44:20 user devstack@n-api.service[61254]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564d96518990 pid: 61254 (default app) Apr 19 14:46:28 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-1197ac4f-d730-451b-9168-475206c25e69 None None] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:46:28 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-1197ac4f-d730-451b-9168-475206c25e69 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001690 Apr 19 14:46:28 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 14:46:28 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:46:28 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_api:SELECT=3 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:46:28 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell0:SELECT=3 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:46:28 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell1:SELECT=3 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:46:28 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell0:SELECT=3 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:46:29 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-3eca0b29-ad6b-4d41-8f0f-c4b559863a8d admin admin] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:46:29 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-3eca0b29-ad6b-4d41-8f0f-c4b559863a8d admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.378014 Apr 19 14:46:29 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Wed Apr 19 14:46:28 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:46:31 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-ebafd08f-1e04-4916-bad5-edee33bf9867 None None] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:46:31 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-ebafd08f-1e04-4916-bad5-edee33bf9867 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002216 Apr 19 14:46:31 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 14:46:31 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:46:31 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_api:SELECT=3 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:46:31 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell1:SELECT=3 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:46:31 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell0:SELECT=3 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:46:31 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:46:31 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-db02cc1e-8b45-4375-bccb-ab2b66deb980 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "swap": 0, "os-flavor-access:is_public": true, "disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "c1", "name": "cirros256"}} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:46:31 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-db02cc1e-8b45-4375-bccb-ab2b66deb980 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.322213 Apr 19 14:46:31 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 14:46:31 2023] POST /compute/v2.1/flavors => generated 405 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 14:46:31 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-1eabb809-fd0d-4fdc-b3d9-101ba372a292 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:46:31 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-1eabb809-fd0d-4fdc-b3d9-101ba372a292 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046329 Apr 19 14:46:31 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 19 14:46:31 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:46:33 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-ebafd08f-1e04-4916-bad5-edee33bf9867 None None] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:46:33 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-ebafd08f-1e04-4916-bad5-edee33bf9867 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001258 Apr 19 14:46:33 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 14:46:33 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:46:33 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-709524ee-ae95-4fca-8fa0-e34a50e602db admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 5, "ram": 512, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d1"}} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:46:33 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-709524ee-ae95-4fca-8fa0-e34a50e602db admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.081147 Apr 19 14:46:33 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 14:46:33 2023] POST /compute/v2.1/flavors => generated 402 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 14:46:33 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-aa9eef19-6572-4477-af53-a431adc224a2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:46:33 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-aa9eef19-6572-4477-af53-a431adc224a2 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050167 Apr 19 14:46:33 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 19 14:46:33 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:46:35 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-ebafd08f-1e04-4916-bad5-edee33bf9867 None None] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:46:35 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-ebafd08f-1e04-4916-bad5-edee33bf9867 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001467 Apr 19 14:46:35 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 14:46:35 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:46:35 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-346ee5ad-ab96-4d57-b28f-b0ab9894fd0c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "swap": 0, "vcpus": 1, "disk": 10, "rxtx_factor": 1.0, "id": "d2", "os-flavor-access:is_public": true, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:46:35 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-346ee5ad-ab96-4d57-b28f-b0ab9894fd0c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.062543 Apr 19 14:46:35 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 14:46:35 2023] POST /compute/v2.1/flavors => generated 402 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 14:46:35 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-14174735-88da-4476-93ca-cb87ebbbcd76 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:46:35 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-14174735-88da-4476-93ca-cb87ebbbcd76 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025685 Apr 19 14:46:35 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 19 14:46:35 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:46:37 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-ebafd08f-1e04-4916-bad5-edee33bf9867 None None] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:46:37 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-ebafd08f-1e04-4916-bad5-edee33bf9867 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002245 Apr 19 14:46:37 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 14:46:37 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:46:37 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-9b96bfad-add0-4446-851c-3b9a50ebc4dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d3", "vcpus": 2, "swap": 0, "ram": 2048}} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:46:37 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-9b96bfad-add0-4446-851c-3b9a50ebc4dc admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.075649 Apr 19 14:46:37 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 14:46:37 2023] POST /compute/v2.1/flavors => generated 402 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 14:46:37 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-ef078f00-fe2c-448a-b34c-6fc6036c3cee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:46:37 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-ef078f00-fe2c-448a-b34c-6fc6036c3cee admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030993 Apr 19 14:46:37 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 19 14:46:37 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:46:39 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-ebafd08f-1e04-4916-bad5-edee33bf9867 None None] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:46:39 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-ebafd08f-1e04-4916-bad5-edee33bf9867 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001295 Apr 19 14:46:39 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 14:46:39 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:46:39 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-6ccce96c-9949-4f9a-a04a-7cdc23fd651a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "ram": 4096, "rxtx_factor": 1.0, "swap": 0, "vcpus": 4, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "os-flavor-access:is_public": true}} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:46:39 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-6ccce96c-9949-4f9a-a04a-7cdc23fd651a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.055704 Apr 19 14:46:39 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 14:46:39 2023] POST /compute/v2.1/flavors => generated 402 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 14:46:39 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-37317144-2eee-48a9-b731-06d361d18c0b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:46:39 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-37317144-2eee-48a9-b731-06d361d18c0b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024103 Apr 19 14:46:39 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 19 14:46:39 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:46:41 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-ebafd08f-1e04-4916-bad5-edee33bf9867 None None] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:46:41 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-ebafd08f-1e04-4916-bad5-edee33bf9867 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001235 Apr 19 14:46:41 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 14:46:41 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:46:41 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-66fa9fe4-988c-4e8f-9e95-80f9d28fcf57 admin admin] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:46:41 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-66fa9fe4-988c-4e8f-9e95-80f9d28fcf57 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.072397 Apr 19 14:46:41 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Wed Apr 19 14:46:41 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 14:46:43 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-37317144-2eee-48a9-b731-06d361d18c0b admin admin] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:46:43 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-37317144-2eee-48a9-b731-06d361d18c0b admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001528 Apr 19 14:46:43 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 14:46:43 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:46:43 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_api:SELECT=3 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:46:43 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell0:SELECT=3 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:46:43 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell1:SELECT=3 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:46:43 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell0:SELECT=3 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:46:43 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-4946cd95-3333-48b5-ae0b-874738122faf admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "name": "m1.tiny", "vcpus": 1, "ram": 512, "os-flavor-access:is_public": true, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0}} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:46:43 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-4946cd95-3333-48b5-ae0b-874738122faf admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.326901 Apr 19 14:46:43 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 14:46:43 2023] POST /compute/v2.1/flavors => generated 400 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 14:46:43 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-307a6016-78ac-4ed6-a003-89ffc6d3113a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:46:43 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-307a6016-78ac-4ed6-a003-89ffc6d3113a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036241 Apr 19 14:46:43 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 19 14:46:43 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:46:45 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-37317144-2eee-48a9-b731-06d361d18c0b admin admin] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:46:45 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-37317144-2eee-48a9-b731-06d361d18c0b admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001266 Apr 19 14:46:45 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 14:46:45 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:46:46 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-22a29488-5f1d-435d-a455-74a5a59efc6d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 20, "vcpus": 1, "swap": 0, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "2", "rxtx_factor": 1.0}} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:46:46 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-22a29488-5f1d-435d-a455-74a5a59efc6d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.063960 Apr 19 14:46:46 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 14:46:45 2023] POST /compute/v2.1/flavors => generated 403 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 14:46:46 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-cb75884a-b845-4ce3-9312-f66f8d4bc423 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:46:46 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-cb75884a-b845-4ce3-9312-f66f8d4bc423 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027681 Apr 19 14:46:46 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 19 14:46:46 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:46:47 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-37317144-2eee-48a9-b731-06d361d18c0b admin admin] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:46:47 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-37317144-2eee-48a9-b731-06d361d18c0b admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001368 Apr 19 14:46:47 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 14:46:47 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:46:47 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-35d214c0-9173-4759-a981-1053f53fce04 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "3", "name": "m1.medium", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "disk": 40}} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:46:47 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-35d214c0-9173-4759-a981-1053f53fce04 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070014 Apr 19 14:46:47 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 14:46:47 2023] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 14:46:47 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-18726035-fb71-49e1-9cf2-ff2c1c6d309b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:46:47 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-18726035-fb71-49e1-9cf2-ff2c1c6d309b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026273 Apr 19 14:46:47 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 19 14:46:47 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:46:49 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-37317144-2eee-48a9-b731-06d361d18c0b admin admin] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:46:49 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-37317144-2eee-48a9-b731-06d361d18c0b admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001414 Apr 19 14:46:49 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 14:46:49 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:46:49 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-dd0321c8-34c9-4849-9544-df199176fd4f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "vcpus": 4, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "ram": 8192}} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:46:49 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-dd0321c8-34c9-4849-9544-df199176fd4f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.057945 Apr 19 14:46:49 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 14:46:49 2023] POST /compute/v2.1/flavors => generated 403 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 14:46:49 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-d32463d4-db89-4983-8b77-c546e101e3bd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:46:49 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-d32463d4-db89-4983-8b77-c546e101e3bd admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024846 Apr 19 14:46:49 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 19 14:46:49 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:46:51 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-37317144-2eee-48a9-b731-06d361d18c0b admin admin] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:46:51 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-37317144-2eee-48a9-b731-06d361d18c0b admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001497 Apr 19 14:46:51 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 14:46:51 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:46:51 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-2af063b6-906f-4e07-b0e3-7cfa2b9f70c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "rxtx_factor": 1.0, "name": "m1.xlarge", "disk": 160, "vcpus": 8, "id": "5", "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:46:51 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-2af063b6-906f-4e07-b0e3-7cfa2b9f70c1 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.064427 Apr 19 14:46:51 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 14:46:51 2023] POST /compute/v2.1/flavors => generated 406 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 14:46:51 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-0e6dc693-597f-4334-9db6-ee7df67b90cc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:46:52 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-0e6dc693-597f-4334-9db6-ee7df67b90cc admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023405 Apr 19 14:46:52 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 19 14:46:51 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:47:22 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-37317144-2eee-48a9-b731-06d361d18c0b admin admin] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:47:22 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-37317144-2eee-48a9-b731-06d361d18c0b admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002347 Apr 19 14:47:22 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 19 14:47:22 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:47:22 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:47:22 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-53ae428d-d5b9-4a4d-ac28-0386d942e63f admin admin] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:47:22 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-53ae428d-d5b9-4a4d-ac28-0386d942e63f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:47:22 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-53ae428d-d5b9-4a4d-ac28-0386d942e63f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:47:22 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-53ae428d-d5b9-4a4d-ac28-0386d942e63f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:47:22 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-53ae428d-d5b9-4a4d-ac28-0386d942e63f admin admin] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:47:22 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-53ae428d-d5b9-4a4d-ac28-0386d942e63f admin admin] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:47:22 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-53ae428d-d5b9-4a4d-ac28-0386d942e63f admin admin] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:47:22 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-53ae428d-d5b9-4a4d-ac28-0386d942e63f admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.088070 Apr 19 14:47:22 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Wed Apr 19 14:47:22 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 14:47:53 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-0e6dc693-597f-4334-9db6-ee7df67b90cc admin admin] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:47:53 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-0e6dc693-597f-4334-9db6-ee7df67b90cc admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001668 Apr 19 14:47:53 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 19 14:47:53 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:47:53 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:47:53 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-b7b2ed63-59a6-43d2-9bdd-2d3553bf4dbc admin admin] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:47:53 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-b7b2ed63-59a6-43d2-9bdd-2d3553bf4dbc admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.060451 Apr 19 14:47:53 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Wed Apr 19 14:47:53 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 14:47:58 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-53ae428d-d5b9-4a4d-ac28-0386d942e63f admin admin] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:47:58 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-53ae428d-d5b9-4a4d-ac28-0386d942e63f admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002450 Apr 19 14:47:58 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 19 14:47:58 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:47:58 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:47:58 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-e50886bb-fec9-49df-8acd-a794088787c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.nano", "id": "42", "ram": 128, "vcpus": 1}} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:47:58 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-e50886bb-fec9-49df-8acd-a794088787c1 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.069385 Apr 19 14:47:58 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Wed Apr 19 14:47:58 2023] POST /compute/v2.1/flavors => generated 403 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 14:47:58 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-774ca44b-e6f5-401e-ad00-61007f50bd51 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:47:58 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-774ca44b-e6f5-401e-ad00-61007f50bd51 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026264 Apr 19 14:47:58 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Wed Apr 19 14:47:58 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:48:02 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-53ae428d-d5b9-4a4d-ac28-0386d942e63f admin admin] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:48:02 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-53ae428d-d5b9-4a4d-ac28-0386d942e63f admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002881 Apr 19 14:48:02 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 19 14:48:02 2023] GET /compute/v2.1 => generated 387 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:48:02 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-fef09e5e-645c-440d-8315-972a1d7736d5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 192, "id": "84", "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.micro", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:48:02 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-fef09e5e-645c-440d-8315-972a1d7736d5 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.108588 Apr 19 14:48:02 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Wed Apr 19 14:48:02 2023] POST /compute/v2.1/flavors => generated 404 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 14:48:02 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-be842378-2b55-4f8e-b25a-1d986e8f5fb0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:48:02 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-be842378-2b55-4f8e-b25a-1d986e8f5fb0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030171 Apr 19 14:48:02 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Wed Apr 19 14:48:02 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:50:13 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell0:SELECT=2 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:50:13 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell1:SELECT=2 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:50:13 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_api:SELECT=4 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:50:13 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-0905e952-9a34-4720-acd9-76367d4137ee tempest-VolumesNegativeTest-2101003155 tempest-VolumesNegativeTest-2101003155-project-member] Action: 'create', calling method: .version_select at 0x7f3cfb69d2d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2128483567", "metadata": {"Type": "work"}}} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:50:13 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-0905e952-9a34-4720-acd9-76367d4137ee tempest-VolumesNegativeTest-2101003155 tempest-VolumesNegativeTest-2101003155-project-member] Request method failure captured: Apr 19 14:50:13 user devstack@n-api.service[61254]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 19 14:50:13 user devstack@n-api.service[61254]: Accept: application/json Apr 19 14:50:13 user devstack@n-api.service[61254]: Accept-Encoding: identity Apr 19 14:50:13 user devstack@n-api.service[61254]: Connection: close Apr 19 14:50:13 user devstack@n-api.service[61254]: Content-Length: 122 Apr 19 14:50:13 user devstack@n-api.service[61254]: Content-Type: application/json Apr 19 14:50:13 user devstack@n-api.service[61254]: Host: 10.0.0.210 Apr 19 14:50:13 user devstack@n-api.service[61254]: Openstack-System-Scope: None Apr 19 14:50:13 user devstack@n-api.service[61254]: User-Agent: python-urllib3/1.26.15 Apr 19 14:50:13 user devstack@n-api.service[61254]: X-Auth-Token: gAAAAABkP_-l2K7GDc1H5QmgUT2gkDAPpRKDsqm3nfMLsqBV3EG7L9rtiFmDXw-PqDlV6Ks0k0P51L2zbv8gnNlaSdSK8LSj1MjY8NMMV8sN0i5ZbgFT6dP7pUT8VI_pWbSL9dgAa_au9ajX6H3eq5MDQoUVh6EYf4dp_9W3VvKQIRZ2843CbZE Apr 19 14:50:13 user devstack@n-api.service[61254]: X-Domain-Id: None Apr 19 14:50:13 user devstack@n-api.service[61254]: X-Domain-Name: None Apr 19 14:50:13 user devstack@n-api.service[61254]: X-Identity-Status: Confirmed Apr 19 14:50:13 user devstack@n-api.service[61254]: X-Is-Admin-Project: True Apr 19 14:50:13 user devstack@n-api.service[61254]: X-Project-Domain-Id: default Apr 19 14:50:13 user devstack@n-api.service[61254]: X-Project-Domain-Name: Default Apr 19 14:50:13 user devstack@n-api.service[61254]: X-Project-Id: 73f49c344ef745c3935ded3a11897c02 Apr 19 14:50:13 user devstack@n-api.service[61254]: X-Project-Name: tempest-VolumesNegativeTest-2101003155 Apr 19 14:50:13 user devstack@n-api.service[61254]: X-Role: member,reader Apr 19 14:50:13 user devstack@n-api.service[61254]: X-Roles: member,reader Apr 19 14:50:13 user devstack@n-api.service[61254]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/73f49c344ef745c3935ded3a11897c02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/73f49c344ef745c3935ded3a11897c02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/73f49c344ef745c3935ded3a11897c02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 14:50:13 user devstack@n-api.service[61254]: X-Tenant: tempest-VolumesNegativeTest-2101003155 Apr 19 14:50:13 user devstack@n-api.service[61254]: X-Tenant-Id: 73f49c344ef745c3935ded3a11897c02 Apr 19 14:50:13 user devstack@n-api.service[61254]: X-Tenant-Name: tempest-VolumesNegativeTest-2101003155 Apr 19 14:50:13 user devstack@n-api.service[61254]: X-User: tempest-VolumesNegativeTest-2101003155-project-member Apr 19 14:50:13 user devstack@n-api.service[61254]: X-User-Domain-Id: default Apr 19 14:50:13 user devstack@n-api.service[61254]: X-User-Domain-Name: Default Apr 19 14:50:13 user devstack@n-api.service[61254]: X-User-Id: 44cf1488848a42178e2a19e3f641452f Apr 19 14:50:13 user devstack@n-api.service[61254]: X-User-Name: tempest-VolumesNegativeTest-2101003155-project-member Apr 19 14:50:13 user devstack@n-api.service[61254]: Apr 19 14:50:13 user devstack@n-api.service[61254]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2128483567", "metadata": {"Type": "work"}}} Apr 19 14:50:13 user devstack@n-api.service[61254]: method: Apr 19 14:50:13 user devstack@n-api.service[61254]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 19 14:50:13 user devstack@n-api.service[61254]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2128483567', 'metadata': {'Type': 'work'}}}} Apr 19 14:50:13 user devstack@n-api.service[61254]: {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:50:13 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:50:13 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 19 14:50:13 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 19 14:50:13 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 19 14:50:13 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise error Apr 19 14:50:13 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 19 14:50:13 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:50:13 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 19 14:50:13 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 19 14:50:13 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:50:13 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 19 14:50:13 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi '#$%' Apr 19 14:50:13 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:50:13 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:50:13 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:50:13 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:50:13 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:50:13 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:50:13 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:50:13 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:50:13 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 19 14:50:13 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 19 14:50:13 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:50:13 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:50:13 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 19 14:50:13 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 19 14:50:13 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 19 14:50:13 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 19 14:50:13 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 19 14:50:13 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 19 14:50:13 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 19 14:50:13 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:50:13 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:50:13 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:50:13 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:50:13 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:50:13 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:50:13 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 19 14:50:13 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 19 14:50:13 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 19 14:50:13 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:50:13 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-0905e952-9a34-4720-acd9-76367d4137ee tempest-VolumesNegativeTest-2101003155 tempest-VolumesNegativeTest-2101003155-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:50:13 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-0905e952-9a34-4720-acd9-76367d4137ee tempest-VolumesNegativeTest-2101003155 tempest-VolumesNegativeTest-2101003155-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.440236 Apr 19 14:50:13 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 19 14:50:13 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 441 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 19 14:50:13 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-c1405cd4-4b7b-46aa-a9d9-f43a5bb47f5a tempest-VolumesNegativeTest-2101003155 tempest-VolumesNegativeTest-2101003155-project-member] Action: 'create', calling method: .version_select at 0x7f3cfb6a2710>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-239541603", "metadata": {"Type": "work"}}} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:50:13 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-c1405cd4-4b7b-46aa-a9d9-f43a5bb47f5a tempest-VolumesNegativeTest-2101003155 tempest-VolumesNegativeTest-2101003155-project-member] Request method failure captured: Apr 19 14:50:13 user devstack@n-api.service[61255]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 19 14:50:13 user devstack@n-api.service[61255]: Accept: application/json Apr 19 14:50:13 user devstack@n-api.service[61255]: Accept-Encoding: identity Apr 19 14:50:13 user devstack@n-api.service[61255]: Connection: close Apr 19 14:50:13 user devstack@n-api.service[61255]: Content-Length: 119 Apr 19 14:50:13 user devstack@n-api.service[61255]: Content-Type: application/json Apr 19 14:50:13 user devstack@n-api.service[61255]: Host: 10.0.0.210 Apr 19 14:50:13 user devstack@n-api.service[61255]: Openstack-System-Scope: None Apr 19 14:50:13 user devstack@n-api.service[61255]: User-Agent: python-urllib3/1.26.15 Apr 19 14:50:13 user devstack@n-api.service[61255]: X-Auth-Token: gAAAAABkP_-l2K7GDc1H5QmgUT2gkDAPpRKDsqm3nfMLsqBV3EG7L9rtiFmDXw-PqDlV6Ks0k0P51L2zbv8gnNlaSdSK8LSj1MjY8NMMV8sN0i5ZbgFT6dP7pUT8VI_pWbSL9dgAa_au9ajX6H3eq5MDQoUVh6EYf4dp_9W3VvKQIRZ2843CbZE Apr 19 14:50:13 user devstack@n-api.service[61255]: X-Domain-Id: None Apr 19 14:50:13 user devstack@n-api.service[61255]: X-Domain-Name: None Apr 19 14:50:13 user devstack@n-api.service[61255]: X-Identity-Status: Confirmed Apr 19 14:50:13 user devstack@n-api.service[61255]: X-Is-Admin-Project: True Apr 19 14:50:13 user devstack@n-api.service[61255]: X-Project-Domain-Id: default Apr 19 14:50:13 user devstack@n-api.service[61255]: X-Project-Domain-Name: Default Apr 19 14:50:13 user devstack@n-api.service[61255]: X-Project-Id: 73f49c344ef745c3935ded3a11897c02 Apr 19 14:50:13 user devstack@n-api.service[61255]: X-Project-Name: tempest-VolumesNegativeTest-2101003155 Apr 19 14:50:13 user devstack@n-api.service[61255]: X-Role: member,reader Apr 19 14:50:13 user devstack@n-api.service[61255]: X-Roles: member,reader Apr 19 14:50:13 user devstack@n-api.service[61255]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/73f49c344ef745c3935ded3a11897c02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/73f49c344ef745c3935ded3a11897c02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/73f49c344ef745c3935ded3a11897c02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 14:50:13 user devstack@n-api.service[61255]: X-Tenant: tempest-VolumesNegativeTest-2101003155 Apr 19 14:50:13 user devstack@n-api.service[61255]: X-Tenant-Id: 73f49c344ef745c3935ded3a11897c02 Apr 19 14:50:13 user devstack@n-api.service[61255]: X-Tenant-Name: tempest-VolumesNegativeTest-2101003155 Apr 19 14:50:13 user devstack@n-api.service[61255]: X-User: tempest-VolumesNegativeTest-2101003155-project-member Apr 19 14:50:13 user devstack@n-api.service[61255]: X-User-Domain-Id: default Apr 19 14:50:13 user devstack@n-api.service[61255]: X-User-Domain-Name: Default Apr 19 14:50:13 user devstack@n-api.service[61255]: X-User-Id: 44cf1488848a42178e2a19e3f641452f Apr 19 14:50:13 user devstack@n-api.service[61255]: X-User-Name: tempest-VolumesNegativeTest-2101003155-project-member Apr 19 14:50:13 user devstack@n-api.service[61255]: Apr 19 14:50:13 user devstack@n-api.service[61255]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-239541603", "metadata": {"Type": "work"}}} Apr 19 14:50:13 user devstack@n-api.service[61255]: method: Apr 19 14:50:13 user devstack@n-api.service[61255]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 19 14:50:13 user devstack@n-api.service[61255]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-239541603', 'metadata': {'Type': 'work'}}}} Apr 19 14:50:13 user devstack@n-api.service[61255]: {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:50:13 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:50:13 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 19 14:50:13 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 19 14:50:13 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 19 14:50:13 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise error Apr 19 14:50:13 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 19 14:50:13 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:50:13 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 19 14:50:13 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 19 14:50:13 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:50:13 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 19 14:50:13 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi '0' Apr 19 14:50:13 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:50:13 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:50:13 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:50:13 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:50:13 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:50:13 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:50:13 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:50:13 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:50:13 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 19 14:50:13 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 19 14:50:13 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:50:13 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:50:13 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 19 14:50:13 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 19 14:50:13 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 19 14:50:13 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 19 14:50:13 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 19 14:50:13 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 19 14:50:13 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 19 14:50:13 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:50:13 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:50:13 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:50:13 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:50:13 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:50:13 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:50:13 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 19 14:50:13 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 19 14:50:13 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 19 14:50:13 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:50:13 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-c1405cd4-4b7b-46aa-a9d9-f43a5bb47f5a tempest-VolumesNegativeTest-2101003155 tempest-VolumesNegativeTest-2101003155-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:50:13 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-c1405cd4-4b7b-46aa-a9d9-f43a5bb47f5a tempest-VolumesNegativeTest-2101003155 tempest-VolumesNegativeTest-2101003155-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011138 Apr 19 14:50:13 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 17/47] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 19 14:50:13 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 19 14:50:13 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:50:13 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-baab3880-4030-42f0-9bb5-e36718b29b36 tempest-VolumesNegativeTest-2101003155 tempest-VolumesNegativeTest-2101003155-project-member] Action: 'create', calling method: .version_select at 0x7f3cfb67e050>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1145089214", "metadata": {"Type": "work"}}} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:50:13 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-baab3880-4030-42f0-9bb5-e36718b29b36 tempest-VolumesNegativeTest-2101003155 tempest-VolumesNegativeTest-2101003155-project-member] Request method failure captured: Apr 19 14:50:13 user devstack@n-api.service[61253]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 19 14:50:13 user devstack@n-api.service[61253]: Accept: application/json Apr 19 14:50:13 user devstack@n-api.service[61253]: Accept-Encoding: identity Apr 19 14:50:13 user devstack@n-api.service[61253]: Connection: close Apr 19 14:50:13 user devstack@n-api.service[61253]: Content-Length: 119 Apr 19 14:50:13 user devstack@n-api.service[61253]: Content-Type: application/json Apr 19 14:50:13 user devstack@n-api.service[61253]: Host: 10.0.0.210 Apr 19 14:50:13 user devstack@n-api.service[61253]: Openstack-System-Scope: None Apr 19 14:50:13 user devstack@n-api.service[61253]: User-Agent: python-urllib3/1.26.15 Apr 19 14:50:13 user devstack@n-api.service[61253]: X-Auth-Token: gAAAAABkP_-l2K7GDc1H5QmgUT2gkDAPpRKDsqm3nfMLsqBV3EG7L9rtiFmDXw-PqDlV6Ks0k0P51L2zbv8gnNlaSdSK8LSj1MjY8NMMV8sN0i5ZbgFT6dP7pUT8VI_pWbSL9dgAa_au9ajX6H3eq5MDQoUVh6EYf4dp_9W3VvKQIRZ2843CbZE Apr 19 14:50:13 user devstack@n-api.service[61253]: X-Domain-Id: None Apr 19 14:50:13 user devstack@n-api.service[61253]: X-Domain-Name: None Apr 19 14:50:13 user devstack@n-api.service[61253]: X-Identity-Status: Confirmed Apr 19 14:50:13 user devstack@n-api.service[61253]: X-Is-Admin-Project: True Apr 19 14:50:13 user devstack@n-api.service[61253]: X-Project-Domain-Id: default Apr 19 14:50:13 user devstack@n-api.service[61253]: X-Project-Domain-Name: Default Apr 19 14:50:13 user devstack@n-api.service[61253]: X-Project-Id: 73f49c344ef745c3935ded3a11897c02 Apr 19 14:50:13 user devstack@n-api.service[61253]: X-Project-Name: tempest-VolumesNegativeTest-2101003155 Apr 19 14:50:13 user devstack@n-api.service[61253]: X-Role: member,reader Apr 19 14:50:13 user devstack@n-api.service[61253]: X-Roles: member,reader Apr 19 14:50:13 user devstack@n-api.service[61253]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/73f49c344ef745c3935ded3a11897c02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/73f49c344ef745c3935ded3a11897c02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/73f49c344ef745c3935ded3a11897c02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 14:50:13 user devstack@n-api.service[61253]: X-Tenant: tempest-VolumesNegativeTest-2101003155 Apr 19 14:50:13 user devstack@n-api.service[61253]: X-Tenant-Id: 73f49c344ef745c3935ded3a11897c02 Apr 19 14:50:13 user devstack@n-api.service[61253]: X-Tenant-Name: tempest-VolumesNegativeTest-2101003155 Apr 19 14:50:13 user devstack@n-api.service[61253]: X-User: tempest-VolumesNegativeTest-2101003155-project-member Apr 19 14:50:13 user devstack@n-api.service[61253]: X-User-Domain-Id: default Apr 19 14:50:13 user devstack@n-api.service[61253]: X-User-Domain-Name: Default Apr 19 14:50:13 user devstack@n-api.service[61253]: X-User-Id: 44cf1488848a42178e2a19e3f641452f Apr 19 14:50:13 user devstack@n-api.service[61253]: X-User-Name: tempest-VolumesNegativeTest-2101003155-project-member Apr 19 14:50:13 user devstack@n-api.service[61253]: Apr 19 14:50:13 user devstack@n-api.service[61253]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1145089214", "metadata": {"Type": "work"}}} Apr 19 14:50:13 user devstack@n-api.service[61253]: method: Apr 19 14:50:13 user devstack@n-api.service[61253]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 19 14:50:13 user devstack@n-api.service[61253]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1145089214', 'metadata': {'Type': 'work'}}}} Apr 19 14:50:13 user devstack@n-api.service[61253]: {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:50:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:50:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 19 14:50:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 19 14:50:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 19 14:50:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise error Apr 19 14:50:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 19 14:50:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 14:50:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 19 14:50:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 19 14:50:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 14:50:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 19 14:50:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi '' Apr 19 14:50:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 14:50:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:50:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 14:50:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:50:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:50:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:50:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:50:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:50:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 19 14:50:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 19 14:50:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:50:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:50:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 19 14:50:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 19 14:50:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 19 14:50:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 19 14:50:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 19 14:50:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 19 14:50:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 19 14:50:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 14:50:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:50:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 14:50:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:50:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:50:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:50:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 19 14:50:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 19 14:50:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 19 14:50:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 14:50:13 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-baab3880-4030-42f0-9bb5-e36718b29b36 tempest-VolumesNegativeTest-2101003155 tempest-VolumesNegativeTest-2101003155-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:50:13 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-baab3880-4030-42f0-9bb5-e36718b29b36 tempest-VolumesNegativeTest-2101003155 tempest-VolumesNegativeTest-2101003155-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.017909 Apr 19 14:50:13 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 16/48] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 19 14:50:13 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 19 14:50:13 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-ef07962f-1f20-406d-8f6b-916f0a7f78cd tempest-VolumesNegativeTest-2101003155 tempest-VolumesNegativeTest-2101003155-project-member] Calling method '.version_select at 0x7f3cfc0b9a20>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:50:14 user devstack@n-api.service[61254]: INFO nova.api.openstack.wsgi [None req-ef07962f-1f20-406d-8f6b-916f0a7f78cd tempest-VolumesNegativeTest-2101003155 tempest-VolumesNegativeTest-2101003155-project-member] HTTP exception thrown: Volume tempest-invalid-590421660 could not be found. Apr 19 14:50:14 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-ef07962f-1f20-406d-8f6b-916f0a7f78cd tempest-VolumesNegativeTest-2101003155 tempest-VolumesNegativeTest-2101003155-project-member] Request method failure captured: Apr 19 14:50:14 user devstack@n-api.service[61254]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-590421660 HTTP/1.1 Apr 19 14:50:14 user devstack@n-api.service[61254]: Accept: application/json Apr 19 14:50:14 user devstack@n-api.service[61254]: Accept-Encoding: identity Apr 19 14:50:14 user devstack@n-api.service[61254]: Connection: close Apr 19 14:50:14 user devstack@n-api.service[61254]: Content-Length: 0 Apr 19 14:50:14 user devstack@n-api.service[61254]: Content-Type: application/json Apr 19 14:50:14 user devstack@n-api.service[61254]: Host: 10.0.0.210 Apr 19 14:50:14 user devstack@n-api.service[61254]: Openstack-System-Scope: None Apr 19 14:50:14 user devstack@n-api.service[61254]: User-Agent: python-urllib3/1.26.15 Apr 19 14:50:14 user devstack@n-api.service[61254]: X-Auth-Token: gAAAAABkP_-l2K7GDc1H5QmgUT2gkDAPpRKDsqm3nfMLsqBV3EG7L9rtiFmDXw-PqDlV6Ks0k0P51L2zbv8gnNlaSdSK8LSj1MjY8NMMV8sN0i5ZbgFT6dP7pUT8VI_pWbSL9dgAa_au9ajX6H3eq5MDQoUVh6EYf4dp_9W3VvKQIRZ2843CbZE Apr 19 14:50:14 user devstack@n-api.service[61254]: X-Domain-Id: None Apr 19 14:50:14 user devstack@n-api.service[61254]: X-Domain-Name: None Apr 19 14:50:14 user devstack@n-api.service[61254]: X-Identity-Status: Confirmed Apr 19 14:50:14 user devstack@n-api.service[61254]: X-Is-Admin-Project: True Apr 19 14:50:14 user devstack@n-api.service[61254]: X-Project-Domain-Id: default Apr 19 14:50:14 user devstack@n-api.service[61254]: X-Project-Domain-Name: Default Apr 19 14:50:14 user devstack@n-api.service[61254]: X-Project-Id: 73f49c344ef745c3935ded3a11897c02 Apr 19 14:50:14 user devstack@n-api.service[61254]: X-Project-Name: tempest-VolumesNegativeTest-2101003155 Apr 19 14:50:14 user devstack@n-api.service[61254]: X-Role: member,reader Apr 19 14:50:14 user devstack@n-api.service[61254]: X-Roles: member,reader Apr 19 14:50:14 user devstack@n-api.service[61254]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/73f49c344ef745c3935ded3a11897c02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/73f49c344ef745c3935ded3a11897c02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/73f49c344ef745c3935ded3a11897c02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 14:50:14 user devstack@n-api.service[61254]: X-Tenant: tempest-VolumesNegativeTest-2101003155 Apr 19 14:50:14 user devstack@n-api.service[61254]: X-Tenant-Id: 73f49c344ef745c3935ded3a11897c02 Apr 19 14:50:14 user devstack@n-api.service[61254]: X-Tenant-Name: tempest-VolumesNegativeTest-2101003155 Apr 19 14:50:14 user devstack@n-api.service[61254]: X-User: tempest-VolumesNegativeTest-2101003155-project-member Apr 19 14:50:14 user devstack@n-api.service[61254]: X-User-Domain-Id: default Apr 19 14:50:14 user devstack@n-api.service[61254]: X-User-Domain-Name: Default Apr 19 14:50:14 user devstack@n-api.service[61254]: X-User-Id: 44cf1488848a42178e2a19e3f641452f Apr 19 14:50:14 user devstack@n-api.service[61254]: X-User-Name: tempest-VolumesNegativeTest-2101003155-project-member Apr 19 14:50:14 user devstack@n-api.service[61254]: method: Apr 19 14:50:14 user devstack@n-api.service[61254]: exception: Volume tempest-invalid-590421660 could not be found. Apr 19 14:50:14 user devstack@n-api.service[61254]: action_args: {'id': 'tempest-invalid-590421660'} Apr 19 14:50:14 user devstack@n-api.service[61254]: {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-590421660 could not be found. (HTTP 404) (Request-ID: req-10666bc8-ac2e-4965-a5f0-780c7fb0fed2) Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-590421660 could not be found. Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-590421660 could not be found. Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-590421660 could not be found. Apr 19 14:50:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:50:14 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-ef07962f-1f20-406d-8f6b-916f0a7f78cd tempest-VolumesNegativeTest-2101003155 tempest-VolumesNegativeTest-2101003155-project-member] Returning 404 to user: Volume tempest-invalid-590421660 could not be found. {{(pid=61254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:50:14 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-ef07962f-1f20-406d-8f6b-916f0a7f78cd tempest-VolumesNegativeTest-2101003155 tempest-VolumesNegativeTest-2101003155-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-590421660" status: 404 len: 98 microversion: 2.1 time: 0.938625 Apr 19 14:50:14 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 16/49] 10.0.0.210 () {62 vars in 1292 bytes} [Wed Apr 19 14:50:13 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-590421660 => generated 98 bytes in 940 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 19 14:50:14 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:50:14 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-fedcdeb3-167c-49ee-8a76-e3fd5c24256f tempest-VolumesNegativeTest-2101003155 tempest-VolumesNegativeTest-2101003155-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010729 Apr 19 14:50:14 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 18/50] 10.0.0.210 () {62 vars in 1217 bytes} [Wed Apr 19 14:50:14 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 19 14:50:14 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-3166ede0-4574-4f9a-b904-61eeb2d669f6 tempest-VolumesNegativeTest-2101003155 tempest-VolumesNegativeTest-2101003155-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011645 Apr 19 14:50:14 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 17/51] 10.0.0.210 () {62 vars in 1214 bytes} [Wed Apr 19 14:50:14 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 19 14:50:14 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-8ef06797-bd42-4531-b68e-d4663f57ebeb tempest-VolumesNegativeTest-2101003155 tempest-VolumesNegativeTest-2101003155-project-member] Calling method '.version_select at 0x7f3cfb56a4d0>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:50:15 user devstack@n-api.service[61254]: INFO nova.api.openstack.wsgi [None req-8ef06797-bd42-4531-b68e-d4663f57ebeb tempest-VolumesNegativeTest-2101003155 tempest-VolumesNegativeTest-2101003155-project-member] HTTP exception thrown: Volume b08a15d4-d16e-4eb3-97c0-21a1a7560bec could not be found. Apr 19 14:50:15 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-8ef06797-bd42-4531-b68e-d4663f57ebeb tempest-VolumesNegativeTest-2101003155 tempest-VolumesNegativeTest-2101003155-project-member] Request method failure captured: Apr 19 14:50:15 user devstack@n-api.service[61254]: request: DELETE /compute/v2.1/os-volumes/b08a15d4-d16e-4eb3-97c0-21a1a7560bec HTTP/1.1 Apr 19 14:50:15 user devstack@n-api.service[61254]: Accept: application/json Apr 19 14:50:15 user devstack@n-api.service[61254]: Accept-Encoding: identity Apr 19 14:50:15 user devstack@n-api.service[61254]: Connection: close Apr 19 14:50:15 user devstack@n-api.service[61254]: Content-Length: 0 Apr 19 14:50:15 user devstack@n-api.service[61254]: Content-Type: application/json Apr 19 14:50:15 user devstack@n-api.service[61254]: Host: 10.0.0.210 Apr 19 14:50:15 user devstack@n-api.service[61254]: Openstack-System-Scope: None Apr 19 14:50:15 user devstack@n-api.service[61254]: User-Agent: python-urllib3/1.26.15 Apr 19 14:50:15 user devstack@n-api.service[61254]: X-Auth-Token: gAAAAABkP_-l2K7GDc1H5QmgUT2gkDAPpRKDsqm3nfMLsqBV3EG7L9rtiFmDXw-PqDlV6Ks0k0P51L2zbv8gnNlaSdSK8LSj1MjY8NMMV8sN0i5ZbgFT6dP7pUT8VI_pWbSL9dgAa_au9ajX6H3eq5MDQoUVh6EYf4dp_9W3VvKQIRZ2843CbZE Apr 19 14:50:15 user devstack@n-api.service[61254]: X-Domain-Id: None Apr 19 14:50:15 user devstack@n-api.service[61254]: X-Domain-Name: None Apr 19 14:50:15 user devstack@n-api.service[61254]: X-Identity-Status: Confirmed Apr 19 14:50:15 user devstack@n-api.service[61254]: X-Is-Admin-Project: True Apr 19 14:50:15 user devstack@n-api.service[61254]: X-Project-Domain-Id: default Apr 19 14:50:15 user devstack@n-api.service[61254]: X-Project-Domain-Name: Default Apr 19 14:50:15 user devstack@n-api.service[61254]: X-Project-Id: 73f49c344ef745c3935ded3a11897c02 Apr 19 14:50:15 user devstack@n-api.service[61254]: X-Project-Name: tempest-VolumesNegativeTest-2101003155 Apr 19 14:50:15 user devstack@n-api.service[61254]: X-Role: member,reader Apr 19 14:50:15 user devstack@n-api.service[61254]: X-Roles: member,reader Apr 19 14:50:15 user devstack@n-api.service[61254]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/73f49c344ef745c3935ded3a11897c02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/73f49c344ef745c3935ded3a11897c02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/73f49c344ef745c3935ded3a11897c02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 14:50:15 user devstack@n-api.service[61254]: X-Tenant: tempest-VolumesNegativeTest-2101003155 Apr 19 14:50:15 user devstack@n-api.service[61254]: X-Tenant-Id: 73f49c344ef745c3935ded3a11897c02 Apr 19 14:50:15 user devstack@n-api.service[61254]: X-Tenant-Name: tempest-VolumesNegativeTest-2101003155 Apr 19 14:50:15 user devstack@n-api.service[61254]: X-User: tempest-VolumesNegativeTest-2101003155-project-member Apr 19 14:50:15 user devstack@n-api.service[61254]: X-User-Domain-Id: default Apr 19 14:50:15 user devstack@n-api.service[61254]: X-User-Domain-Name: Default Apr 19 14:50:15 user devstack@n-api.service[61254]: X-User-Id: 44cf1488848a42178e2a19e3f641452f Apr 19 14:50:15 user devstack@n-api.service[61254]: X-User-Name: tempest-VolumesNegativeTest-2101003155-project-member Apr 19 14:50:15 user devstack@n-api.service[61254]: method: Apr 19 14:50:15 user devstack@n-api.service[61254]: exception: Volume b08a15d4-d16e-4eb3-97c0-21a1a7560bec could not be found. Apr 19 14:50:15 user devstack@n-api.service[61254]: action_args: {'id': 'b08a15d4-d16e-4eb3-97c0-21a1a7560bec'} Apr 19 14:50:15 user devstack@n-api.service[61254]: {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b08a15d4-d16e-4eb3-97c0-21a1a7560bec could not be found. (HTTP 404) (Request-ID: req-b1d4ccd4-3ce1-42da-90d7-2a80cbb0c521) Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b08a15d4-d16e-4eb3-97c0-21a1a7560bec could not be found. Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b08a15d4-d16e-4eb3-97c0-21a1a7560bec could not be found. Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b08a15d4-d16e-4eb3-97c0-21a1a7560bec could not be found. Apr 19 14:50:15 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:50:15 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-8ef06797-bd42-4531-b68e-d4663f57ebeb tempest-VolumesNegativeTest-2101003155 tempest-VolumesNegativeTest-2101003155-project-member] Returning 404 to user: Volume b08a15d4-d16e-4eb3-97c0-21a1a7560bec could not be found. {{(pid=61254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:50:15 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-8ef06797-bd42-4531-b68e-d4663f57ebeb tempest-VolumesNegativeTest-2101003155 tempest-VolumesNegativeTest-2101003155-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/b08a15d4-d16e-4eb3-97c0-21a1a7560bec" status: 404 len: 109 microversion: 2.1 time: 0.837403 Apr 19 14:50:15 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 17/52] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 19 14:50:14 2023] DELETE /compute/v2.1/os-volumes/b08a15d4-d16e-4eb3-97c0-21a1a7560bec => generated 109 bytes in 839 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:50:15 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-427c196b-74de-410d-8cf6-49210d86dd6f tempest-VolumesNegativeTest-2101003155 tempest-VolumesNegativeTest-2101003155-project-member] Calling method '.version_select at 0x7f3cfb6a3130>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:50:15 user devstack@n-api.service[61255]: INFO nova.api.openstack.wsgi [None req-427c196b-74de-410d-8cf6-49210d86dd6f tempest-VolumesNegativeTest-2101003155 tempest-VolumesNegativeTest-2101003155-project-member] HTTP exception thrown: Volume 11bedb4b-4011-483e-ae9c-ee4b6e0863c0 could not be found. Apr 19 14:50:15 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-427c196b-74de-410d-8cf6-49210d86dd6f tempest-VolumesNegativeTest-2101003155 tempest-VolumesNegativeTest-2101003155-project-member] Request method failure captured: Apr 19 14:50:15 user devstack@n-api.service[61255]: request: GET /compute/v2.1/os-volumes/11bedb4b-4011-483e-ae9c-ee4b6e0863c0 HTTP/1.1 Apr 19 14:50:15 user devstack@n-api.service[61255]: Accept: application/json Apr 19 14:50:15 user devstack@n-api.service[61255]: Accept-Encoding: identity Apr 19 14:50:15 user devstack@n-api.service[61255]: Connection: close Apr 19 14:50:15 user devstack@n-api.service[61255]: Content-Length: 0 Apr 19 14:50:15 user devstack@n-api.service[61255]: Content-Type: application/json Apr 19 14:50:15 user devstack@n-api.service[61255]: Host: 10.0.0.210 Apr 19 14:50:15 user devstack@n-api.service[61255]: Openstack-System-Scope: None Apr 19 14:50:15 user devstack@n-api.service[61255]: User-Agent: python-urllib3/1.26.15 Apr 19 14:50:15 user devstack@n-api.service[61255]: X-Auth-Token: gAAAAABkP_-l2K7GDc1H5QmgUT2gkDAPpRKDsqm3nfMLsqBV3EG7L9rtiFmDXw-PqDlV6Ks0k0P51L2zbv8gnNlaSdSK8LSj1MjY8NMMV8sN0i5ZbgFT6dP7pUT8VI_pWbSL9dgAa_au9ajX6H3eq5MDQoUVh6EYf4dp_9W3VvKQIRZ2843CbZE Apr 19 14:50:15 user devstack@n-api.service[61255]: X-Domain-Id: None Apr 19 14:50:15 user devstack@n-api.service[61255]: X-Domain-Name: None Apr 19 14:50:15 user devstack@n-api.service[61255]: X-Identity-Status: Confirmed Apr 19 14:50:15 user devstack@n-api.service[61255]: X-Is-Admin-Project: True Apr 19 14:50:15 user devstack@n-api.service[61255]: X-Project-Domain-Id: default Apr 19 14:50:15 user devstack@n-api.service[61255]: X-Project-Domain-Name: Default Apr 19 14:50:15 user devstack@n-api.service[61255]: X-Project-Id: 73f49c344ef745c3935ded3a11897c02 Apr 19 14:50:15 user devstack@n-api.service[61255]: X-Project-Name: tempest-VolumesNegativeTest-2101003155 Apr 19 14:50:15 user devstack@n-api.service[61255]: X-Role: member,reader Apr 19 14:50:15 user devstack@n-api.service[61255]: X-Roles: member,reader Apr 19 14:50:15 user devstack@n-api.service[61255]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/73f49c344ef745c3935ded3a11897c02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/73f49c344ef745c3935ded3a11897c02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/73f49c344ef745c3935ded3a11897c02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 14:50:15 user devstack@n-api.service[61255]: X-Tenant: tempest-VolumesNegativeTest-2101003155 Apr 19 14:50:15 user devstack@n-api.service[61255]: X-Tenant-Id: 73f49c344ef745c3935ded3a11897c02 Apr 19 14:50:15 user devstack@n-api.service[61255]: X-Tenant-Name: tempest-VolumesNegativeTest-2101003155 Apr 19 14:50:15 user devstack@n-api.service[61255]: X-User: tempest-VolumesNegativeTest-2101003155-project-member Apr 19 14:50:15 user devstack@n-api.service[61255]: X-User-Domain-Id: default Apr 19 14:50:15 user devstack@n-api.service[61255]: X-User-Domain-Name: Default Apr 19 14:50:15 user devstack@n-api.service[61255]: X-User-Id: 44cf1488848a42178e2a19e3f641452f Apr 19 14:50:15 user devstack@n-api.service[61255]: X-User-Name: tempest-VolumesNegativeTest-2101003155-project-member Apr 19 14:50:15 user devstack@n-api.service[61255]: method: Apr 19 14:50:15 user devstack@n-api.service[61255]: exception: Volume 11bedb4b-4011-483e-ae9c-ee4b6e0863c0 could not be found. Apr 19 14:50:15 user devstack@n-api.service[61255]: action_args: {'id': '11bedb4b-4011-483e-ae9c-ee4b6e0863c0'} Apr 19 14:50:15 user devstack@n-api.service[61255]: {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 11bedb4b-4011-483e-ae9c-ee4b6e0863c0 could not be found. (HTTP 404) (Request-ID: req-ebaf7bcd-0462-4705-af3f-70ef3eddbd34) Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 11bedb4b-4011-483e-ae9c-ee4b6e0863c0 could not be found. Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 11bedb4b-4011-483e-ae9c-ee4b6e0863c0 could not be found. Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 11bedb4b-4011-483e-ae9c-ee4b6e0863c0 could not be found. Apr 19 14:50:15 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:50:15 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-427c196b-74de-410d-8cf6-49210d86dd6f tempest-VolumesNegativeTest-2101003155 tempest-VolumesNegativeTest-2101003155-project-member] Returning 404 to user: Volume 11bedb4b-4011-483e-ae9c-ee4b6e0863c0 could not be found. {{(pid=61255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:50:15 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-427c196b-74de-410d-8cf6-49210d86dd6f tempest-VolumesNegativeTest-2101003155 tempest-VolumesNegativeTest-2101003155-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/11bedb4b-4011-483e-ae9c-ee4b6e0863c0" status: 404 len: 109 microversion: 2.1 time: 0.303772 Apr 19 14:50:15 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 19/53] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 19 14:50:15 2023] GET /compute/v2.1/os-volumes/11bedb4b-4011-483e-ae9c-ee4b6e0863c0 => generated 109 bytes in 305 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:50:28 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-443a6dc3-1b0d-45d1-a139-d5e400732cf3 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2069687971", "imageRef": "283dcfe8-75fd-4917-902e-1b940387187c", "flavorRef": "42", "networks": [{"uuid": "7eb159e6-9039-4ab6-84db-f9216f4a706b"}]}} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:50:28 user devstack@n-api.service[61253]: DEBUG nova.network.neutron [None req-443a6dc3-1b0d-45d1-a139-d5e400732cf3 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] validate_networks() for [('7eb159e6-9039-4ab6-84db-f9216f4a706b', None, None, None, None, None)] {{(pid=61253) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 14:50:30 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-443a6dc3-1b0d-45d1-a139-d5e400732cf3 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Flavor limits 0:0:0 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 14:50:30 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-443a6dc3-1b0d-45d1-a139-d5e400732cf3 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Image limits 0:0:0 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 14:50:30 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-443a6dc3-1b0d-45d1-a139-d5e400732cf3 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Flavor pref 0:0:0 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 14:50:30 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-443a6dc3-1b0d-45d1-a139-d5e400732cf3 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Image pref 0:0:0 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 14:50:30 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-443a6dc3-1b0d-45d1-a139-d5e400732cf3 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 14:50:30 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-443a6dc3-1b0d-45d1-a139-d5e400732cf3 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:50:30 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-443a6dc3-1b0d-45d1-a139-d5e400732cf3 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:50:30 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-443a6dc3-1b0d-45d1-a139-d5e400732cf3 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:50:30 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-443a6dc3-1b0d-45d1-a139-d5e400732cf3 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:50:30 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-443a6dc3-1b0d-45d1-a139-d5e400732cf3 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:50:30 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-443a6dc3-1b0d-45d1-a139-d5e400732cf3 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:50:30 user devstack@n-api.service[61253]: DEBUG nova.quota [None req-443a6dc3-1b0d-45d1-a139-d5e400732cf3 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Getting quotas for project ea8cf58226424348afa3db7ce42833f1. Resources: {'ram', 'instances', 'cores'} {{(pid=61253) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:50:30 user devstack@n-api.service[61253]: DEBUG nova.quota [None req-443a6dc3-1b0d-45d1-a139-d5e400732cf3 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Getting quotas for user 9c59859626174f24b37a68077e322051 and project ea8cf58226424348afa3db7ce42833f1. Resources: {'ram', 'instances', 'cores'} {{(pid=61253) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:50:30 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-443a6dc3-1b0d-45d1-a139-d5e400732cf3 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Going to run 1 instances... {{(pid=61253) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 14:50:30 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-443a6dc3-1b0d-45d1-a139-d5e400732cf3 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] [instance: 84619c4f-a014-4044-bdf8-a2c30eb11a18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='283dcfe8-75fd-4917-902e-1b940387187c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61253) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 14:50:30 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-443a6dc3-1b0d-45d1-a139-d5e400732cf3 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.637833 Apr 19 14:50:30 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 18/54] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 14:50:27 2023] POST /compute/v2.1/servers => generated 378 bytes in 2639 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 14:50:30 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-e1a60a3b-3254-408f-834a-24f5d13cf5ec tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:50:30 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-e1a60a3b-3254-408f-834a-24f5d13cf5ec tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] [instance: 84619c4f-a014-4044-bdf8-a2c30eb11a18] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:50:30 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-e1a60a3b-3254-408f-834a-24f5d13cf5ec tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c59859626174f24b37a68077e322051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea8cf58226424348afa3db7ce42833f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:50:30 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-e1a60a3b-3254-408f-834a-24f5d13cf5ec tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84619c4f-a014-4044-bdf8-a2c30eb11a18" status: 200 len: 1209 microversion: 2.1 time: 0.243980 Apr 19 14:50:30 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 18/55] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:50:30 2023] GET /compute/v2.1/servers/84619c4f-a014-4044-bdf8-a2c30eb11a18 => generated 1209 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:50:32 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-67b49e9e-f3c2-4440-ae46-5d6b3beca1b6 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Action: 'create', calling method: .version_select at 0x7f3cfb5892d0>, body: {"keypair": {"name": "tempest-keypair-417331245", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJE1rRwRoScznDF7TM4+vPy2GXrrao9GX2Z0qZVP0iSMwSZwYP4VR1ulRnAoOu81i4h3VnNXenm7snhMk9bJYsudU5f7Q3/Eu6iW4XMELRLeXNsMx/WEBs/iX04J5OmZug=="}} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:50:32 user devstack@n-api.service[61255]: DEBUG nova.quota [None req-67b49e9e-f3c2-4440-ae46-5d6b3beca1b6 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Getting quotas for project 4de5e8e3b3394f219c8af4b834c85631. Resources: {'key_pairs'} {{(pid=61255) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:50:32 user devstack@n-api.service[61255]: DEBUG nova.quota [None req-67b49e9e-f3c2-4440-ae46-5d6b3beca1b6 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Getting quotas for user 31b888ae3c3540df8cf7953ed5ed90d1 and project 4de5e8e3b3394f219c8af4b834c85631. Resources: {'key_pairs'} {{(pid=61255) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:50:32 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-67b49e9e-f3c2-4440-ae46-5d6b3beca1b6 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.282213 Apr 19 14:50:32 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 20/56] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 14:50:32 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:50:33 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-42a3ca98-9928-42eb-bd15-d8b51abadb06 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1564913160", "imageRef": "283dcfe8-75fd-4917-902e-1b940387187c", "flavorRef": "42", "networks": [{"uuid": "773ad771-04cd-4587-bc7e-10971f78fa84"}]}} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:50:33 user devstack@n-api.service[61253]: DEBUG nova.network.neutron [None req-42a3ca98-9928-42eb-bd15-d8b51abadb06 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] validate_networks() for [('773ad771-04cd-4587-bc7e-10971f78fa84', None, None, None, None, None)] {{(pid=61253) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 14:50:34 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-42a3ca98-9928-42eb-bd15-d8b51abadb06 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Flavor limits 0:0:0 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 14:50:34 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-42a3ca98-9928-42eb-bd15-d8b51abadb06 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Image limits 0:0:0 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 14:50:34 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-42a3ca98-9928-42eb-bd15-d8b51abadb06 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Flavor pref 0:0:0 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 14:50:34 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-42a3ca98-9928-42eb-bd15-d8b51abadb06 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Image pref 0:0:0 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 14:50:34 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-42a3ca98-9928-42eb-bd15-d8b51abadb06 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 14:50:34 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-42a3ca98-9928-42eb-bd15-d8b51abadb06 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:50:34 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-42a3ca98-9928-42eb-bd15-d8b51abadb06 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:50:34 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-42a3ca98-9928-42eb-bd15-d8b51abadb06 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:50:34 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-42a3ca98-9928-42eb-bd15-d8b51abadb06 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:50:34 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-42a3ca98-9928-42eb-bd15-d8b51abadb06 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:50:34 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-42a3ca98-9928-42eb-bd15-d8b51abadb06 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:50:34 user devstack@n-api.service[61253]: DEBUG nova.quota [None req-42a3ca98-9928-42eb-bd15-d8b51abadb06 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Getting quotas for project b1bc7474b840449da88a8f420316ecfb. Resources: {'ram', 'instances', 'cores'} {{(pid=61253) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:50:34 user devstack@n-api.service[61253]: DEBUG nova.quota [None req-42a3ca98-9928-42eb-bd15-d8b51abadb06 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Getting quotas for user b33dd700a9314ab9a70428a3455a571c and project b1bc7474b840449da88a8f420316ecfb. Resources: {'ram', 'instances', 'cores'} {{(pid=61253) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:50:34 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-42a3ca98-9928-42eb-bd15-d8b51abadb06 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Going to run 1 instances... {{(pid=61253) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 14:50:34 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-42a3ca98-9928-42eb-bd15-d8b51abadb06 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] [instance: 95058640-8ace-444b-8e6b-685575695a46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='283dcfe8-75fd-4917-902e-1b940387187c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61253) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 14:50:34 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-42a3ca98-9928-42eb-bd15-d8b51abadb06 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 1.688434 Apr 19 14:50:34 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 19/57] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 19 14:50:33 2023] POST /compute/v2.1/servers => generated 378 bytes in 1690 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 19 14:50:34 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-aa3d77ca-42be-448e-ac51-adbeddd192b1 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:50:34 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-aa3d77ca-42be-448e-ac51-adbeddd192b1 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] [instance: 95058640-8ace-444b-8e6b-685575695a46] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:50:35 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-aa3d77ca-42be-448e-ac51-adbeddd192b1 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33dd700a9314ab9a70428a3455a571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bc7474b840449da88a8f420316ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:50:35 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-aa3d77ca-42be-448e-ac51-adbeddd192b1 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b33dd700a9314ab9a70428a3455a571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bc7474b840449da88a8f420316ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:50:35 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-aa3d77ca-42be-448e-ac51-adbeddd192b1 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b33dd700a9314ab9a70428a3455a571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bc7474b840449da88a8f420316ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:50:35 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-aa3d77ca-42be-448e-ac51-adbeddd192b1 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95058640-8ace-444b-8e6b-685575695a46" status: 200 len: 1395 microversion: 2.87 time: 0.180179 Apr 19 14:50:35 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 19/58] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 14:50:34 2023] GET /compute/v2.1/servers/95058640-8ace-444b-8e6b-685575695a46 => generated 1395 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 14:50:37 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-d9d2ba15-897a-4b32-8ccb-de5dc4dd6e73 req-94edd501-4d49-416a-ba57-e1959cf5a46d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84619c4f-a014-4044-bdf8-a2c30eb11a18", "tag": "b3375dfe-c516-4cbd-a65a-b5d5568fe554"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:50:37 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-d9d2ba15-897a-4b32-8ccb-de5dc4dd6e73 req-94edd501-4d49-416a-ba57-e1959cf5a46d service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:50:37 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-d9d2ba15-897a-4b32-8ccb-de5dc4dd6e73 req-94edd501-4d49-416a-ba57-e1959cf5a46d service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:50:37 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-d9d2ba15-897a-4b32-8ccb-de5dc4dd6e73 req-94edd501-4d49-416a-ba57-e1959cf5a46d service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:50:37 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-d9d2ba15-897a-4b32-8ccb-de5dc4dd6e73 req-94edd501-4d49-416a-ba57-e1959cf5a46d service nova] Creating event network-changed:b3375dfe-c516-4cbd-a65a-b5d5568fe554 for instance 84619c4f-a014-4044-bdf8-a2c30eb11a18 on user Apr 19 14:50:37 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-d9d2ba15-897a-4b32-8ccb-de5dc4dd6e73 req-94edd501-4d49-416a-ba57-e1959cf5a46d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61255) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 19 14:50:37 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-d9d2ba15-897a-4b32-8ccb-de5dc4dd6e73 req-94edd501-4d49-416a-ba57-e1959cf5a46d service nova] Acquired lock "compute-rpcapi-router" {{(pid=61255) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 19 14:50:37 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-6c973f6b-b3a9-4712-8d2b-b818ff605489 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:50:37 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-6c973f6b-b3a9-4712-8d2b-b818ff605489 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:50:37 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-6c973f6b-b3a9-4712-8d2b-b818ff605489 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:50:37 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-6c973f6b-b3a9-4712-8d2b-b818ff605489 None None] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:50:37 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-6c973f6b-b3a9-4712-8d2b-b818ff605489 None None] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:50:37 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-6c973f6b-b3a9-4712-8d2b-b818ff605489 None None] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:50:37 user devstack@n-api.service[61255]: INFO nova.compute.rpcapi [None req-6c973f6b-b3a9-4712-8d2b-b818ff605489 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 19 14:50:37 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-6c973f6b-b3a9-4712-8d2b-b818ff605489 None None] Releasing lock "compute-rpcapi-router" {{(pid=61255) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 19 14:50:37 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-6c973f6b-b3a9-4712-8d2b-b818ff605489 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139718 Apr 19 14:50:37 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 21/59] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:50:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:50:38 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-e631cb81-e587-45cd-960a-b093aad403ff tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-505906234", "imageRef": "283dcfe8-75fd-4917-902e-1b940387187c", "flavorRef": "42", "networks": [{"uuid": "93c61815-236d-49c0-ad74-81030f5c76c4"}], "security_groups": [{"name": "tempest-securitygroup--1751634460"}], "key_name": "tempest-keypair-417331245", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:50:38 user devstack@n-api.service[61253]: DEBUG nova.network.neutron [None req-e631cb81-e587-45cd-960a-b093aad403ff tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] validate_networks() for [('93c61815-236d-49c0-ad74-81030f5c76c4', None, None, None, None, None)] {{(pid=61253) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 14:50:40 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-e631cb81-e587-45cd-960a-b093aad403ff tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Flavor limits 0:0:0 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 14:50:40 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-e631cb81-e587-45cd-960a-b093aad403ff tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Image limits 0:0:0 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 14:50:40 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-e631cb81-e587-45cd-960a-b093aad403ff tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Flavor pref 0:0:0 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 14:50:40 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-e631cb81-e587-45cd-960a-b093aad403ff tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Image pref 0:0:0 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 14:50:40 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-e631cb81-e587-45cd-960a-b093aad403ff tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 14:50:40 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-e631cb81-e587-45cd-960a-b093aad403ff tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:50:40 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-e631cb81-e587-45cd-960a-b093aad403ff tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:50:40 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-e631cb81-e587-45cd-960a-b093aad403ff tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:50:40 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-e631cb81-e587-45cd-960a-b093aad403ff tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:50:40 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-e631cb81-e587-45cd-960a-b093aad403ff tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:50:40 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-e631cb81-e587-45cd-960a-b093aad403ff tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:50:40 user devstack@n-api.service[61253]: DEBUG nova.quota [None req-e631cb81-e587-45cd-960a-b093aad403ff tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Getting quotas for project 4de5e8e3b3394f219c8af4b834c85631. Resources: {'ram', 'instances', 'cores'} {{(pid=61253) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:50:40 user devstack@n-api.service[61253]: DEBUG nova.quota [None req-e631cb81-e587-45cd-960a-b093aad403ff tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Getting quotas for user 31b888ae3c3540df8cf7953ed5ed90d1 and project 4de5e8e3b3394f219c8af4b834c85631. Resources: {'ram', 'instances', 'cores'} {{(pid=61253) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:50:40 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-e631cb81-e587-45cd-960a-b093aad403ff tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Going to run 1 instances... {{(pid=61253) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 14:50:40 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-e631cb81-e587-45cd-960a-b093aad403ff tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] [instance: 04ea16ad-a0eb-4187-a966-7ec4f2396852] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='283dcfe8-75fd-4917-902e-1b940387187c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61253) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 14:50:40 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-e631cb81-e587-45cd-960a-b093aad403ff tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.811846 Apr 19 14:50:40 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 20/60] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 14:50:38 2023] POST /compute/v2.1/servers => generated 404 bytes in 1813 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 14:50:40 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-71667dd1-f98e-44ce-8c8f-7564f0bb98c1 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:50:40 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-71667dd1-f98e-44ce-8c8f-7564f0bb98c1 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] [instance: 04ea16ad-a0eb-4187-a966-7ec4f2396852] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:50:40 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-71667dd1-f98e-44ce-8c8f-7564f0bb98c1 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b888ae3c3540df8cf7953ed5ed90d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de5e8e3b3394f219c8af4b834c85631', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:50:40 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-71667dd1-f98e-44ce-8c8f-7564f0bb98c1 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04ea16ad-a0eb-4187-a966-7ec4f2396852" status: 200 len: 1238 microversion: 2.1 time: 0.133506 Apr 19 14:50:40 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 20/61] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:50:40 2023] GET /compute/v2.1/servers/04ea16ad-a0eb-4187-a966-7ec4f2396852 => generated 1238 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:50:40 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-b25c089b-b0d2-4c8a-a2f3-c49a8110d3b9 req-e88adab5-51d6-4cae-adfb-b1905e49c31c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95058640-8ace-444b-8e6b-685575695a46", "tag": "4899e7a4-0c57-44a0-adcc-20591aa70d7e"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:50:40 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-b25c089b-b0d2-4c8a-a2f3-c49a8110d3b9 req-e88adab5-51d6-4cae-adfb-b1905e49c31c service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:50:40 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-b25c089b-b0d2-4c8a-a2f3-c49a8110d3b9 req-e88adab5-51d6-4cae-adfb-b1905e49c31c service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:50:40 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-b25c089b-b0d2-4c8a-a2f3-c49a8110d3b9 req-e88adab5-51d6-4cae-adfb-b1905e49c31c service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:50:40 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-b25c089b-b0d2-4c8a-a2f3-c49a8110d3b9 req-e88adab5-51d6-4cae-adfb-b1905e49c31c service nova] Creating event network-changed:4899e7a4-0c57-44a0-adcc-20591aa70d7e for instance 95058640-8ace-444b-8e6b-685575695a46 on user Apr 19 14:50:40 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [req-b25c089b-b0d2-4c8a-a2f3-c49a8110d3b9 req-e88adab5-51d6-4cae-adfb-b1905e49c31c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046492 Apr 19 14:50:40 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 22/62] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:50:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:50:43 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [req-f864d2e5-3828-4594-8dc2-7bfe815ad752 req-e17777ab-60f7-4164-a3e4-f6b67a1ff948 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84619c4f-a014-4044-bdf8-a2c30eb11a18", "name": "network-vif-plugged", "status": "completed", "tag": "b3375dfe-c516-4cbd-a65a-b5d5568fe554"}]} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:50:43 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-f864d2e5-3828-4594-8dc2-7bfe815ad752 req-e17777ab-60f7-4164-a3e4-f6b67a1ff948 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:50:43 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-f864d2e5-3828-4594-8dc2-7bfe815ad752 req-e17777ab-60f7-4164-a3e4-f6b67a1ff948 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:50:43 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-f864d2e5-3828-4594-8dc2-7bfe815ad752 req-e17777ab-60f7-4164-a3e4-f6b67a1ff948 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:50:43 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-f864d2e5-3828-4594-8dc2-7bfe815ad752 req-e17777ab-60f7-4164-a3e4-f6b67a1ff948 service nova] Creating event network-vif-plugged:b3375dfe-c516-4cbd-a65a-b5d5568fe554 for instance 84619c4f-a014-4044-bdf8-a2c30eb11a18 on user Apr 19 14:50:43 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-f864d2e5-3828-4594-8dc2-7bfe815ad752 req-e17777ab-60f7-4164-a3e4-f6b67a1ff948 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61253) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 19 14:50:43 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-f864d2e5-3828-4594-8dc2-7bfe815ad752 req-e17777ab-60f7-4164-a3e4-f6b67a1ff948 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61253) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 19 14:50:43 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-396fabf0-e54e-4b8e-b992-438beb02740a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:50:43 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-396fabf0-e54e-4b8e-b992-438beb02740a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:50:43 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-396fabf0-e54e-4b8e-b992-438beb02740a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:50:43 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-396fabf0-e54e-4b8e-b992-438beb02740a None None] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:50:43 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-396fabf0-e54e-4b8e-b992-438beb02740a None None] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:50:43 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-396fabf0-e54e-4b8e-b992-438beb02740a None None] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:50:43 user devstack@n-api.service[61253]: INFO nova.compute.rpcapi [None req-396fabf0-e54e-4b8e-b992-438beb02740a None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 19 14:50:43 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-396fabf0-e54e-4b8e-b992-438beb02740a None None] Releasing lock "compute-rpcapi-router" {{(pid=61253) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 19 14:50:43 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-396fabf0-e54e-4b8e-b992-438beb02740a None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095289 Apr 19 14:50:43 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 21/63] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:50:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:50:45 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [req-3cd3f909-a67b-4db3-8218-b3b9a3c6812d req-e85b67ae-024e-4ac3-a818-a0ae1346938e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95058640-8ace-444b-8e6b-685575695a46", "name": "network-vif-plugged", "status": "completed", "tag": "4899e7a4-0c57-44a0-adcc-20591aa70d7e"}]} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:50:45 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-3cd3f909-a67b-4db3-8218-b3b9a3c6812d req-e85b67ae-024e-4ac3-a818-a0ae1346938e service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:50:45 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-3cd3f909-a67b-4db3-8218-b3b9a3c6812d req-e85b67ae-024e-4ac3-a818-a0ae1346938e service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:50:45 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-3cd3f909-a67b-4db3-8218-b3b9a3c6812d req-e85b67ae-024e-4ac3-a818-a0ae1346938e service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:50:45 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-3cd3f909-a67b-4db3-8218-b3b9a3c6812d req-e85b67ae-024e-4ac3-a818-a0ae1346938e service nova] Creating event network-vif-plugged:4899e7a4-0c57-44a0-adcc-20591aa70d7e for instance 95058640-8ace-444b-8e6b-685575695a46 on user Apr 19 14:50:45 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-3cd3f909-a67b-4db3-8218-b3b9a3c6812d req-e85b67ae-024e-4ac3-a818-a0ae1346938e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61254) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 19 14:50:45 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-3cd3f909-a67b-4db3-8218-b3b9a3c6812d req-e85b67ae-024e-4ac3-a818-a0ae1346938e service nova] Acquired lock "compute-rpcapi-router" {{(pid=61254) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 19 14:50:45 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-e81d8290-83b5-480f-8951-5353733ffc6b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:50:45 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-e81d8290-83b5-480f-8951-5353733ffc6b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:50:45 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-e81d8290-83b5-480f-8951-5353733ffc6b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:50:45 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-e81d8290-83b5-480f-8951-5353733ffc6b None None] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:50:45 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-e81d8290-83b5-480f-8951-5353733ffc6b None None] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:50:45 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-e81d8290-83b5-480f-8951-5353733ffc6b None None] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:50:45 user devstack@n-api.service[61254]: INFO nova.compute.rpcapi [None req-e81d8290-83b5-480f-8951-5353733ffc6b None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 19 14:50:45 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-e81d8290-83b5-480f-8951-5353733ffc6b None None] Releasing lock "compute-rpcapi-router" {{(pid=61254) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 19 14:50:45 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-e81d8290-83b5-480f-8951-5353733ffc6b None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.219329 Apr 19 14:50:45 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 21/64] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:50:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:50:45 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell0:SELECT=4 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:50:45 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-2c6897ea-4ed3-4ca4-b32a-b797ef28778c req-b3ea7b1b-97b1-4267-9813-59a5f8bd78d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84619c4f-a014-4044-bdf8-a2c30eb11a18", "name": "network-vif-plugged", "status": "completed", "tag": "b3375dfe-c516-4cbd-a65a-b5d5568fe554"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:50:45 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-2c6897ea-4ed3-4ca4-b32a-b797ef28778c req-b3ea7b1b-97b1-4267-9813-59a5f8bd78d8 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:50:45 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-2c6897ea-4ed3-4ca4-b32a-b797ef28778c req-b3ea7b1b-97b1-4267-9813-59a5f8bd78d8 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:50:45 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-2c6897ea-4ed3-4ca4-b32a-b797ef28778c req-b3ea7b1b-97b1-4267-9813-59a5f8bd78d8 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:50:45 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-2c6897ea-4ed3-4ca4-b32a-b797ef28778c req-b3ea7b1b-97b1-4267-9813-59a5f8bd78d8 service nova] Creating event network-vif-plugged:b3375dfe-c516-4cbd-a65a-b5d5568fe554 for instance 84619c4f-a014-4044-bdf8-a2c30eb11a18 on user Apr 19 14:50:45 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [req-2c6897ea-4ed3-4ca4-b32a-b797ef28778c req-b3ea7b1b-97b1-4267-9813-59a5f8bd78d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040781 Apr 19 14:50:45 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 23/65] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:50:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:50:47 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [req-8dfb59b1-aa0a-4931-85cf-151ceaac9701 req-3c0bad51-a38a-4152-81ab-993a56ef8e0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95058640-8ace-444b-8e6b-685575695a46", "name": "network-vif-plugged", "status": "completed", "tag": "4899e7a4-0c57-44a0-adcc-20591aa70d7e"}]} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:50:47 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-8dfb59b1-aa0a-4931-85cf-151ceaac9701 req-3c0bad51-a38a-4152-81ab-993a56ef8e0d service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:50:47 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-8dfb59b1-aa0a-4931-85cf-151ceaac9701 req-3c0bad51-a38a-4152-81ab-993a56ef8e0d service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:50:47 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-8dfb59b1-aa0a-4931-85cf-151ceaac9701 req-3c0bad51-a38a-4152-81ab-993a56ef8e0d service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:50:47 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-8dfb59b1-aa0a-4931-85cf-151ceaac9701 req-3c0bad51-a38a-4152-81ab-993a56ef8e0d service nova] Creating event network-vif-plugged:4899e7a4-0c57-44a0-adcc-20591aa70d7e for instance 95058640-8ace-444b-8e6b-685575695a46 on user Apr 19 14:50:47 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [req-8dfb59b1-aa0a-4931-85cf-151ceaac9701 req-3c0bad51-a38a-4152-81ab-993a56ef8e0d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083943 Apr 19 14:50:47 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 22/66] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:50:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:50:47 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [req-1519dc01-73e1-475f-97d3-9910be4be7eb req-54181d35-9db7-4848-b461-a5a8b9831087 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04ea16ad-a0eb-4187-a966-7ec4f2396852", "tag": "17cc0520-8e21-4a1d-80b2-3520c4a13a61"}]} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:50:47 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-1519dc01-73e1-475f-97d3-9910be4be7eb req-54181d35-9db7-4848-b461-a5a8b9831087 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:50:47 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-1519dc01-73e1-475f-97d3-9910be4be7eb req-54181d35-9db7-4848-b461-a5a8b9831087 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:50:47 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-1519dc01-73e1-475f-97d3-9910be4be7eb req-54181d35-9db7-4848-b461-a5a8b9831087 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:50:47 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-1519dc01-73e1-475f-97d3-9910be4be7eb req-54181d35-9db7-4848-b461-a5a8b9831087 service nova] Creating event network-changed:17cc0520-8e21-4a1d-80b2-3520c4a13a61 for instance 04ea16ad-a0eb-4187-a966-7ec4f2396852 on user Apr 19 14:50:47 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [req-1519dc01-73e1-475f-97d3-9910be4be7eb req-54181d35-9db7-4848-b461-a5a8b9831087 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055707 Apr 19 14:50:47 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 22/67] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:50:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:50:52 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell0:SELECT=2 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:50:52 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-e9e5a3e9-9a3e-4afc-91a7-4391d01de671 req-a70ad806-8aeb-433c-a5ce-c5bc1862ddf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04ea16ad-a0eb-4187-a966-7ec4f2396852", "name": "network-vif-plugged", "status": "completed", "tag": "17cc0520-8e21-4a1d-80b2-3520c4a13a61"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:50:52 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-e9e5a3e9-9a3e-4afc-91a7-4391d01de671 req-a70ad806-8aeb-433c-a5ce-c5bc1862ddf4 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:50:52 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-e9e5a3e9-9a3e-4afc-91a7-4391d01de671 req-a70ad806-8aeb-433c-a5ce-c5bc1862ddf4 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:50:52 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-e9e5a3e9-9a3e-4afc-91a7-4391d01de671 req-a70ad806-8aeb-433c-a5ce-c5bc1862ddf4 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:50:52 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-e9e5a3e9-9a3e-4afc-91a7-4391d01de671 req-a70ad806-8aeb-433c-a5ce-c5bc1862ddf4 service nova] Creating event network-vif-plugged:17cc0520-8e21-4a1d-80b2-3520c4a13a61 for instance 04ea16ad-a0eb-4187-a966-7ec4f2396852 on user Apr 19 14:50:52 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [req-e9e5a3e9-9a3e-4afc-91a7-4391d01de671 req-a70ad806-8aeb-433c-a5ce-c5bc1862ddf4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047122 Apr 19 14:50:52 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 24/68] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:50:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:50:54 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [req-310eb869-1d4a-4fa8-8bdb-89830aa66035 req-01e25e69-96bd-4350-a72a-8d8a24b28530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04ea16ad-a0eb-4187-a966-7ec4f2396852", "name": "network-vif-plugged", "status": "completed", "tag": "17cc0520-8e21-4a1d-80b2-3520c4a13a61"}]} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:50:54 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell0:SELECT=18 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:50:54 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell0:SELECT=8 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:50:54 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-310eb869-1d4a-4fa8-8bdb-89830aa66035 req-01e25e69-96bd-4350-a72a-8d8a24b28530 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:50:54 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-310eb869-1d4a-4fa8-8bdb-89830aa66035 req-01e25e69-96bd-4350-a72a-8d8a24b28530 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:50:54 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-310eb869-1d4a-4fa8-8bdb-89830aa66035 req-01e25e69-96bd-4350-a72a-8d8a24b28530 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:50:54 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-310eb869-1d4a-4fa8-8bdb-89830aa66035 req-01e25e69-96bd-4350-a72a-8d8a24b28530 service nova] Creating event network-vif-plugged:17cc0520-8e21-4a1d-80b2-3520c4a13a61 for instance 04ea16ad-a0eb-4187-a966-7ec4f2396852 on user Apr 19 14:50:54 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [req-310eb869-1d4a-4fa8-8bdb-89830aa66035 req-01e25e69-96bd-4350-a72a-8d8a24b28530 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057820 Apr 19 14:50:54 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 23/69] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:50:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:50:56 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell0:SELECT=6 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:50:56 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell0:SELECT=2 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:50:56 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-22bdbed0-fe84-42d4-ab00-528cb3f639e0 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Action: 'create', calling method: .version_select at 0x7f3cfb469480>, body: {"keypair": {"name": "tempest-keypair-743362310", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAsrGBMA58nnQ2o8APqDhrSfVnKkWO2ZEnbqBbVoUDex3vrVLmfI+xmsNtbStRCFaX7pQxprs/DMIvSd/VftXu934VrfVfohbZwvy1yuzvBrH2hMViUMpc0nwRegAhHeWQ=="}} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:50:56 user devstack@n-api.service[61254]: DEBUG nova.quota [None req-22bdbed0-fe84-42d4-ab00-528cb3f639e0 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Getting quotas for project 8e931bbf53a24ad385fd4480c6e34c9e. Resources: {'key_pairs'} {{(pid=61254) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:50:56 user devstack@n-api.service[61254]: DEBUG nova.quota [None req-22bdbed0-fe84-42d4-ab00-528cb3f639e0 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Getting quotas for user f959bfd4235e48b89b84317f32887eb8 and project 8e931bbf53a24ad385fd4480c6e34c9e. Resources: {'key_pairs'} {{(pid=61254) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:50:56 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-22bdbed0-fe84-42d4-ab00-528cb3f639e0 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.325442 Apr 19 14:50:56 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 23/70] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 14:50:56 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:50:57 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-92685d96-d2b6-47b7-9821-ac877d727045 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Action: 'create', calling method: .version_select at 0x7f3cfb475360>, body: {"keypair": {"name": "tempest-keypair-979545121", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJq15WunHtId5U9CbrNaAkAmrduPxOv1hG1uY0zNJGjblFEzBc1w24h2RWSpZfbqAiKO+YaexcY1qUoZk9uYuUn9eHIzmrQjiGykGAI6y6C/VkGagp79DqYSrJrtt9msWw=="}} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:50:57 user devstack@n-api.service[61255]: DEBUG nova.quota [None req-92685d96-d2b6-47b7-9821-ac877d727045 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Getting quotas for project da86be1a28254582b530973fbf7f724c. Resources: {'key_pairs'} {{(pid=61255) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:50:57 user devstack@n-api.service[61255]: DEBUG nova.quota [None req-92685d96-d2b6-47b7-9821-ac877d727045 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Getting quotas for user 708068c5f6f5451fbcd6c24235a185d2 and project da86be1a28254582b530973fbf7f724c. Resources: {'key_pairs'} {{(pid=61255) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:50:57 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-92685d96-d2b6-47b7-9821-ac877d727045 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.390480 Apr 19 14:50:57 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 25/71] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 14:50:57 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:51:02 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-d778f9fa-e668-40fd-8f08-08c5fcd9abfd tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1286914869", "imageRef": "872cdec2-5772-4b3f-b961-6cd42b37c6fd", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "88ff9da8-9dd7-4ab1-8dbf-7407f733ac26"}], "security_groups": [{"name": "tempest-securitygroup--938174093"}], "key_name": "tempest-keypair-743362310", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:51:02 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=9 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:51:02 user devstack@n-api.service[61253]: DEBUG nova.network.neutron [None req-d778f9fa-e668-40fd-8f08-08c5fcd9abfd tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] validate_networks() for [('88ff9da8-9dd7-4ab1-8dbf-7407f733ac26', None, None, None, None, None)] {{(pid=61253) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 14:51:03 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-d778f9fa-e668-40fd-8f08-08c5fcd9abfd tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Flavor limits 0:0:0 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 14:51:03 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-d778f9fa-e668-40fd-8f08-08c5fcd9abfd tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Image limits 0:0:0 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 14:51:03 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-d778f9fa-e668-40fd-8f08-08c5fcd9abfd tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Flavor pref 0:0:0 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 14:51:03 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-d778f9fa-e668-40fd-8f08-08c5fcd9abfd tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Image pref 0:0:0 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 14:51:03 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-d778f9fa-e668-40fd-8f08-08c5fcd9abfd tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 14:51:03 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-d778f9fa-e668-40fd-8f08-08c5fcd9abfd tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:51:03 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-d778f9fa-e668-40fd-8f08-08c5fcd9abfd tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:51:03 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-d778f9fa-e668-40fd-8f08-08c5fcd9abfd tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:51:03 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-d778f9fa-e668-40fd-8f08-08c5fcd9abfd tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:51:03 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-d778f9fa-e668-40fd-8f08-08c5fcd9abfd tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:51:03 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-d778f9fa-e668-40fd-8f08-08c5fcd9abfd tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:51:03 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell1:SELECT=15 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:51:03 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell1:SELECT=6 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:51:03 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-afeef963-452c-4a53-9993-780edc67f6c1 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1636236782", "imageRef": "283dcfe8-75fd-4917-902e-1b940387187c", "flavorRef": "42", "networks": [{"uuid": "3c2419fc-af3f-4d4e-a992-2d1855c43c82"}], "security_groups": [{"name": "tempest-securitygroup--1887786302"}], "key_name": "tempest-keypair-979545121", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:51:03 user devstack@n-api.service[61253]: DEBUG nova.quota [None req-d778f9fa-e668-40fd-8f08-08c5fcd9abfd tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Getting quotas for project 8e931bbf53a24ad385fd4480c6e34c9e. Resources: {'ram', 'instances', 'cores'} {{(pid=61253) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:51:03 user devstack@n-api.service[61253]: DEBUG nova.quota [None req-d778f9fa-e668-40fd-8f08-08c5fcd9abfd tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Getting quotas for user f959bfd4235e48b89b84317f32887eb8 and project 8e931bbf53a24ad385fd4480c6e34c9e. Resources: {'ram', 'instances', 'cores'} {{(pid=61253) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:51:03 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-d778f9fa-e668-40fd-8f08-08c5fcd9abfd tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Going to run 1 instances... {{(pid=61253) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 14:51:03 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-d778f9fa-e668-40fd-8f08-08c5fcd9abfd tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] [instance: d5629772-08a7-4edb-acd5-4d92d8dbc48b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='872cdec2-5772-4b3f-b961-6cd42b37c6fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61253) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 14:51:03 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:51:03 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-d778f9fa-e668-40fd-8f08-08c5fcd9abfd tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.246068 Apr 19 14:51:03 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 24/72] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 14:51:02 2023] POST /compute/v2.1/servers => generated 403 bytes in 1247 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 14:51:03 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell1:SELECT=10 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:51:03 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-393fb958-60ed-4bca-961a-254cfbb56c84 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:51:03 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-393fb958-60ed-4bca-961a-254cfbb56c84 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] [instance: d5629772-08a7-4edb-acd5-4d92d8dbc48b] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:51:03 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=2 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:51:03 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-393fb958-60ed-4bca-961a-254cfbb56c84 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f959bfd4235e48b89b84317f32887eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e931bbf53a24ad385fd4480c6e34c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:51:03 user devstack@n-api.service[61254]: DEBUG nova.network.neutron [None req-afeef963-452c-4a53-9993-780edc67f6c1 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] validate_networks() for [('3c2419fc-af3f-4d4e-a992-2d1855c43c82', None, None, None, None, None)] {{(pid=61254) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 14:51:03 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-393fb958-60ed-4bca-961a-254cfbb56c84 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d5629772-08a7-4edb-acd5-4d92d8dbc48b" status: 200 len: 1239 microversion: 2.1 time: 0.177138 Apr 19 14:51:03 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 26/73] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:51:03 2023] GET /compute/v2.1/servers/d5629772-08a7-4edb-acd5-4d92d8dbc48b => generated 1239 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:51:05 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-afeef963-452c-4a53-9993-780edc67f6c1 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Flavor limits 0:0:0 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 14:51:05 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-afeef963-452c-4a53-9993-780edc67f6c1 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Image limits 0:0:0 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 14:51:05 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-afeef963-452c-4a53-9993-780edc67f6c1 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Flavor pref 0:0:0 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 14:51:05 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-afeef963-452c-4a53-9993-780edc67f6c1 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Image pref 0:0:0 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 14:51:05 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-afeef963-452c-4a53-9993-780edc67f6c1 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 14:51:05 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-afeef963-452c-4a53-9993-780edc67f6c1 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:51:05 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-afeef963-452c-4a53-9993-780edc67f6c1 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:51:05 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-afeef963-452c-4a53-9993-780edc67f6c1 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:51:05 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-afeef963-452c-4a53-9993-780edc67f6c1 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:51:05 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-afeef963-452c-4a53-9993-780edc67f6c1 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:51:05 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-afeef963-452c-4a53-9993-780edc67f6c1 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:51:05 user devstack@n-api.service[61254]: DEBUG nova.quota [None req-afeef963-452c-4a53-9993-780edc67f6c1 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Getting quotas for project da86be1a28254582b530973fbf7f724c. Resources: {'ram', 'instances', 'cores'} {{(pid=61254) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:51:05 user devstack@n-api.service[61254]: DEBUG nova.quota [None req-afeef963-452c-4a53-9993-780edc67f6c1 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Getting quotas for user 708068c5f6f5451fbcd6c24235a185d2 and project da86be1a28254582b530973fbf7f724c. Resources: {'ram', 'instances', 'cores'} {{(pid=61254) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:51:05 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-afeef963-452c-4a53-9993-780edc67f6c1 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Going to run 1 instances... {{(pid=61254) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 14:51:05 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-afeef963-452c-4a53-9993-780edc67f6c1 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] [instance: a499484d-dfca-44f4-9ab0-ecabbf88f06d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='283dcfe8-75fd-4917-902e-1b940387187c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61254) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 14:51:05 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-afeef963-452c-4a53-9993-780edc67f6c1 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.194405 Apr 19 14:51:05 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 24/74] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 14:51:03 2023] POST /compute/v2.1/servers => generated 404 bytes in 2196 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 14:51:05 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-57f6fa0f-c1fd-41c6-8df2-95d38d258960 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:51:05 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-57f6fa0f-c1fd-41c6-8df2-95d38d258960 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] [instance: a499484d-dfca-44f4-9ab0-ecabbf88f06d] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:51:05 user devstack@n-api.service[61253]: DEBUG nova.policy [None req-57f6fa0f-c1fd-41c6-8df2-95d38d258960 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708068c5f6f5451fbcd6c24235a185d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da86be1a28254582b530973fbf7f724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61253) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:51:05 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-57f6fa0f-c1fd-41c6-8df2-95d38d258960 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a499484d-dfca-44f4-9ab0-ecabbf88f06d" status: 200 len: 1235 microversion: 2.1 time: 0.445237 Apr 19 14:51:05 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 25/75] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:51:05 2023] GET /compute/v2.1/servers/a499484d-dfca-44f4-9ab0-ecabbf88f06d => generated 1235 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:51:08 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-7c038320-c33a-4ce6-882d-dc7ef9a376a4 req-9ab4b995-3f5c-4dbf-8da7-1a45085abc48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5629772-08a7-4edb-acd5-4d92d8dbc48b", "tag": "6b433d92-f704-4c3a-b3b5-314f29ff2fa0"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:51:08 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-7c038320-c33a-4ce6-882d-dc7ef9a376a4 req-9ab4b995-3f5c-4dbf-8da7-1a45085abc48 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:51:08 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-7c038320-c33a-4ce6-882d-dc7ef9a376a4 req-9ab4b995-3f5c-4dbf-8da7-1a45085abc48 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:51:08 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-7c038320-c33a-4ce6-882d-dc7ef9a376a4 req-9ab4b995-3f5c-4dbf-8da7-1a45085abc48 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:51:08 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-7c038320-c33a-4ce6-882d-dc7ef9a376a4 req-9ab4b995-3f5c-4dbf-8da7-1a45085abc48 service nova] Creating event network-changed:6b433d92-f704-4c3a-b3b5-314f29ff2fa0 for instance d5629772-08a7-4edb-acd5-4d92d8dbc48b on user Apr 19 14:51:08 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [req-7c038320-c33a-4ce6-882d-dc7ef9a376a4 req-9ab4b995-3f5c-4dbf-8da7-1a45085abc48 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035702 Apr 19 14:51:08 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 27/76] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:51:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:51:11 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [req-455985bb-cd03-4f90-974c-2c07c6676fdd req-50501b21-3cf7-4e4f-b1ed-4050bdb17975 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a499484d-dfca-44f4-9ab0-ecabbf88f06d", "tag": "cd2ec5dc-a7b9-4af8-8e23-c269ffdd095f"}]} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:51:11 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-455985bb-cd03-4f90-974c-2c07c6676fdd req-50501b21-3cf7-4e4f-b1ed-4050bdb17975 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:51:11 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-455985bb-cd03-4f90-974c-2c07c6676fdd req-50501b21-3cf7-4e4f-b1ed-4050bdb17975 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:51:11 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-455985bb-cd03-4f90-974c-2c07c6676fdd req-50501b21-3cf7-4e4f-b1ed-4050bdb17975 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:51:11 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-455985bb-cd03-4f90-974c-2c07c6676fdd req-50501b21-3cf7-4e4f-b1ed-4050bdb17975 service nova] Creating event network-changed:cd2ec5dc-a7b9-4af8-8e23-c269ffdd095f for instance a499484d-dfca-44f4-9ab0-ecabbf88f06d on user Apr 19 14:51:11 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [req-455985bb-cd03-4f90-974c-2c07c6676fdd req-50501b21-3cf7-4e4f-b1ed-4050bdb17975 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060565 Apr 19 14:51:11 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 25/77] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:51:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:51:11 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [req-fb676792-c927-45c1-9287-c10448120a65 req-c3699855-cd81-4957-be2c-a83c5cde595a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5629772-08a7-4edb-acd5-4d92d8dbc48b", "name": "network-vif-plugged", "status": "completed", "tag": "6b433d92-f704-4c3a-b3b5-314f29ff2fa0"}]} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:51:11 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-fb676792-c927-45c1-9287-c10448120a65 req-c3699855-cd81-4957-be2c-a83c5cde595a service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:51:11 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-fb676792-c927-45c1-9287-c10448120a65 req-c3699855-cd81-4957-be2c-a83c5cde595a service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:51:11 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-fb676792-c927-45c1-9287-c10448120a65 req-c3699855-cd81-4957-be2c-a83c5cde595a service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:51:11 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-fb676792-c927-45c1-9287-c10448120a65 req-c3699855-cd81-4957-be2c-a83c5cde595a service nova] Creating event network-vif-plugged:6b433d92-f704-4c3a-b3b5-314f29ff2fa0 for instance d5629772-08a7-4edb-acd5-4d92d8dbc48b on user Apr 19 14:51:11 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [req-fb676792-c927-45c1-9287-c10448120a65 req-c3699855-cd81-4957-be2c-a83c5cde595a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124978 Apr 19 14:51:11 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 26/78] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:51:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:51:13 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell0:SELECT=6 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:51:13 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-666daa38-3197-4bf0-8c1d-9b8edfbbe6ea req-6811b158-09e7-4a56-ab6f-35c64f06523c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a499484d-dfca-44f4-9ab0-ecabbf88f06d", "name": "network-vif-plugged", "status": "completed", "tag": "cd2ec5dc-a7b9-4af8-8e23-c269ffdd095f"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:51:13 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-666daa38-3197-4bf0-8c1d-9b8edfbbe6ea req-6811b158-09e7-4a56-ab6f-35c64f06523c service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:51:13 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-666daa38-3197-4bf0-8c1d-9b8edfbbe6ea req-6811b158-09e7-4a56-ab6f-35c64f06523c service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:51:13 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-666daa38-3197-4bf0-8c1d-9b8edfbbe6ea req-6811b158-09e7-4a56-ab6f-35c64f06523c service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:51:13 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-666daa38-3197-4bf0-8c1d-9b8edfbbe6ea req-6811b158-09e7-4a56-ab6f-35c64f06523c service nova] Creating event network-vif-plugged:cd2ec5dc-a7b9-4af8-8e23-c269ffdd095f for instance a499484d-dfca-44f4-9ab0-ecabbf88f06d on user Apr 19 14:51:13 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [req-666daa38-3197-4bf0-8c1d-9b8edfbbe6ea req-6811b158-09e7-4a56-ab6f-35c64f06523c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084166 Apr 19 14:51:13 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 28/79] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:51:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:51:13 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [req-4cba1a87-d281-4e07-87c3-2ad32049f8ab req-c91949fd-5108-46ed-8072-a498c83098fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5629772-08a7-4edb-acd5-4d92d8dbc48b", "name": "network-vif-plugged", "status": "completed", "tag": "6b433d92-f704-4c3a-b3b5-314f29ff2fa0"}]} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:51:13 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-4cba1a87-d281-4e07-87c3-2ad32049f8ab req-c91949fd-5108-46ed-8072-a498c83098fb service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:51:13 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-4cba1a87-d281-4e07-87c3-2ad32049f8ab req-c91949fd-5108-46ed-8072-a498c83098fb service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:51:13 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-4cba1a87-d281-4e07-87c3-2ad32049f8ab req-c91949fd-5108-46ed-8072-a498c83098fb service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:51:13 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-4cba1a87-d281-4e07-87c3-2ad32049f8ab req-c91949fd-5108-46ed-8072-a498c83098fb service nova] Creating event network-vif-plugged:6b433d92-f704-4c3a-b3b5-314f29ff2fa0 for instance d5629772-08a7-4edb-acd5-4d92d8dbc48b on user Apr 19 14:51:14 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [req-4cba1a87-d281-4e07-87c3-2ad32049f8ab req-c91949fd-5108-46ed-8072-a498c83098fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038972 Apr 19 14:51:14 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 26/80] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:51:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:51:14 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell0:SELECT=2 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:51:14 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-0295503c-7eb3-4a9b-b23d-e3fe4d8bfa80 tempest-TestShelveInstance-1346483284 tempest-TestShelveInstance-1346483284-project-member] Action: 'create', calling method: .version_select at 0x7f3cfac36680>, body: {"keypair": {"name": "tempest-TestShelveInstance-412565636", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcx9YKt/nG1RN79VjYA5st9fjBamQOncJZBcHee1Z+OnVDQYGVyqDDnY4YeuVhlZUOt3cMAvam8UdBKXGAN2dXpmapQMABnAzyXrOu8bZFvWxrsuodmr9cn47BLCl/hvA=="}} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:51:14 user devstack@n-api.service[61253]: DEBUG nova.quota [None req-0295503c-7eb3-4a9b-b23d-e3fe4d8bfa80 tempest-TestShelveInstance-1346483284 tempest-TestShelveInstance-1346483284-project-member] Getting quotas for project a7c3baa777564e6d9aaa5bc8607b7e56. Resources: {'key_pairs'} {{(pid=61253) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:51:14 user devstack@n-api.service[61253]: DEBUG nova.quota [None req-0295503c-7eb3-4a9b-b23d-e3fe4d8bfa80 tempest-TestShelveInstance-1346483284 tempest-TestShelveInstance-1346483284-project-member] Getting quotas for user 9bdf4d6a608a4646a4bdfc1ceff9cfef and project a7c3baa777564e6d9aaa5bc8607b7e56. Resources: {'key_pairs'} {{(pid=61253) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:51:14 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-0295503c-7eb3-4a9b-b23d-e3fe4d8bfa80 tempest-TestShelveInstance-1346483284 tempest-TestShelveInstance-1346483284-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.286257 Apr 19 14:51:14 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 27/81] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 14:51:14 2023] POST /compute/v2.1/os-keypairs => generated 396 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:51:15 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-331da34e-c160-4012-8a79-2aa9c12486ea req-d7baa200-8375-45a5-b3a4-87203d1b0487 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a499484d-dfca-44f4-9ab0-ecabbf88f06d", "name": "network-vif-plugged", "status": "completed", "tag": "cd2ec5dc-a7b9-4af8-8e23-c269ffdd095f"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:51:15 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-331da34e-c160-4012-8a79-2aa9c12486ea req-d7baa200-8375-45a5-b3a4-87203d1b0487 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:51:15 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-331da34e-c160-4012-8a79-2aa9c12486ea req-d7baa200-8375-45a5-b3a4-87203d1b0487 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:51:15 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-331da34e-c160-4012-8a79-2aa9c12486ea req-d7baa200-8375-45a5-b3a4-87203d1b0487 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:51:15 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-331da34e-c160-4012-8a79-2aa9c12486ea req-d7baa200-8375-45a5-b3a4-87203d1b0487 service nova] Creating event network-vif-plugged:cd2ec5dc-a7b9-4af8-8e23-c269ffdd095f for instance a499484d-dfca-44f4-9ab0-ecabbf88f06d on user Apr 19 14:51:15 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [req-331da34e-c160-4012-8a79-2aa9c12486ea req-d7baa200-8375-45a5-b3a4-87203d1b0487 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076831 Apr 19 14:51:15 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 29/82] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:51:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:51:19 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell0:SELECT=2 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:51:19 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell0:SELECT=10 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:51:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-6c224ba4-3b70-4458-8125-adfeaa99d144 tempest-TestShelveInstance-1346483284 tempest-TestShelveInstance-1346483284-project-member] Calling method '.version_select at 0x7f3cfab4d5a0>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:51:19 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-6c224ba4-3b70-4458-8125-adfeaa99d144 tempest-TestShelveInstance-1346483284 tempest-TestShelveInstance-1346483284-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-412565636" status: 202 len: 0 microversion: 2.1 time: 0.044498 Apr 19 14:51:19 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 27/83] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 19 14:51:19 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-412565636 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 14:51:20 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-ba50aa80-2b55-4d11-ab1f-de93a6c078e2 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Action: 'create', calling method: .version_select at 0x7f3cfac35ea0>, body: {"keypair": {"name": "tempest-keypair-805315041", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDgnmDsV8C+tLM2c6+hRzkqeTierYjBwP5tPueO8kIPCqvKWaaAao8piP9f88xLXXoWgBMVUtYpcWt9X9vTtnaNLgJXNjWDfokwKLsih7jMgdS6DH6DsW5l02PrIHZNEA=="}} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:51:20 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-99123d57-b1e7-456d-acd1-174956bcb252 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Action: 'create', calling method: .version_select at 0x7f3cfb476170>, body: {"keypair": {"name": "tempest-keypair-1240204617", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvfWAWu8jbYwIlKpZdstChJqEdne/4YP5Un8P7L5FH6PYWoEABs5n9LyGmnohq91ov9VG7dKLzDzZw+1vVE6SN3sZ2NT7mD9GJryPTxYnNsAkRu6xWM38q7DrxgmHDpfQ=="}} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:51:20 user devstack@n-api.service[61253]: DEBUG nova.quota [None req-ba50aa80-2b55-4d11-ab1f-de93a6c078e2 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Getting quotas for project 5383c493e2f049fc9dc06818cb00a6f2. Resources: {'key_pairs'} {{(pid=61253) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:51:20 user devstack@n-api.service[61253]: DEBUG nova.quota [None req-ba50aa80-2b55-4d11-ab1f-de93a6c078e2 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Getting quotas for user fab5193fb1ec41b8a19e8621843a54a7 and project 5383c493e2f049fc9dc06818cb00a6f2. Resources: {'key_pairs'} {{(pid=61253) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:51:20 user devstack@n-api.service[61255]: DEBUG nova.quota [None req-99123d57-b1e7-456d-acd1-174956bcb252 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Getting quotas for project 07dbf312f7154ce1ae7fc1403947d51c. Resources: {'key_pairs'} {{(pid=61255) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:51:20 user devstack@n-api.service[61255]: DEBUG nova.quota [None req-99123d57-b1e7-456d-acd1-174956bcb252 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Getting quotas for user 59aab0b2e3424d80852e588323f187bb and project 07dbf312f7154ce1ae7fc1403947d51c. Resources: {'key_pairs'} {{(pid=61255) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:51:20 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-ba50aa80-2b55-4d11-ab1f-de93a6c078e2 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.424550 Apr 19 14:51:20 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 28/84] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 14:51:19 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:51:20 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-99123d57-b1e7-456d-acd1-174956bcb252 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.263585 Apr 19 14:51:20 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 30/85] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 14:51:20 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:51:20 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-4a2628ec-98bf-4f64-b34c-9f677507c847 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:51:20 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-4a2628ec-98bf-4f64-b34c-9f677507c847 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] [instance: 84619c4f-a014-4044-bdf8-a2c30eb11a18] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:51:20 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-4a2628ec-98bf-4f64-b34c-9f677507c847 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:51:20 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-4a2628ec-98bf-4f64-b34c-9f677507c847 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:51:20 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-4a2628ec-98bf-4f64-b34c-9f677507c847 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:51:20 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-4a2628ec-98bf-4f64-b34c-9f677507c847 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:51:20 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-4a2628ec-98bf-4f64-b34c-9f677507c847 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:51:20 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-4a2628ec-98bf-4f64-b34c-9f677507c847 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:51:21 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-4a2628ec-98bf-4f64-b34c-9f677507c847 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c59859626174f24b37a68077e322051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea8cf58226424348afa3db7ce42833f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:51:21 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-4a2628ec-98bf-4f64-b34c-9f677507c847 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84619c4f-a014-4044-bdf8-a2c30eb11a18" status: 200 len: 1490 microversion: 2.1 time: 0.718325 Apr 19 14:51:21 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 28/86] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:51:20 2023] GET /compute/v2.1/servers/84619c4f-a014-4044-bdf8-a2c30eb11a18 => generated 1490 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:51:23 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell1:SELECT=3 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:51:23 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-9984536a-e4eb-4759-970a-5c864c061150 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-4357067", "imageRef": "283dcfe8-75fd-4917-902e-1b940387187c", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "17166877-bda4-4d38-864d-f92eab0126b0"}], "security_groups": [{"name": "tempest-securitygroup--665470993"}], "key_name": "tempest-keypair-805315041", "user_data": "}} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:51:23 user devstack@n-api.service[61253]: DEBUG nova.network.neutron [None req-9984536a-e4eb-4759-970a-5c864c061150 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] validate_networks() for [('17166877-bda4-4d38-864d-f92eab0126b0', None, None, None, None, None)] {{(pid=61253) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 14:51:23 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-c023f5f4-2b96-4a48-a680-e5b991b24674 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2124371401", "imageRef": "283dcfe8-75fd-4917-902e-1b940387187c", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "216f8697-97d3-4233-a3a7-c69d19a2a92e"}], "security_groups": [{"name": "tempest-securitygroup--210959419"}], "key_name": "tempest-keypair-1240204617", "user_data": "}} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:51:23 user devstack@n-api.service[61255]: DEBUG nova.network.neutron [None req-c023f5f4-2b96-4a48-a680-e5b991b24674 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] validate_networks() for [('216f8697-97d3-4233-a3a7-c69d19a2a92e', None, None, None, None, None)] {{(pid=61255) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 14:51:24 user devstack@n-api.service[61255]: DEBUG nova.virt.hardware [None req-c023f5f4-2b96-4a48-a680-e5b991b24674 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Flavor limits 0:0:0 {{(pid=61255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 14:51:24 user devstack@n-api.service[61255]: DEBUG nova.virt.hardware [None req-c023f5f4-2b96-4a48-a680-e5b991b24674 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Image limits 0:0:0 {{(pid=61255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 14:51:24 user devstack@n-api.service[61255]: DEBUG nova.virt.hardware [None req-c023f5f4-2b96-4a48-a680-e5b991b24674 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Flavor pref 0:0:0 {{(pid=61255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 14:51:24 user devstack@n-api.service[61255]: DEBUG nova.virt.hardware [None req-c023f5f4-2b96-4a48-a680-e5b991b24674 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Image pref 0:0:0 {{(pid=61255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 14:51:24 user devstack@n-api.service[61255]: DEBUG nova.virt.hardware [None req-c023f5f4-2b96-4a48-a680-e5b991b24674 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 14:51:24 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-c023f5f4-2b96-4a48-a680-e5b991b24674 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:51:24 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-c023f5f4-2b96-4a48-a680-e5b991b24674 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:51:24 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-c023f5f4-2b96-4a48-a680-e5b991b24674 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:51:24 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-c023f5f4-2b96-4a48-a680-e5b991b24674 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:51:24 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-c023f5f4-2b96-4a48-a680-e5b991b24674 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:51:24 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-c023f5f4-2b96-4a48-a680-e5b991b24674 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:51:24 user devstack@n-api.service[61255]: DEBUG nova.quota [None req-c023f5f4-2b96-4a48-a680-e5b991b24674 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Getting quotas for project 07dbf312f7154ce1ae7fc1403947d51c. Resources: {'ram', 'instances', 'cores'} {{(pid=61255) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:51:24 user devstack@n-api.service[61255]: DEBUG nova.quota [None req-c023f5f4-2b96-4a48-a680-e5b991b24674 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Getting quotas for user 59aab0b2e3424d80852e588323f187bb and project 07dbf312f7154ce1ae7fc1403947d51c. Resources: {'ram', 'instances', 'cores'} {{(pid=61255) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:51:24 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-9984536a-e4eb-4759-970a-5c864c061150 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Flavor limits 0:0:0 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 14:51:24 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-9984536a-e4eb-4759-970a-5c864c061150 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Image limits 0:0:0 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 14:51:24 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-9984536a-e4eb-4759-970a-5c864c061150 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Flavor pref 0:0:0 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 14:51:24 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-9984536a-e4eb-4759-970a-5c864c061150 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Image pref 0:0:0 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 14:51:24 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-9984536a-e4eb-4759-970a-5c864c061150 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 14:51:24 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-c023f5f4-2b96-4a48-a680-e5b991b24674 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Going to run 1 instances... {{(pid=61255) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 14:51:24 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell0:SELECT=17 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:51:24 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-c023f5f4-2b96-4a48-a680-e5b991b24674 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] [instance: 9fee43ad-330a-45d7-9374-07feefcf9e14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='283dcfe8-75fd-4917-902e-1b940387187c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61255) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 14:51:24 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-9984536a-e4eb-4759-970a-5c864c061150 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:51:24 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-9984536a-e4eb-4759-970a-5c864c061150 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:51:24 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-9984536a-e4eb-4759-970a-5c864c061150 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:51:24 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-9984536a-e4eb-4759-970a-5c864c061150 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:51:24 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-9984536a-e4eb-4759-970a-5c864c061150 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:51:24 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-9984536a-e4eb-4759-970a-5c864c061150 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:51:24 user devstack@n-api.service[61253]: DEBUG nova.quota [None req-9984536a-e4eb-4759-970a-5c864c061150 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Getting quotas for project 5383c493e2f049fc9dc06818cb00a6f2. Resources: {'ram', 'instances', 'cores'} {{(pid=61253) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:51:24 user devstack@n-api.service[61253]: DEBUG nova.quota [None req-9984536a-e4eb-4759-970a-5c864c061150 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Getting quotas for user fab5193fb1ec41b8a19e8621843a54a7 and project 5383c493e2f049fc9dc06818cb00a6f2. Resources: {'ram', 'instances', 'cores'} {{(pid=61253) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:51:24 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-9984536a-e4eb-4759-970a-5c864c061150 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Going to run 1 instances... {{(pid=61253) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 14:51:24 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-9984536a-e4eb-4759-970a-5c864c061150 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] [instance: 22962ccc-a7a7-410e-9042-7f01424d38a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='283dcfe8-75fd-4917-902e-1b940387187c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61253) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 14:51:24 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-c023f5f4-2b96-4a48-a680-e5b991b24674 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.975101 Apr 19 14:51:24 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 31/87] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 14:51:23 2023] POST /compute/v2.1/servers => generated 406 bytes in 976 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 14:51:24 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-60123167-4cc2-4b6a-9d8d-5e3543f2f8da tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:51:24 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-60123167-4cc2-4b6a-9d8d-5e3543f2f8da tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] [instance: 9fee43ad-330a-45d7-9374-07feefcf9e14] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:51:24 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-9984536a-e4eb-4759-970a-5c864c061150 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 1.394037 Apr 19 14:51:24 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 29/88] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 14:51:23 2023] POST /compute/v2.1/servers => generated 399 bytes in 1396 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 14:51:24 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-4c8bb478-4eeb-484c-afc5-d30153fb36a4 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:51:24 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-4c8bb478-4eeb-484c-afc5-d30153fb36a4 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] [instance: 22962ccc-a7a7-410e-9042-7f01424d38a6] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:51:24 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-60123167-4cc2-4b6a-9d8d-5e3543f2f8da tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aab0b2e3424d80852e588323f187bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dbf312f7154ce1ae7fc1403947d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:51:24 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-60123167-4cc2-4b6a-9d8d-5e3543f2f8da tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9fee43ad-330a-45d7-9374-07feefcf9e14" status: 200 len: 1233 microversion: 2.1 time: 0.089993 Apr 19 14:51:24 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 29/89] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:51:24 2023] GET /compute/v2.1/servers/9fee43ad-330a-45d7-9374-07feefcf9e14 => generated 1233 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:51:24 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-4c8bb478-4eeb-484c-afc5-d30153fb36a4 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab5193fb1ec41b8a19e8621843a54a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5383c493e2f049fc9dc06818cb00a6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:51:24 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-4c8bb478-4eeb-484c-afc5-d30153fb36a4 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22962ccc-a7a7-410e-9042-7f01424d38a6" status: 200 len: 1228 microversion: 2.1 time: 0.073427 Apr 19 14:51:24 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 32/90] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:51:24 2023] GET /compute/v2.1/servers/22962ccc-a7a7-410e-9042-7f01424d38a6 => generated 1228 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:51:25 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-29f17444-ab13-43d3-8960-887b8be3f2ec tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:51:25 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-29f17444-ab13-43d3-8960-887b8be3f2ec tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] [instance: 95058640-8ace-444b-8e6b-685575695a46] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:51:25 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-29f17444-ab13-43d3-8960-887b8be3f2ec tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:51:25 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-29f17444-ab13-43d3-8960-887b8be3f2ec tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:51:25 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-29f17444-ab13-43d3-8960-887b8be3f2ec tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:51:25 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-29f17444-ab13-43d3-8960-887b8be3f2ec tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:51:25 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-29f17444-ab13-43d3-8960-887b8be3f2ec tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:51:25 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-29f17444-ab13-43d3-8960-887b8be3f2ec tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:51:25 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-867e5c27-51aa-4ed1-9bf5-ceec46bd296b tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1063078936", "imageRef": "283dcfe8-75fd-4917-902e-1b940387187c", "flavorRef": "42", "networks": [{"uuid": "4aae7185-7130-4fb9-a14b-f5e373408ed8"}]}} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:51:25 user devstack@n-api.service[61253]: DEBUG nova.policy [None req-29f17444-ab13-43d3-8960-887b8be3f2ec tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33dd700a9314ab9a70428a3455a571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bc7474b840449da88a8f420316ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61253) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:51:25 user devstack@n-api.service[61253]: DEBUG nova.policy [None req-29f17444-ab13-43d3-8960-887b8be3f2ec tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b33dd700a9314ab9a70428a3455a571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bc7474b840449da88a8f420316ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61253) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:51:25 user devstack@n-api.service[61253]: DEBUG nova.policy [None req-29f17444-ab13-43d3-8960-887b8be3f2ec tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b33dd700a9314ab9a70428a3455a571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bc7474b840449da88a8f420316ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61253) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:51:25 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-29f17444-ab13-43d3-8960-887b8be3f2ec tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95058640-8ace-444b-8e6b-685575695a46" status: 200 len: 1691 microversion: 2.87 time: 0.471831 Apr 19 14:51:25 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 30/91] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 14:51:25 2023] GET /compute/v2.1/servers/95058640-8ace-444b-8e6b-685575695a46 => generated 1691 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 14:51:25 user devstack@n-api.service[61254]: DEBUG nova.network.neutron [None req-867e5c27-51aa-4ed1-9bf5-ceec46bd296b tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] validate_networks() for [('4aae7185-7130-4fb9-a14b-f5e373408ed8', None, None, None, None, None)] {{(pid=61254) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 14:51:26 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-867e5c27-51aa-4ed1-9bf5-ceec46bd296b tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Flavor limits 0:0:0 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 14:51:26 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-867e5c27-51aa-4ed1-9bf5-ceec46bd296b tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Image limits 0:0:0 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 14:51:26 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-867e5c27-51aa-4ed1-9bf5-ceec46bd296b tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Flavor pref 0:0:0 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 14:51:26 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-867e5c27-51aa-4ed1-9bf5-ceec46bd296b tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Image pref 0:0:0 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 14:51:26 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-867e5c27-51aa-4ed1-9bf5-ceec46bd296b tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 14:51:26 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-867e5c27-51aa-4ed1-9bf5-ceec46bd296b tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:51:26 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-867e5c27-51aa-4ed1-9bf5-ceec46bd296b tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:51:26 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-867e5c27-51aa-4ed1-9bf5-ceec46bd296b tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:51:26 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-867e5c27-51aa-4ed1-9bf5-ceec46bd296b tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:51:26 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-867e5c27-51aa-4ed1-9bf5-ceec46bd296b tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:51:26 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-867e5c27-51aa-4ed1-9bf5-ceec46bd296b tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:51:26 user devstack@n-api.service[61254]: DEBUG nova.quota [None req-867e5c27-51aa-4ed1-9bf5-ceec46bd296b tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Getting quotas for project 14492681eaac49e89054c4fe63074b53. Resources: {'ram', 'instances', 'cores'} {{(pid=61254) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:51:26 user devstack@n-api.service[61254]: DEBUG nova.quota [None req-867e5c27-51aa-4ed1-9bf5-ceec46bd296b tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Getting quotas for user 5e93c83b829546fbb633032cca416a31 and project 14492681eaac49e89054c4fe63074b53. Resources: {'ram', 'instances', 'cores'} {{(pid=61254) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:51:26 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-867e5c27-51aa-4ed1-9bf5-ceec46bd296b tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Going to run 1 instances... {{(pid=61254) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 14:51:26 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-867e5c27-51aa-4ed1-9bf5-ceec46bd296b tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] [instance: 104344aa-6bec-467b-b519-a2bb1b0b89f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='283dcfe8-75fd-4917-902e-1b940387187c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61254) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 14:51:27 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-867e5c27-51aa-4ed1-9bf5-ceec46bd296b tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.658243 Apr 19 14:51:27 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 30/92] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 14:51:25 2023] POST /compute/v2.1/servers => generated 378 bytes in 1660 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 14:51:27 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-7f41b060-2f14-4e09-ae93-155c38813c3a tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:51:27 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-7f41b060-2f14-4e09-ae93-155c38813c3a tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] [instance: 104344aa-6bec-467b-b519-a2bb1b0b89f8] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:51:27 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-7f41b060-2f14-4e09-ae93-155c38813c3a tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e93c83b829546fbb633032cca416a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14492681eaac49e89054c4fe63074b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:51:27 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-7f41b060-2f14-4e09-ae93-155c38813c3a tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] 10.0.0.210 "GET /compute/v2.1/servers/104344aa-6bec-467b-b519-a2bb1b0b89f8" status: 200 len: 1208 microversion: 2.1 time: 0.153015 Apr 19 14:51:27 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 33/93] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:51:27 2023] GET /compute/v2.1/servers/104344aa-6bec-467b-b519-a2bb1b0b89f8 => generated 1208 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 14:51:28 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [req-ed121ff5-0965-4db8-9dd9-08c62b7fb9ec req-2360e6e5-5ec2-458e-b534-6eaa52f899b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22962ccc-a7a7-410e-9042-7f01424d38a6", "tag": "128b1957-c496-4f3c-a3d6-291d27873173"}]} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:51:28 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-ed121ff5-0965-4db8-9dd9-08c62b7fb9ec req-2360e6e5-5ec2-458e-b534-6eaa52f899b3 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:51:28 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-ed121ff5-0965-4db8-9dd9-08c62b7fb9ec req-2360e6e5-5ec2-458e-b534-6eaa52f899b3 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:51:28 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-ed121ff5-0965-4db8-9dd9-08c62b7fb9ec req-2360e6e5-5ec2-458e-b534-6eaa52f899b3 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:51:28 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-ed121ff5-0965-4db8-9dd9-08c62b7fb9ec req-2360e6e5-5ec2-458e-b534-6eaa52f899b3 service nova] Creating event network-changed:128b1957-c496-4f3c-a3d6-291d27873173 for instance 22962ccc-a7a7-410e-9042-7f01424d38a6 on user Apr 19 14:51:28 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [req-ed121ff5-0965-4db8-9dd9-08c62b7fb9ec req-2360e6e5-5ec2-458e-b534-6eaa52f899b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047265 Apr 19 14:51:28 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 31/94] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:51:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 14:51:29 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [req-b405c3b0-1fa9-42ee-93fc-666c188d5198 req-d2db6728-722c-47ca-aaf8-1ba53752cb52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "104344aa-6bec-467b-b519-a2bb1b0b89f8", "tag": "3f361385-c381-4731-85a8-4a131c868d65"}]} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:51:29 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-b405c3b0-1fa9-42ee-93fc-666c188d5198 req-d2db6728-722c-47ca-aaf8-1ba53752cb52 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:51:29 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-b405c3b0-1fa9-42ee-93fc-666c188d5198 req-d2db6728-722c-47ca-aaf8-1ba53752cb52 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:51:29 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-b405c3b0-1fa9-42ee-93fc-666c188d5198 req-d2db6728-722c-47ca-aaf8-1ba53752cb52 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:51:29 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-b405c3b0-1fa9-42ee-93fc-666c188d5198 req-d2db6728-722c-47ca-aaf8-1ba53752cb52 service nova] Creating event network-changed:3f361385-c381-4731-85a8-4a131c868d65 for instance 104344aa-6bec-467b-b519-a2bb1b0b89f8 on user Apr 19 14:51:29 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [req-b405c3b0-1fa9-42ee-93fc-666c188d5198 req-d2db6728-722c-47ca-aaf8-1ba53752cb52 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033314 Apr 19 14:51:29 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 31/95] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:51:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:51:30 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-249565ca-feb7-453f-8722-89af52b6ccc8 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:51:30 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-249565ca-feb7-453f-8722-89af52b6ccc8 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] [instance: 04ea16ad-a0eb-4187-a966-7ec4f2396852] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:51:30 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-249565ca-feb7-453f-8722-89af52b6ccc8 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:51:30 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-249565ca-feb7-453f-8722-89af52b6ccc8 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:51:30 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-249565ca-feb7-453f-8722-89af52b6ccc8 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:51:30 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-249565ca-feb7-453f-8722-89af52b6ccc8 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:51:30 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-249565ca-feb7-453f-8722-89af52b6ccc8 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:51:30 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-249565ca-feb7-453f-8722-89af52b6ccc8 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:51:30 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [req-3f180a70-4c5c-47cc-b10b-298750d69626 req-92e9b148-b9fb-411a-8909-1c4b2247f63c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fee43ad-330a-45d7-9374-07feefcf9e14", "tag": "08e83784-97d8-4c35-a28e-ab60d1724994"}]} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:51:30 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-3f180a70-4c5c-47cc-b10b-298750d69626 req-92e9b148-b9fb-411a-8909-1c4b2247f63c service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:51:30 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-3f180a70-4c5c-47cc-b10b-298750d69626 req-92e9b148-b9fb-411a-8909-1c4b2247f63c service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:51:30 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-3f180a70-4c5c-47cc-b10b-298750d69626 req-92e9b148-b9fb-411a-8909-1c4b2247f63c service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:51:30 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-3f180a70-4c5c-47cc-b10b-298750d69626 req-92e9b148-b9fb-411a-8909-1c4b2247f63c service nova] Creating event network-changed:08e83784-97d8-4c35-a28e-ab60d1724994 for instance 9fee43ad-330a-45d7-9374-07feefcf9e14 on user Apr 19 14:51:30 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [req-3f180a70-4c5c-47cc-b10b-298750d69626 req-92e9b148-b9fb-411a-8909-1c4b2247f63c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032859 Apr 19 14:51:30 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 32/96] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:51:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:51:31 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-249565ca-feb7-453f-8722-89af52b6ccc8 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b888ae3c3540df8cf7953ed5ed90d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de5e8e3b3394f219c8af4b834c85631', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:51:31 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-249565ca-feb7-453f-8722-89af52b6ccc8 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04ea16ad-a0eb-4187-a966-7ec4f2396852" status: 200 len: 1553 microversion: 2.1 time: 0.635746 Apr 19 14:51:31 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 34/97] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:51:30 2023] GET /compute/v2.1/servers/04ea16ad-a0eb-4187-a966-7ec4f2396852 => generated 1553 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:51:31 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [req-a2a096ef-af94-4dee-a021-1830161a506c req-3ed520ba-f230-4384-9503-adcde842967d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22962ccc-a7a7-410e-9042-7f01424d38a6", "name": "network-vif-plugged", "status": "completed", "tag": "128b1957-c496-4f3c-a3d6-291d27873173"}, {"server_uuid": "22962ccc-a7a7-410e-9042-7f01424d38a6", "name": "network-vif-plugged", "status": "completed", "tag": "128b1957-c496-4f3c-a3d6-291d27873173"}]} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:51:31 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-a2a096ef-af94-4dee-a021-1830161a506c req-3ed520ba-f230-4384-9503-adcde842967d service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:51:31 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-a2a096ef-af94-4dee-a021-1830161a506c req-3ed520ba-f230-4384-9503-adcde842967d service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:51:31 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-a2a096ef-af94-4dee-a021-1830161a506c req-3ed520ba-f230-4384-9503-adcde842967d service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:51:32 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-a2a096ef-af94-4dee-a021-1830161a506c req-3ed520ba-f230-4384-9503-adcde842967d service nova] Creating event network-vif-plugged:128b1957-c496-4f3c-a3d6-291d27873173 for instance 22962ccc-a7a7-410e-9042-7f01424d38a6 on user Apr 19 14:51:32 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-a2a096ef-af94-4dee-a021-1830161a506c req-3ed520ba-f230-4384-9503-adcde842967d service nova] Creating event network-vif-plugged:128b1957-c496-4f3c-a3d6-291d27873173 for instance 22962ccc-a7a7-410e-9042-7f01424d38a6 on user Apr 19 14:51:32 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [req-a2a096ef-af94-4dee-a021-1830161a506c req-3ed520ba-f230-4384-9503-adcde842967d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032255 Apr 19 14:51:32 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 32/98] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:51:31 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:51:33 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [req-fd8a63df-47b4-4a9f-8c70-53fddfbc80b8 req-9faea19f-aec8-4b71-a794-73cbf572a3be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "104344aa-6bec-467b-b519-a2bb1b0b89f8", "name": "network-vif-plugged", "status": "completed", "tag": "3f361385-c381-4731-85a8-4a131c868d65"}]} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:51:33 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=8 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:51:33 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-fd8a63df-47b4-4a9f-8c70-53fddfbc80b8 req-9faea19f-aec8-4b71-a794-73cbf572a3be service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:51:33 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-fd8a63df-47b4-4a9f-8c70-53fddfbc80b8 req-9faea19f-aec8-4b71-a794-73cbf572a3be service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:51:33 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-fd8a63df-47b4-4a9f-8c70-53fddfbc80b8 req-9faea19f-aec8-4b71-a794-73cbf572a3be service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:51:33 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-fd8a63df-47b4-4a9f-8c70-53fddfbc80b8 req-9faea19f-aec8-4b71-a794-73cbf572a3be service nova] Creating event network-vif-plugged:3f361385-c381-4731-85a8-4a131c868d65 for instance 104344aa-6bec-467b-b519-a2bb1b0b89f8 on user Apr 19 14:51:33 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [req-fd8a63df-47b4-4a9f-8c70-53fddfbc80b8 req-9faea19f-aec8-4b71-a794-73cbf572a3be service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029569 Apr 19 14:51:33 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 33/99] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:51:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:51:33 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-cef12b9b-9e7e-4dcb-a243-b629780d3944 req-723619d9-dfdc-4564-8407-ae980b384922 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fee43ad-330a-45d7-9374-07feefcf9e14", "name": "network-vif-plugged", "status": "completed", "tag": "08e83784-97d8-4c35-a28e-ab60d1724994"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:51:33 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=4 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:51:33 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-cef12b9b-9e7e-4dcb-a243-b629780d3944 req-723619d9-dfdc-4564-8407-ae980b384922 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:51:33 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-cef12b9b-9e7e-4dcb-a243-b629780d3944 req-723619d9-dfdc-4564-8407-ae980b384922 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:51:33 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-cef12b9b-9e7e-4dcb-a243-b629780d3944 req-723619d9-dfdc-4564-8407-ae980b384922 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:51:33 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell1:SELECT=15 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:51:33 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-cef12b9b-9e7e-4dcb-a243-b629780d3944 req-723619d9-dfdc-4564-8407-ae980b384922 service nova] Creating event network-vif-plugged:08e83784-97d8-4c35-a28e-ab60d1724994 for instance 9fee43ad-330a-45d7-9374-07feefcf9e14 on user Apr 19 14:51:33 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [req-cef12b9b-9e7e-4dcb-a243-b629780d3944 req-723619d9-dfdc-4564-8407-ae980b384922 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033281 Apr 19 14:51:33 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 35/100] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:51:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:51:35 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [req-1d9d1edc-4ddc-4b5b-b19b-53562a111feb req-18898358-1fc5-4ebc-9a6a-7095ac039288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "104344aa-6bec-467b-b519-a2bb1b0b89f8", "name": "network-vif-plugged", "status": "completed", "tag": "3f361385-c381-4731-85a8-4a131c868d65"}]} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:51:35 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:51:35 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-1d9d1edc-4ddc-4b5b-b19b-53562a111feb req-18898358-1fc5-4ebc-9a6a-7095ac039288 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:51:35 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-1d9d1edc-4ddc-4b5b-b19b-53562a111feb req-18898358-1fc5-4ebc-9a6a-7095ac039288 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:51:35 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-1d9d1edc-4ddc-4b5b-b19b-53562a111feb req-18898358-1fc5-4ebc-9a6a-7095ac039288 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:51:35 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell1:SELECT=19 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:51:35 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-1d9d1edc-4ddc-4b5b-b19b-53562a111feb req-18898358-1fc5-4ebc-9a6a-7095ac039288 service nova] Creating event network-vif-plugged:3f361385-c381-4731-85a8-4a131c868d65 for instance 104344aa-6bec-467b-b519-a2bb1b0b89f8 on user Apr 19 14:51:35 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [req-1d9d1edc-4ddc-4b5b-b19b-53562a111feb req-18898358-1fc5-4ebc-9a6a-7095ac039288 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031552 Apr 19 14:51:35 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 33/101] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:51:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:51:35 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell0:SELECT=2 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:51:35 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell0:SELECT=5 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:51:35 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [req-0b95079f-6008-41e1-aac3-9221cf90c12b req-c36b748c-8667-4f73-a492-119bd3d60d98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fee43ad-330a-45d7-9374-07feefcf9e14", "name": "network-vif-plugged", "status": "completed", "tag": "08e83784-97d8-4c35-a28e-ab60d1724994"}]} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:51:35 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-0b95079f-6008-41e1-aac3-9221cf90c12b req-c36b748c-8667-4f73-a492-119bd3d60d98 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:51:35 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-0b95079f-6008-41e1-aac3-9221cf90c12b req-c36b748c-8667-4f73-a492-119bd3d60d98 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:51:35 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-0b95079f-6008-41e1-aac3-9221cf90c12b req-c36b748c-8667-4f73-a492-119bd3d60d98 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:51:35 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-0b95079f-6008-41e1-aac3-9221cf90c12b req-c36b748c-8667-4f73-a492-119bd3d60d98 service nova] Creating event network-vif-plugged:08e83784-97d8-4c35-a28e-ab60d1724994 for instance 9fee43ad-330a-45d7-9374-07feefcf9e14 on user Apr 19 14:51:35 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [req-0b95079f-6008-41e1-aac3-9221cf90c12b req-c36b748c-8667-4f73-a492-119bd3d60d98 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035222 Apr 19 14:51:35 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 34/102] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:51:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:51:53 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell0:SELECT=2 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:51:53 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell0:SELECT=14 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:51:53 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-26e23f24-57aa-4995-a4f5-2bb385281e06 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:51:53 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-26e23f24-57aa-4995-a4f5-2bb385281e06 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] [instance: d5629772-08a7-4edb-acd5-4d92d8dbc48b] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:51:53 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-26e23f24-57aa-4995-a4f5-2bb385281e06 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:51:53 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-26e23f24-57aa-4995-a4f5-2bb385281e06 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:51:53 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-26e23f24-57aa-4995-a4f5-2bb385281e06 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:51:53 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-26e23f24-57aa-4995-a4f5-2bb385281e06 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:51:53 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-26e23f24-57aa-4995-a4f5-2bb385281e06 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:51:53 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-26e23f24-57aa-4995-a4f5-2bb385281e06 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:51:53 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-26e23f24-57aa-4995-a4f5-2bb385281e06 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f959bfd4235e48b89b84317f32887eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e931bbf53a24ad385fd4480c6e34c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:51:53 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-26e23f24-57aa-4995-a4f5-2bb385281e06 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d5629772-08a7-4edb-acd5-4d92d8dbc48b" status: 200 len: 1548 microversion: 2.1 time: 0.236469 Apr 19 14:51:53 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 36/103] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:51:53 2023] GET /compute/v2.1/servers/d5629772-08a7-4edb-acd5-4d92d8dbc48b => generated 1548 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 14:51:55 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell0:SELECT=2 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:51:55 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell0:SELECT=8 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:51:55 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-ca6435ed-760b-4d5b-9f0e-5e3cbec63a87 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:51:55 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-ca6435ed-760b-4d5b-9f0e-5e3cbec63a87 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] [instance: a499484d-dfca-44f4-9ab0-ecabbf88f06d] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:51:55 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-ca6435ed-760b-4d5b-9f0e-5e3cbec63a87 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:51:55 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-ca6435ed-760b-4d5b-9f0e-5e3cbec63a87 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:51:55 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-ca6435ed-760b-4d5b-9f0e-5e3cbec63a87 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:51:55 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-ca6435ed-760b-4d5b-9f0e-5e3cbec63a87 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:51:55 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-ca6435ed-760b-4d5b-9f0e-5e3cbec63a87 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:51:55 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-ca6435ed-760b-4d5b-9f0e-5e3cbec63a87 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:51:56 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-ca6435ed-760b-4d5b-9f0e-5e3cbec63a87 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708068c5f6f5451fbcd6c24235a185d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da86be1a28254582b530973fbf7f724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:51:56 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-ca6435ed-760b-4d5b-9f0e-5e3cbec63a87 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a499484d-dfca-44f4-9ab0-ecabbf88f06d" status: 200 len: 1545 microversion: 2.1 time: 0.217353 Apr 19 14:51:56 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 34/104] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:51:55 2023] GET /compute/v2.1/servers/a499484d-dfca-44f4-9ab0-ecabbf88f06d => generated 1545 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:52:14 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_api:SELECT=3 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:52:14 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell1:SELECT=16 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:52:14 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-3590185d-1774-47c6-a304-1f4c499701e8 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:52:14 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-a43a0cd4-e401-46c6-be3a-8c94354852b4 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:52:14 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-3590185d-1774-47c6-a304-1f4c499701e8 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] [instance: 9fee43ad-330a-45d7-9374-07feefcf9e14] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:52:14 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-a43a0cd4-e401-46c6-be3a-8c94354852b4 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] [instance: 22962ccc-a7a7-410e-9042-7f01424d38a6] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:52:14 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_api:SELECT=3 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:52:14 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell1:SELECT=7 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:52:14 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-a43a0cd4-e401-46c6-be3a-8c94354852b4 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:52:14 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-a43a0cd4-e401-46c6-be3a-8c94354852b4 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:52:14 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-a43a0cd4-e401-46c6-be3a-8c94354852b4 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:52:14 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-a43a0cd4-e401-46c6-be3a-8c94354852b4 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:52:14 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-a43a0cd4-e401-46c6-be3a-8c94354852b4 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:52:14 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-3590185d-1774-47c6-a304-1f4c499701e8 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:52:14 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-a43a0cd4-e401-46c6-be3a-8c94354852b4 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:52:14 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-3590185d-1774-47c6-a304-1f4c499701e8 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:52:14 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-3590185d-1774-47c6-a304-1f4c499701e8 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:52:14 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-3590185d-1774-47c6-a304-1f4c499701e8 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:52:14 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-3590185d-1774-47c6-a304-1f4c499701e8 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:52:14 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-3590185d-1774-47c6-a304-1f4c499701e8 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:52:14 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-3590185d-1774-47c6-a304-1f4c499701e8 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aab0b2e3424d80852e588323f187bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dbf312f7154ce1ae7fc1403947d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:52:14 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-3590185d-1774-47c6-a304-1f4c499701e8 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9fee43ad-330a-45d7-9374-07feefcf9e14" status: 200 len: 1539 microversion: 2.1 time: 0.251747 Apr 19 14:52:14 user devstack@n-api.service[61253]: DEBUG nova.policy [None req-a43a0cd4-e401-46c6-be3a-8c94354852b4 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab5193fb1ec41b8a19e8621843a54a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5383c493e2f049fc9dc06818cb00a6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61253) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:52:14 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 37/105] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:52:14 2023] GET /compute/v2.1/servers/9fee43ad-330a-45d7-9374-07feefcf9e14 => generated 1539 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:52:14 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-a43a0cd4-e401-46c6-be3a-8c94354852b4 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22962ccc-a7a7-410e-9042-7f01424d38a6" status: 200 len: 1533 microversion: 2.1 time: 0.262921 Apr 19 14:52:14 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 35/106] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:52:14 2023] GET /compute/v2.1/servers/22962ccc-a7a7-410e-9042-7f01424d38a6 => generated 1533 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:52:17 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-087ba3ca-6e3f-4a6a-94fb-07efe8e96ecc tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:52:17 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-087ba3ca-6e3f-4a6a-94fb-07efe8e96ecc tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] [instance: 104344aa-6bec-467b-b519-a2bb1b0b89f8] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:52:17 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_api:SELECT=3 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:52:17 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell1:SELECT=7 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:52:17 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-087ba3ca-6e3f-4a6a-94fb-07efe8e96ecc tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:52:17 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-087ba3ca-6e3f-4a6a-94fb-07efe8e96ecc tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:52:17 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-087ba3ca-6e3f-4a6a-94fb-07efe8e96ecc tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:52:17 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-087ba3ca-6e3f-4a6a-94fb-07efe8e96ecc tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:52:17 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-087ba3ca-6e3f-4a6a-94fb-07efe8e96ecc tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:52:17 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-087ba3ca-6e3f-4a6a-94fb-07efe8e96ecc tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:52:17 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-087ba3ca-6e3f-4a6a-94fb-07efe8e96ecc tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e93c83b829546fbb633032cca416a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14492681eaac49e89054c4fe63074b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:52:17 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-087ba3ca-6e3f-4a6a-94fb-07efe8e96ecc tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] 10.0.0.210 "GET /compute/v2.1/servers/104344aa-6bec-467b-b519-a2bb1b0b89f8" status: 200 len: 1485 microversion: 2.1 time: 0.211446 Apr 19 14:52:17 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 35/107] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:52:17 2023] GET /compute/v2.1/servers/104344aa-6bec-467b-b519-a2bb1b0b89f8 => generated 1485 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:52:23 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-28a089cd-cf93-400a-bf8c-2506e5c59d78 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:52:23 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-28a089cd-cf93-400a-bf8c-2506e5c59d78 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] [instance: 84619c4f-a014-4044-bdf8-a2c30eb11a18] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:52:23 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-28a089cd-cf93-400a-bf8c-2506e5c59d78 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:52:23 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-28a089cd-cf93-400a-bf8c-2506e5c59d78 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:52:23 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-28a089cd-cf93-400a-bf8c-2506e5c59d78 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:52:23 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-28a089cd-cf93-400a-bf8c-2506e5c59d78 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:52:23 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-28a089cd-cf93-400a-bf8c-2506e5c59d78 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:52:23 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-28a089cd-cf93-400a-bf8c-2506e5c59d78 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:52:23 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-28a089cd-cf93-400a-bf8c-2506e5c59d78 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] [instance: 84619c4f-a014-4044-bdf8-a2c30eb11a18] Going to try to terminate instance {{(pid=61255) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 14:52:23 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-28a089cd-cf93-400a-bf8c-2506e5c59d78 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/84619c4f-a014-4044-bdf8-a2c30eb11a18" status: 204 len: 0 microversion: 2.1 time: 0.157014 Apr 19 14:52:23 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 38/108] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 14:52:23 2023] DELETE /compute/v2.1/servers/84619c4f-a014-4044-bdf8-a2c30eb11a18 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 14:52:23 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-16d11752-7424-4ba1-9386-dbef99108676 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:52:23 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-16d11752-7424-4ba1-9386-dbef99108676 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] [instance: 84619c4f-a014-4044-bdf8-a2c30eb11a18] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:52:23 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-16d11752-7424-4ba1-9386-dbef99108676 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:52:23 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-16d11752-7424-4ba1-9386-dbef99108676 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:52:23 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-16d11752-7424-4ba1-9386-dbef99108676 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:52:23 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-16d11752-7424-4ba1-9386-dbef99108676 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:52:23 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-16d11752-7424-4ba1-9386-dbef99108676 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:52:23 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-16d11752-7424-4ba1-9386-dbef99108676 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:52:23 user devstack@n-api.service[61253]: DEBUG nova.policy [None req-16d11752-7424-4ba1-9386-dbef99108676 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c59859626174f24b37a68077e322051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea8cf58226424348afa3db7ce42833f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61253) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:52:23 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-16d11752-7424-4ba1-9386-dbef99108676 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84619c4f-a014-4044-bdf8-a2c30eb11a18" status: 200 len: 1496 microversion: 2.1 time: 0.414495 Apr 19 14:52:23 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 36/109] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:52:23 2023] GET /compute/v2.1/servers/84619c4f-a014-4044-bdf8-a2c30eb11a18 => generated 1496 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:52:23 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [req-551e8101-564f-488e-bda1-c3fd27ef6a26 req-02dfd74d-2755-4f2b-b897-11cb9da437d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84619c4f-a014-4044-bdf8-a2c30eb11a18", "name": "network-vif-unplugged", "status": "completed", "tag": "b3375dfe-c516-4cbd-a65a-b5d5568fe554"}]} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:52:23 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-551e8101-564f-488e-bda1-c3fd27ef6a26 req-02dfd74d-2755-4f2b-b897-11cb9da437d8 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:52:23 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-551e8101-564f-488e-bda1-c3fd27ef6a26 req-02dfd74d-2755-4f2b-b897-11cb9da437d8 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:52:23 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-551e8101-564f-488e-bda1-c3fd27ef6a26 req-02dfd74d-2755-4f2b-b897-11cb9da437d8 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:52:23 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-551e8101-564f-488e-bda1-c3fd27ef6a26 req-02dfd74d-2755-4f2b-b897-11cb9da437d8 service nova] Creating event network-vif-unplugged:b3375dfe-c516-4cbd-a65a-b5d5568fe554 for instance 84619c4f-a014-4044-bdf8-a2c30eb11a18 on user Apr 19 14:52:23 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [req-551e8101-564f-488e-bda1-c3fd27ef6a26 req-02dfd74d-2755-4f2b-b897-11cb9da437d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027944 Apr 19 14:52:23 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 36/110] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:52:23 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:52:24 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-da282da6-8b6d-46cc-8123-83438495afa1 req-f47421b5-1859-4eee-8b93-2e373d2a46a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84619c4f-a014-4044-bdf8-a2c30eb11a18", "name": "network-vif-deleted", "tag": "b3375dfe-c516-4cbd-a65a-b5d5568fe554"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:52:24 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-da282da6-8b6d-46cc-8123-83438495afa1 req-f47421b5-1859-4eee-8b93-2e373d2a46a8 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:52:24 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-da282da6-8b6d-46cc-8123-83438495afa1 req-f47421b5-1859-4eee-8b93-2e373d2a46a8 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:52:24 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-da282da6-8b6d-46cc-8123-83438495afa1 req-f47421b5-1859-4eee-8b93-2e373d2a46a8 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:52:24 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-da282da6-8b6d-46cc-8123-83438495afa1 req-f47421b5-1859-4eee-8b93-2e373d2a46a8 service nova] Creating event network-vif-deleted:b3375dfe-c516-4cbd-a65a-b5d5568fe554 for instance 84619c4f-a014-4044-bdf8-a2c30eb11a18 on user Apr 19 14:52:24 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [req-da282da6-8b6d-46cc-8123-83438495afa1 req-f47421b5-1859-4eee-8b93-2e373d2a46a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028649 Apr 19 14:52:24 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 39/111] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:52:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:52:25 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-e0768ead-192a-47e4-9be9-a552dd92161a tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1887541478"}} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:52:25 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-e0768ead-192a-47e4-9be9-a552dd92161a tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] [instance: 95058640-8ace-444b-8e6b-685575695a46] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:52:25 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-e0768ead-192a-47e4-9be9-a552dd92161a tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:52:25 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-e0768ead-192a-47e4-9be9-a552dd92161a tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:52:25 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-e0768ead-192a-47e4-9be9-a552dd92161a tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:52:25 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-e0768ead-192a-47e4-9be9-a552dd92161a tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:52:25 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-e0768ead-192a-47e4-9be9-a552dd92161a tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:52:25 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-e0768ead-192a-47e4-9be9-a552dd92161a tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:52:25 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [req-ec31d19b-038c-4534-be00-7e5aa2ca13d4 req-d3f78be6-0afa-49f1-9982-dc64448e810f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84619c4f-a014-4044-bdf8-a2c30eb11a18", "name": "network-vif-plugged", "status": "completed", "tag": "b3375dfe-c516-4cbd-a65a-b5d5568fe554"}]} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:52:25 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-ec31d19b-038c-4534-be00-7e5aa2ca13d4 req-d3f78be6-0afa-49f1-9982-dc64448e810f service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:52:25 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-ec31d19b-038c-4534-be00-7e5aa2ca13d4 req-d3f78be6-0afa-49f1-9982-dc64448e810f service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:52:25 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-ec31d19b-038c-4534-be00-7e5aa2ca13d4 req-d3f78be6-0afa-49f1-9982-dc64448e810f service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:52:25 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-ec31d19b-038c-4534-be00-7e5aa2ca13d4 req-d3f78be6-0afa-49f1-9982-dc64448e810f service nova] Creating event network-vif-plugged:b3375dfe-c516-4cbd-a65a-b5d5568fe554 for instance 84619c4f-a014-4044-bdf8-a2c30eb11a18 on user Apr 19 14:52:25 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [req-ec31d19b-038c-4534-be00-7e5aa2ca13d4 req-d3f78be6-0afa-49f1-9982-dc64448e810f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033010 Apr 19 14:52:25 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 37/112] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:52:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:52:26 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-e0768ead-192a-47e4-9be9-a552dd92161a tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] 10.0.0.210 "POST /compute/v2.1/servers/95058640-8ace-444b-8e6b-685575695a46/action" status: 202 len: 52 microversion: 2.87 time: 0.950496 Apr 19 14:52:26 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 37/113] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 19 14:52:25 2023] POST /compute/v2.1/servers/95058640-8ace-444b-8e6b-685575695a46/action => generated 52 bytes in 952 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 19 14:52:31 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-75c7b757-e8e3-4e08-a475-c9cf1f235a86 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:52:31 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-75c7b757-e8e3-4e08-a475-c9cf1f235a86 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] [instance: 04ea16ad-a0eb-4187-a966-7ec4f2396852] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:52:31 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-75c7b757-e8e3-4e08-a475-c9cf1f235a86 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:52:31 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-75c7b757-e8e3-4e08-a475-c9cf1f235a86 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:52:31 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-75c7b757-e8e3-4e08-a475-c9cf1f235a86 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:52:31 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-75c7b757-e8e3-4e08-a475-c9cf1f235a86 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:52:31 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-75c7b757-e8e3-4e08-a475-c9cf1f235a86 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:52:31 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-75c7b757-e8e3-4e08-a475-c9cf1f235a86 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:52:31 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-75c7b757-e8e3-4e08-a475-c9cf1f235a86 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04ea16ad-a0eb-4187-a966-7ec4f2396852/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.165568 Apr 19 14:52:31 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 40/114] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 14:52:31 2023] GET /compute/v2.1/servers/04ea16ad-a0eb-4187-a966-7ec4f2396852/os-interface => generated 283 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:52:31 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-f0a8559f-7df5-4c8a-b56e-0a041ce6156d tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:52:31 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-f0a8559f-7df5-4c8a-b56e-0a041ce6156d tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] [instance: 95058640-8ace-444b-8e6b-685575695a46] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:52:31 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-f0a8559f-7df5-4c8a-b56e-0a041ce6156d tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:52:31 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-f0a8559f-7df5-4c8a-b56e-0a041ce6156d tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:52:31 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-f0a8559f-7df5-4c8a-b56e-0a041ce6156d tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:52:31 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-f0a8559f-7df5-4c8a-b56e-0a041ce6156d tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:52:31 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-f0a8559f-7df5-4c8a-b56e-0a041ce6156d tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:52:31 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-f0a8559f-7df5-4c8a-b56e-0a041ce6156d tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:52:32 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-f0a8559f-7df5-4c8a-b56e-0a041ce6156d tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33dd700a9314ab9a70428a3455a571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bc7474b840449da88a8f420316ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:52:32 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-f0a8559f-7df5-4c8a-b56e-0a041ce6156d tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b33dd700a9314ab9a70428a3455a571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bc7474b840449da88a8f420316ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:52:32 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-f0a8559f-7df5-4c8a-b56e-0a041ce6156d tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b33dd700a9314ab9a70428a3455a571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bc7474b840449da88a8f420316ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:52:32 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-f0a8559f-7df5-4c8a-b56e-0a041ce6156d tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95058640-8ace-444b-8e6b-685575695a46" status: 200 len: 1691 microversion: 2.87 time: 0.588325 Apr 19 14:52:32 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 38/115] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 14:52:31 2023] GET /compute/v2.1/servers/95058640-8ace-444b-8e6b-685575695a46 => generated 1691 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 14:52:32 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [req-c67c0ca2-ad3f-49ba-b86c-2e29ea881edd req-1d0ea1da-f8ef-47ad-a070-f35385cd6663 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04ea16ad-a0eb-4187-a966-7ec4f2396852", "tag": "17cc0520-8e21-4a1d-80b2-3520c4a13a61"}]} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:52:32 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-c67c0ca2-ad3f-49ba-b86c-2e29ea881edd req-1d0ea1da-f8ef-47ad-a070-f35385cd6663 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:52:32 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-c67c0ca2-ad3f-49ba-b86c-2e29ea881edd req-1d0ea1da-f8ef-47ad-a070-f35385cd6663 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:52:32 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-c67c0ca2-ad3f-49ba-b86c-2e29ea881edd req-1d0ea1da-f8ef-47ad-a070-f35385cd6663 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:52:32 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-c67c0ca2-ad3f-49ba-b86c-2e29ea881edd req-1d0ea1da-f8ef-47ad-a070-f35385cd6663 service nova] Creating event network-changed:17cc0520-8e21-4a1d-80b2-3520c4a13a61 for instance 04ea16ad-a0eb-4187-a966-7ec4f2396852 on user Apr 19 14:52:32 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [req-c67c0ca2-ad3f-49ba-b86c-2e29ea881edd req-1d0ea1da-f8ef-47ad-a070-f35385cd6663 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037871 Apr 19 14:52:32 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 38/116] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:52:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:52:32 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-64f61b55-fe84-4367-9a39-3100f88d69d3 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-383661510"}} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:52:32 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-64f61b55-fe84-4367-9a39-3100f88d69d3 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] [instance: 04ea16ad-a0eb-4187-a966-7ec4f2396852] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:52:32 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-64f61b55-fe84-4367-9a39-3100f88d69d3 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:52:32 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-64f61b55-fe84-4367-9a39-3100f88d69d3 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:52:32 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-64f61b55-fe84-4367-9a39-3100f88d69d3 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:52:32 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-64f61b55-fe84-4367-9a39-3100f88d69d3 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:52:32 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-64f61b55-fe84-4367-9a39-3100f88d69d3 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:52:32 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-64f61b55-fe84-4367-9a39-3100f88d69d3 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:52:33 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-64f61b55-fe84-4367-9a39-3100f88d69d3 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] 10.0.0.210 "POST /compute/v2.1/servers/04ea16ad-a0eb-4187-a966-7ec4f2396852/action" status: 202 len: 0 microversion: 2.1 time: 1.092133 Apr 19 14:52:33 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 41/117] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 19 14:52:32 2023] POST /compute/v2.1/servers/04ea16ad-a0eb-4187-a966-7ec4f2396852/action => generated 0 bytes in 1094 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 19 14:52:33 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-ad801374-5513-4b94-95a7-fb1d4bf2a757 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Calling method '.version_select at 0x7f3cfab4e7a0>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:52:33 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-ad801374-5513-4b94-95a7-fb1d4bf2a757 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] 10.0.0.210 "GET /compute/v2.1/images/02388b55-5cf8-4f6f-a47d-89b8a8cb305b" status: 200 len: 1610 microversion: 2.1 time: 0.050452 Apr 19 14:52:33 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 39/118] 10.0.0.210 () {62 vars in 1310 bytes} [Wed Apr 19 14:52:33 2023] GET /compute/v2.1/images/02388b55-5cf8-4f6f-a47d-89b8a8cb305b => generated 1610 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:52:53 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_api:SELECT=8 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:52:53 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:52:53 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-0b0bf10d-baf3-4384-aae8-dc39f7ca15c3 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:52:53 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-0b0bf10d-baf3-4384-aae8-dc39f7ca15c3 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] [instance: d5629772-08a7-4edb-acd5-4d92d8dbc48b] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:52:53 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-0b0bf10d-baf3-4384-aae8-dc39f7ca15c3 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:52:53 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-0b0bf10d-baf3-4384-aae8-dc39f7ca15c3 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:52:53 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-0b0bf10d-baf3-4384-aae8-dc39f7ca15c3 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:52:53 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-0b0bf10d-baf3-4384-aae8-dc39f7ca15c3 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:52:53 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-0b0bf10d-baf3-4384-aae8-dc39f7ca15c3 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:52:53 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-0b0bf10d-baf3-4384-aae8-dc39f7ca15c3 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:52:54 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-0b0bf10d-baf3-4384-aae8-dc39f7ca15c3 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d5629772-08a7-4edb-acd5-4d92d8dbc48b/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.286761 Apr 19 14:52:54 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 39/119] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 14:52:53 2023] GET /compute/v2.1/servers/d5629772-08a7-4edb-acd5-4d92d8dbc48b/os-interface => generated 282 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:52:55 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:52:55 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:52:55 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-f4997420-11eb-4f77-bda5-fcba141c09dc req-e926388b-f34e-410a-9c49-97755300c9d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5629772-08a7-4edb-acd5-4d92d8dbc48b", "tag": "6b433d92-f704-4c3a-b3b5-314f29ff2fa0"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:52:55 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-f4997420-11eb-4f77-bda5-fcba141c09dc req-e926388b-f34e-410a-9c49-97755300c9d9 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:52:55 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-f4997420-11eb-4f77-bda5-fcba141c09dc req-e926388b-f34e-410a-9c49-97755300c9d9 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:52:55 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-f4997420-11eb-4f77-bda5-fcba141c09dc req-e926388b-f34e-410a-9c49-97755300c9d9 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:52:55 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-f4997420-11eb-4f77-bda5-fcba141c09dc req-e926388b-f34e-410a-9c49-97755300c9d9 service nova] Creating event network-changed:6b433d92-f704-4c3a-b3b5-314f29ff2fa0 for instance d5629772-08a7-4edb-acd5-4d92d8dbc48b on user Apr 19 14:52:55 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [req-f4997420-11eb-4f77-bda5-fcba141c09dc req-e926388b-f34e-410a-9c49-97755300c9d9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041390 Apr 19 14:52:55 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 42/120] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:52:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:52:56 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell1:SELECT=16 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:52:56 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_api:SELECT=10 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:52:56 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-9d1a2dec-5749-4a54-9f18-090704d2ec44 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:52:56 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-9d1a2dec-5749-4a54-9f18-090704d2ec44 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] [instance: a499484d-dfca-44f4-9ab0-ecabbf88f06d] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:52:56 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-9d1a2dec-5749-4a54-9f18-090704d2ec44 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:52:56 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-9d1a2dec-5749-4a54-9f18-090704d2ec44 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:52:56 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-9d1a2dec-5749-4a54-9f18-090704d2ec44 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:52:56 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-9d1a2dec-5749-4a54-9f18-090704d2ec44 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:52:56 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-9d1a2dec-5749-4a54-9f18-090704d2ec44 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:52:56 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-9d1a2dec-5749-4a54-9f18-090704d2ec44 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:52:56 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-9d1a2dec-5749-4a54-9f18-090704d2ec44 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a499484d-dfca-44f4-9ab0-ecabbf88f06d/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.226247 Apr 19 14:52:56 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 40/121] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 14:52:56 2023] GET /compute/v2.1/servers/a499484d-dfca-44f4-9ab0-ecabbf88f06d/os-interface => generated 282 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:52:56 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-e196ee9c-1cd3-4fe8-b871-bd90e0c55b27 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:52:56 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-e196ee9c-1cd3-4fe8-b871-bd90e0c55b27 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] [instance: d5629772-08a7-4edb-acd5-4d92d8dbc48b] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:52:56 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-e196ee9c-1cd3-4fe8-b871-bd90e0c55b27 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:52:56 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-e196ee9c-1cd3-4fe8-b871-bd90e0c55b27 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:52:56 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-e196ee9c-1cd3-4fe8-b871-bd90e0c55b27 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:52:56 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-e196ee9c-1cd3-4fe8-b871-bd90e0c55b27 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:52:56 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-e196ee9c-1cd3-4fe8-b871-bd90e0c55b27 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:52:56 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-e196ee9c-1cd3-4fe8-b871-bd90e0c55b27 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:52:56 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-e196ee9c-1cd3-4fe8-b871-bd90e0c55b27 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] [instance: d5629772-08a7-4edb-acd5-4d92d8dbc48b] Going to try to terminate instance {{(pid=61253) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 14:52:56 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-e196ee9c-1cd3-4fe8-b871-bd90e0c55b27 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d5629772-08a7-4edb-acd5-4d92d8dbc48b" status: 204 len: 0 microversion: 2.1 time: 0.120843 Apr 19 14:52:56 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 40/122] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 14:52:56 2023] DELETE /compute/v2.1/servers/d5629772-08a7-4edb-acd5-4d92d8dbc48b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 14:52:56 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-934b25f1-23fc-41e4-bbb8-b781b230d0a4 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:52:56 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-934b25f1-23fc-41e4-bbb8-b781b230d0a4 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] [instance: d5629772-08a7-4edb-acd5-4d92d8dbc48b] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:52:56 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-934b25f1-23fc-41e4-bbb8-b781b230d0a4 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:52:56 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-934b25f1-23fc-41e4-bbb8-b781b230d0a4 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:52:56 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-934b25f1-23fc-41e4-bbb8-b781b230d0a4 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:52:56 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-934b25f1-23fc-41e4-bbb8-b781b230d0a4 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:52:56 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-934b25f1-23fc-41e4-bbb8-b781b230d0a4 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:52:56 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-934b25f1-23fc-41e4-bbb8-b781b230d0a4 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:52:57 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-934b25f1-23fc-41e4-bbb8-b781b230d0a4 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f959bfd4235e48b89b84317f32887eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e931bbf53a24ad385fd4480c6e34c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:52:57 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-934b25f1-23fc-41e4-bbb8-b781b230d0a4 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d5629772-08a7-4edb-acd5-4d92d8dbc48b" status: 200 len: 1673 microversion: 2.1 time: 0.346315 Apr 19 14:52:57 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 43/123] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:52:56 2023] GET /compute/v2.1/servers/d5629772-08a7-4edb-acd5-4d92d8dbc48b => generated 1673 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:52:57 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [req-55f81055-f439-42d2-a676-8e8a5ff0f2ab req-417c9d96-7161-424f-99ce-7259a64c3c02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5629772-08a7-4edb-acd5-4d92d8dbc48b", "name": "network-vif-unplugged", "status": "completed", "tag": "6b433d92-f704-4c3a-b3b5-314f29ff2fa0"}]} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:52:57 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-55f81055-f439-42d2-a676-8e8a5ff0f2ab req-417c9d96-7161-424f-99ce-7259a64c3c02 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:52:57 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-55f81055-f439-42d2-a676-8e8a5ff0f2ab req-417c9d96-7161-424f-99ce-7259a64c3c02 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:52:57 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-55f81055-f439-42d2-a676-8e8a5ff0f2ab req-417c9d96-7161-424f-99ce-7259a64c3c02 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:52:57 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-55f81055-f439-42d2-a676-8e8a5ff0f2ab req-417c9d96-7161-424f-99ce-7259a64c3c02 service nova] Creating event network-vif-unplugged:6b433d92-f704-4c3a-b3b5-314f29ff2fa0 for instance d5629772-08a7-4edb-acd5-4d92d8dbc48b on user Apr 19 14:52:57 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [req-55f81055-f439-42d2-a676-8e8a5ff0f2ab req-417c9d96-7161-424f-99ce-7259a64c3c02 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030495 Apr 19 14:52:57 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 41/124] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:52:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:52:58 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [req-13889b81-636d-49ae-915f-94be60ed2cc9 req-40363a66-ef0d-4173-bf82-9ca75f89d7e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5629772-08a7-4edb-acd5-4d92d8dbc48b", "name": "network-vif-deleted", "tag": "6b433d92-f704-4c3a-b3b5-314f29ff2fa0"}]} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:52:58 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-13889b81-636d-49ae-915f-94be60ed2cc9 req-40363a66-ef0d-4173-bf82-9ca75f89d7e9 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:52:58 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-13889b81-636d-49ae-915f-94be60ed2cc9 req-40363a66-ef0d-4173-bf82-9ca75f89d7e9 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:52:58 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-13889b81-636d-49ae-915f-94be60ed2cc9 req-40363a66-ef0d-4173-bf82-9ca75f89d7e9 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:52:58 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-13889b81-636d-49ae-915f-94be60ed2cc9 req-40363a66-ef0d-4173-bf82-9ca75f89d7e9 service nova] Creating event network-vif-deleted:6b433d92-f704-4c3a-b3b5-314f29ff2fa0 for instance d5629772-08a7-4edb-acd5-4d92d8dbc48b on user Apr 19 14:52:58 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [req-13889b81-636d-49ae-915f-94be60ed2cc9 req-40363a66-ef0d-4173-bf82-9ca75f89d7e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035130 Apr 19 14:52:58 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 41/125] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:52:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:52:58 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-8af44fea-f03a-430c-8d37-b873e61adfa9 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1643015307", "imageRef": "283dcfe8-75fd-4917-902e-1b940387187c", "flavorRef": "42", "networks": [{"uuid": "3c2419fc-af3f-4d4e-a992-2d1855c43c82"}]}} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:52:58 user devstack@n-api.service[61255]: DEBUG nova.network.neutron [None req-8af44fea-f03a-430c-8d37-b873e61adfa9 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] validate_networks() for [('3c2419fc-af3f-4d4e-a992-2d1855c43c82', None, None, None, None, None)] {{(pid=61255) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 14:52:59 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [req-3cbd4fee-4de8-47da-b978-3f5616a622d7 req-4f61b5f5-f1d2-48e2-b664-fa9c4cb4cf01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a499484d-dfca-44f4-9ab0-ecabbf88f06d", "tag": "cd2ec5dc-a7b9-4af8-8e23-c269ffdd095f"}, {"server_uuid": "d5629772-08a7-4edb-acd5-4d92d8dbc48b", "name": "network-vif-plugged", "status": "completed", "tag": "6b433d92-f704-4c3a-b3b5-314f29ff2fa0"}]} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:52:59 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-3cbd4fee-4de8-47da-b978-3f5616a622d7 req-4f61b5f5-f1d2-48e2-b664-fa9c4cb4cf01 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:52:59 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-3cbd4fee-4de8-47da-b978-3f5616a622d7 req-4f61b5f5-f1d2-48e2-b664-fa9c4cb4cf01 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:52:59 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-3cbd4fee-4de8-47da-b978-3f5616a622d7 req-4f61b5f5-f1d2-48e2-b664-fa9c4cb4cf01 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:52:59 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-3cbd4fee-4de8-47da-b978-3f5616a622d7 req-4f61b5f5-f1d2-48e2-b664-fa9c4cb4cf01 service nova] Creating event network-changed:cd2ec5dc-a7b9-4af8-8e23-c269ffdd095f for instance a499484d-dfca-44f4-9ab0-ecabbf88f06d on user Apr 19 14:52:59 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-3cbd4fee-4de8-47da-b978-3f5616a622d7 req-4f61b5f5-f1d2-48e2-b664-fa9c4cb4cf01 service nova] Creating event network-vif-plugged:6b433d92-f704-4c3a-b3b5-314f29ff2fa0 for instance d5629772-08a7-4edb-acd5-4d92d8dbc48b on user Apr 19 14:52:59 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [req-3cbd4fee-4de8-47da-b978-3f5616a622d7 req-4f61b5f5-f1d2-48e2-b664-fa9c4cb4cf01 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.036027 Apr 19 14:52:59 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 42/126] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:52:59 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:52:59 user devstack@n-api.service[61255]: DEBUG nova.virt.hardware [None req-8af44fea-f03a-430c-8d37-b873e61adfa9 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Flavor limits 0:0:0 {{(pid=61255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 14:52:59 user devstack@n-api.service[61255]: DEBUG nova.virt.hardware [None req-8af44fea-f03a-430c-8d37-b873e61adfa9 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Image limits 0:0:0 {{(pid=61255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 14:52:59 user devstack@n-api.service[61255]: DEBUG nova.virt.hardware [None req-8af44fea-f03a-430c-8d37-b873e61adfa9 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Flavor pref 0:0:0 {{(pid=61255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 14:52:59 user devstack@n-api.service[61255]: DEBUG nova.virt.hardware [None req-8af44fea-f03a-430c-8d37-b873e61adfa9 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Image pref 0:0:0 {{(pid=61255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 14:52:59 user devstack@n-api.service[61255]: DEBUG nova.virt.hardware [None req-8af44fea-f03a-430c-8d37-b873e61adfa9 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 14:52:59 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-8af44fea-f03a-430c-8d37-b873e61adfa9 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:52:59 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-8af44fea-f03a-430c-8d37-b873e61adfa9 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:52:59 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-8af44fea-f03a-430c-8d37-b873e61adfa9 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:52:59 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-8af44fea-f03a-430c-8d37-b873e61adfa9 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:52:59 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-8af44fea-f03a-430c-8d37-b873e61adfa9 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:52:59 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-8af44fea-f03a-430c-8d37-b873e61adfa9 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:52:59 user devstack@n-api.service[61255]: DEBUG nova.quota [None req-8af44fea-f03a-430c-8d37-b873e61adfa9 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Getting quotas for project da86be1a28254582b530973fbf7f724c. Resources: {'ram', 'instances', 'cores'} {{(pid=61255) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:52:59 user devstack@n-api.service[61255]: DEBUG nova.quota [None req-8af44fea-f03a-430c-8d37-b873e61adfa9 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Getting quotas for user 708068c5f6f5451fbcd6c24235a185d2 and project da86be1a28254582b530973fbf7f724c. Resources: {'ram', 'instances', 'cores'} {{(pid=61255) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:52:59 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-8af44fea-f03a-430c-8d37-b873e61adfa9 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Going to run 1 instances... {{(pid=61255) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 14:52:59 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-8af44fea-f03a-430c-8d37-b873e61adfa9 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] [instance: 0a8c97e3-3c9e-4a4a-bc86-ee3c313cb1d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='283dcfe8-75fd-4917-902e-1b940387187c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61255) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 14:52:59 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-8af44fea-f03a-430c-8d37-b873e61adfa9 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.725306 Apr 19 14:52:59 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 44/127] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 14:52:58 2023] POST /compute/v2.1/servers => generated 378 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 14:52:59 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-021e53f7-7f42-4d2e-a3a4-36ac49705ce3 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:52:59 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-021e53f7-7f42-4d2e-a3a4-36ac49705ce3 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] [instance: 0a8c97e3-3c9e-4a4a-bc86-ee3c313cb1d3] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:52:59 user devstack@n-api.service[61253]: DEBUG nova.policy [None req-021e53f7-7f42-4d2e-a3a4-36ac49705ce3 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708068c5f6f5451fbcd6c24235a185d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da86be1a28254582b530973fbf7f724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61253) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:52:59 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-021e53f7-7f42-4d2e-a3a4-36ac49705ce3 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0a8c97e3-3c9e-4a4a-bc86-ee3c313cb1d3" status: 200 len: 1212 microversion: 2.1 time: 0.068230 Apr 19 14:52:59 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 42/128] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:52:59 2023] GET /compute/v2.1/servers/0a8c97e3-3c9e-4a4a-bc86-ee3c313cb1d3 => generated 1212 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:53:02 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [req-a79a88e4-0272-4c0b-9e56-de79919431b0 req-08d600a3-1834-42e7-af90-f824f1e5f1c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a8c97e3-3c9e-4a4a-bc86-ee3c313cb1d3", "tag": "878e79b6-c83f-4872-9143-cb5f61cd413a"}]} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:53:02 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-a79a88e4-0272-4c0b-9e56-de79919431b0 req-08d600a3-1834-42e7-af90-f824f1e5f1c7 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:02 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-a79a88e4-0272-4c0b-9e56-de79919431b0 req-08d600a3-1834-42e7-af90-f824f1e5f1c7 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:02 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-a79a88e4-0272-4c0b-9e56-de79919431b0 req-08d600a3-1834-42e7-af90-f824f1e5f1c7 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:02 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-a79a88e4-0272-4c0b-9e56-de79919431b0 req-08d600a3-1834-42e7-af90-f824f1e5f1c7 service nova] Creating event network-changed:878e79b6-c83f-4872-9143-cb5f61cd413a for instance 0a8c97e3-3c9e-4a4a-bc86-ee3c313cb1d3 on user Apr 19 14:53:02 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [req-a79a88e4-0272-4c0b-9e56-de79919431b0 req-08d600a3-1834-42e7-af90-f824f1e5f1c7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027381 Apr 19 14:53:02 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 43/129] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:53:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:53:04 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-9ab759d8-d43c-49bc-ad3c-8fdd99951897 req-752e21dd-2c62-4f8e-adec-2169c0878927 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a8c97e3-3c9e-4a4a-bc86-ee3c313cb1d3", "name": "network-vif-plugged", "status": "completed", "tag": "878e79b6-c83f-4872-9143-cb5f61cd413a"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:53:04 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-9ab759d8-d43c-49bc-ad3c-8fdd99951897 req-752e21dd-2c62-4f8e-adec-2169c0878927 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:04 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-9ab759d8-d43c-49bc-ad3c-8fdd99951897 req-752e21dd-2c62-4f8e-adec-2169c0878927 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:04 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-9ab759d8-d43c-49bc-ad3c-8fdd99951897 req-752e21dd-2c62-4f8e-adec-2169c0878927 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:04 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-9ab759d8-d43c-49bc-ad3c-8fdd99951897 req-752e21dd-2c62-4f8e-adec-2169c0878927 service nova] Creating event network-vif-plugged:878e79b6-c83f-4872-9143-cb5f61cd413a for instance 0a8c97e3-3c9e-4a4a-bc86-ee3c313cb1d3 on user Apr 19 14:53:04 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [req-9ab759d8-d43c-49bc-ad3c-8fdd99951897 req-752e21dd-2c62-4f8e-adec-2169c0878927 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027708 Apr 19 14:53:04 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 45/130] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:53:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:53:06 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [req-0718e64d-b4e5-46c6-8f77-3eac2e2ad9ed req-ec6153b3-9fd6-47fe-8caa-4ac16cc9ac0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a8c97e3-3c9e-4a4a-bc86-ee3c313cb1d3", "name": "network-vif-plugged", "status": "completed", "tag": "878e79b6-c83f-4872-9143-cb5f61cd413a"}]} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:53:06 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-0718e64d-b4e5-46c6-8f77-3eac2e2ad9ed req-ec6153b3-9fd6-47fe-8caa-4ac16cc9ac0d service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:06 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-0718e64d-b4e5-46c6-8f77-3eac2e2ad9ed req-ec6153b3-9fd6-47fe-8caa-4ac16cc9ac0d service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:06 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-0718e64d-b4e5-46c6-8f77-3eac2e2ad9ed req-ec6153b3-9fd6-47fe-8caa-4ac16cc9ac0d service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:06 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-0718e64d-b4e5-46c6-8f77-3eac2e2ad9ed req-ec6153b3-9fd6-47fe-8caa-4ac16cc9ac0d service nova] Creating event network-vif-plugged:878e79b6-c83f-4872-9143-cb5f61cd413a for instance 0a8c97e3-3c9e-4a4a-bc86-ee3c313cb1d3 on user Apr 19 14:53:06 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [req-0718e64d-b4e5-46c6-8f77-3eac2e2ad9ed req-ec6153b3-9fd6-47fe-8caa-4ac16cc9ac0d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031349 Apr 19 14:53:06 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 43/131] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:53:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 14:53:13 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_api:SELECT=8 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:53:13 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell1:SELECT=10 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:53:13 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-f77f6907-7cc3-40aa-bf02-f327a8bf4d21 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:53:13 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-f77f6907-7cc3-40aa-bf02-f327a8bf4d21 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] [instance: 84619c4f-a014-4044-bdf8-a2c30eb11a18] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:53:13 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-f77f6907-7cc3-40aa-bf02-f327a8bf4d21 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:13 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-f77f6907-7cc3-40aa-bf02-f327a8bf4d21 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:13 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-f77f6907-7cc3-40aa-bf02-f327a8bf4d21 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:13 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-f77f6907-7cc3-40aa-bf02-f327a8bf4d21 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:13 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-f77f6907-7cc3-40aa-bf02-f327a8bf4d21 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:13 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-f77f6907-7cc3-40aa-bf02-f327a8bf4d21 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:14 user devstack@n-api.service[61254]: INFO nova.api.openstack.wsgi [None req-f77f6907-7cc3-40aa-bf02-f327a8bf4d21 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] HTTP exception thrown: Instance 84619c4f-a014-4044-bdf8-a2c30eb11a18 could not be found. Apr 19 14:53:14 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-f77f6907-7cc3-40aa-bf02-f327a8bf4d21 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Request method failure captured: Apr 19 14:53:14 user devstack@n-api.service[61254]: request: GET /compute/v2.1/servers/84619c4f-a014-4044-bdf8-a2c30eb11a18 HTTP/1.1 Apr 19 14:53:14 user devstack@n-api.service[61254]: Accept: application/json Apr 19 14:53:14 user devstack@n-api.service[61254]: Accept-Encoding: identity Apr 19 14:53:14 user devstack@n-api.service[61254]: Connection: close Apr 19 14:53:14 user devstack@n-api.service[61254]: Content-Length: 0 Apr 19 14:53:14 user devstack@n-api.service[61254]: Content-Type: application/json Apr 19 14:53:14 user devstack@n-api.service[61254]: Host: 10.0.0.210 Apr 19 14:53:14 user devstack@n-api.service[61254]: Openstack-System-Scope: None Apr 19 14:53:14 user devstack@n-api.service[61254]: User-Agent: python-urllib3/1.26.15 Apr 19 14:53:14 user devstack@n-api.service[61254]: X-Auth-Token: gAAAAABkP_-z2_rmcdlbemjitSyvc65ZSE1SdSrX1Mxf8HcElfVfs2hR-50Ji2EHJEEx1mQTalw_SQ1vKw-ZCRZKosAK8FMEBWPlLZRPuHqyZ8OlZa0sG3kBOrPfVu6-H9X6pnnXa0ZO3EFgeZ44e0vdUP6qVBUro1VSIfaYLjlrM388mwXfDL0 Apr 19 14:53:14 user devstack@n-api.service[61254]: X-Domain-Id: None Apr 19 14:53:14 user devstack@n-api.service[61254]: X-Domain-Name: None Apr 19 14:53:14 user devstack@n-api.service[61254]: X-Identity-Status: Confirmed Apr 19 14:53:14 user devstack@n-api.service[61254]: X-Is-Admin-Project: True Apr 19 14:53:14 user devstack@n-api.service[61254]: X-Project-Domain-Id: default Apr 19 14:53:14 user devstack@n-api.service[61254]: X-Project-Domain-Name: Default Apr 19 14:53:14 user devstack@n-api.service[61254]: X-Project-Id: ea8cf58226424348afa3db7ce42833f1 Apr 19 14:53:14 user devstack@n-api.service[61254]: X-Project-Name: tempest-DeleteServersTestJSON-624422919 Apr 19 14:53:14 user devstack@n-api.service[61254]: X-Role: member,reader Apr 19 14:53:14 user devstack@n-api.service[61254]: X-Roles: member,reader Apr 19 14:53:14 user devstack@n-api.service[61254]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ea8cf58226424348afa3db7ce42833f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ea8cf58226424348afa3db7ce42833f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ea8cf58226424348afa3db7ce42833f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 14:53:14 user devstack@n-api.service[61254]: X-Tenant: tempest-DeleteServersTestJSON-624422919 Apr 19 14:53:14 user devstack@n-api.service[61254]: X-Tenant-Id: ea8cf58226424348afa3db7ce42833f1 Apr 19 14:53:14 user devstack@n-api.service[61254]: X-Tenant-Name: tempest-DeleteServersTestJSON-624422919 Apr 19 14:53:14 user devstack@n-api.service[61254]: X-User: tempest-DeleteServersTestJSON-624422919-project-member Apr 19 14:53:14 user devstack@n-api.service[61254]: X-User-Domain-Id: default Apr 19 14:53:14 user devstack@n-api.service[61254]: X-User-Domain-Name: Default Apr 19 14:53:14 user devstack@n-api.service[61254]: X-User-Id: 9c59859626174f24b37a68077e322051 Apr 19 14:53:14 user devstack@n-api.service[61254]: X-User-Name: tempest-DeleteServersTestJSON-624422919-project-member Apr 19 14:53:14 user devstack@n-api.service[61254]: method: > Apr 19 14:53:14 user devstack@n-api.service[61254]: exception: Instance 84619c4f-a014-4044-bdf8-a2c30eb11a18 could not be found. Apr 19 14:53:14 user devstack@n-api.service[61254]: action_args: {'id': '84619c4f-a014-4044-bdf8-a2c30eb11a18'} Apr 19 14:53:14 user devstack@n-api.service[61254]: {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:53:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:53:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:53:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:53:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:53:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:53:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:53:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:53:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:53:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:53:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84619c4f-a014-4044-bdf8-a2c30eb11a18 could not be found. Apr 19 14:53:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:53:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:53:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:53:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:53:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:53:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:53:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:53:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:53:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:53:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:53:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:53:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:53:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:53:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:53:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:53:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:53:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84619c4f-a014-4044-bdf8-a2c30eb11a18 could not be found. Apr 19 14:53:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:53:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:53:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:53:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:53:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:53:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:53:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:53:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:53:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84619c4f-a014-4044-bdf8-a2c30eb11a18 could not be found. Apr 19 14:53:14 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:53:14 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-f77f6907-7cc3-40aa-bf02-f327a8bf4d21 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] Returning 404 to user: Instance 84619c4f-a014-4044-bdf8-a2c30eb11a18 could not be found. {{(pid=61254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:53:14 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-f77f6907-7cc3-40aa-bf02-f327a8bf4d21 tempest-DeleteServersTestJSON-624422919 tempest-DeleteServersTestJSON-624422919-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84619c4f-a014-4044-bdf8-a2c30eb11a18" status: 404 len: 111 microversion: 2.1 time: 0.217919 Apr 19 14:53:14 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 44/132] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:53:13 2023] GET /compute/v2.1/servers/84619c4f-a014-4044-bdf8-a2c30eb11a18 => generated 111 bytes in 219 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:53:14 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-3e6cf29b-9fce-41b2-b571-db51740340b9 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:53:14 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-3e6cf29b-9fce-41b2-b571-db51740340b9 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] [instance: 9fee43ad-330a-45d7-9374-07feefcf9e14] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:53:14 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell0:SELECT=2 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:53:14 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell0:SELECT=2 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:53:14 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell0:SELECT=6 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:53:14 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:53:14 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell1:SELECT=12 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:53:14 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-3e6cf29b-9fce-41b2-b571-db51740340b9 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:14 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-3e6cf29b-9fce-41b2-b571-db51740340b9 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:14 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-3e6cf29b-9fce-41b2-b571-db51740340b9 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:14 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-3e6cf29b-9fce-41b2-b571-db51740340b9 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:14 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-3e6cf29b-9fce-41b2-b571-db51740340b9 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:14 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-3e6cf29b-9fce-41b2-b571-db51740340b9 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:14 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-583b19af-a95d-4fed-bdaf-719f8b98fdd0 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:53:14 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-583b19af-a95d-4fed-bdaf-719f8b98fdd0 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] [instance: 22962ccc-a7a7-410e-9042-7f01424d38a6] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:53:14 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-583b19af-a95d-4fed-bdaf-719f8b98fdd0 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:14 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-583b19af-a95d-4fed-bdaf-719f8b98fdd0 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:14 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-583b19af-a95d-4fed-bdaf-719f8b98fdd0 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:14 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-583b19af-a95d-4fed-bdaf-719f8b98fdd0 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:14 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-583b19af-a95d-4fed-bdaf-719f8b98fdd0 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:14 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-583b19af-a95d-4fed-bdaf-719f8b98fdd0 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:15 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-583b19af-a95d-4fed-bdaf-719f8b98fdd0 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22962ccc-a7a7-410e-9042-7f01424d38a6/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.182264 Apr 19 14:53:15 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 44/133] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 14:53:14 2023] GET /compute/v2.1/servers/22962ccc-a7a7-410e-9042-7f01424d38a6/os-interface => generated 282 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:53:15 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-3e6cf29b-9fce-41b2-b571-db51740340b9 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9fee43ad-330a-45d7-9374-07feefcf9e14/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.223958 Apr 19 14:53:15 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 46/134] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 14:53:14 2023] GET /compute/v2.1/servers/9fee43ad-330a-45d7-9374-07feefcf9e14/os-interface => generated 282 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:53:16 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [req-0073297a-e182-4cdd-a80d-84a664a1c7f4 req-ec292808-2cda-458d-a17e-c30e9c5145ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22962ccc-a7a7-410e-9042-7f01424d38a6", "tag": "128b1957-c496-4f3c-a3d6-291d27873173"}]} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:53:16 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-0073297a-e182-4cdd-a80d-84a664a1c7f4 req-ec292808-2cda-458d-a17e-c30e9c5145ff service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:16 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-0073297a-e182-4cdd-a80d-84a664a1c7f4 req-ec292808-2cda-458d-a17e-c30e9c5145ff service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:16 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-0073297a-e182-4cdd-a80d-84a664a1c7f4 req-ec292808-2cda-458d-a17e-c30e9c5145ff service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:16 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-0073297a-e182-4cdd-a80d-84a664a1c7f4 req-ec292808-2cda-458d-a17e-c30e9c5145ff service nova] Creating event network-changed:128b1957-c496-4f3c-a3d6-291d27873173 for instance 22962ccc-a7a7-410e-9042-7f01424d38a6 on user Apr 19 14:53:16 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [req-0073297a-e182-4cdd-a80d-84a664a1c7f4 req-ec292808-2cda-458d-a17e-c30e9c5145ff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046618 Apr 19 14:53:16 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 45/135] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:53:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:53:16 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [req-1e287a30-da3b-449b-9d05-55096b8b27d6 req-c8cee39d-0771-4160-a859-cd58a8c96c7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fee43ad-330a-45d7-9374-07feefcf9e14", "tag": "08e83784-97d8-4c35-a28e-ab60d1724994"}]} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:53:16 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-1e287a30-da3b-449b-9d05-55096b8b27d6 req-c8cee39d-0771-4160-a859-cd58a8c96c7b service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:16 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-1e287a30-da3b-449b-9d05-55096b8b27d6 req-c8cee39d-0771-4160-a859-cd58a8c96c7b service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:16 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-1e287a30-da3b-449b-9d05-55096b8b27d6 req-c8cee39d-0771-4160-a859-cd58a8c96c7b service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:16 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-1e287a30-da3b-449b-9d05-55096b8b27d6 req-c8cee39d-0771-4160-a859-cd58a8c96c7b service nova] Creating event network-changed:08e83784-97d8-4c35-a28e-ab60d1724994 for instance 9fee43ad-330a-45d7-9374-07feefcf9e14 on user Apr 19 14:53:16 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-049c324e-8115-4c1a-bf5c-50159c178cf5 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:53:16 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-049c324e-8115-4c1a-bf5c-50159c178cf5 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] [instance: 22962ccc-a7a7-410e-9042-7f01424d38a6] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:53:16 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [req-1e287a30-da3b-449b-9d05-55096b8b27d6 req-c8cee39d-0771-4160-a859-cd58a8c96c7b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039716 Apr 19 14:53:16 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 45/136] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:53:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 14:53:16 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-049c324e-8115-4c1a-bf5c-50159c178cf5 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:16 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-049c324e-8115-4c1a-bf5c-50159c178cf5 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:16 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-049c324e-8115-4c1a-bf5c-50159c178cf5 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:16 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-049c324e-8115-4c1a-bf5c-50159c178cf5 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:16 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-049c324e-8115-4c1a-bf5c-50159c178cf5 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:16 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-049c324e-8115-4c1a-bf5c-50159c178cf5 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:16 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-d4b60835-b679-4f41-9631-1b4b5ef87036 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:53:16 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-d4b60835-b679-4f41-9631-1b4b5ef87036 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] [instance: 9fee43ad-330a-45d7-9374-07feefcf9e14] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:53:16 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-049c324e-8115-4c1a-bf5c-50159c178cf5 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22962ccc-a7a7-410e-9042-7f01424d38a6/ips" status: 200 len: 104 microversion: 2.1 time: 0.040375 Apr 19 14:53:16 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 47/137] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 19 14:53:16 2023] GET /compute/v2.1/servers/22962ccc-a7a7-410e-9042-7f01424d38a6/ips => generated 104 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:53:16 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-d4b60835-b679-4f41-9631-1b4b5ef87036 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:16 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-d4b60835-b679-4f41-9631-1b4b5ef87036 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:16 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-d4b60835-b679-4f41-9631-1b4b5ef87036 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:16 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-d4b60835-b679-4f41-9631-1b4b5ef87036 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:16 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-d4b60835-b679-4f41-9631-1b4b5ef87036 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:16 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-d4b60835-b679-4f41-9631-1b4b5ef87036 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:16 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-d4b60835-b679-4f41-9631-1b4b5ef87036 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aab0b2e3424d80852e588323f187bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dbf312f7154ce1ae7fc1403947d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:53:16 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-d4b60835-b679-4f41-9631-1b4b5ef87036 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9fee43ad-330a-45d7-9374-07feefcf9e14" status: 200 len: 1539 microversion: 2.1 time: 0.436477 Apr 19 14:53:16 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 46/138] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:53:16 2023] GET /compute/v2.1/servers/9fee43ad-330a-45d7-9374-07feefcf9e14 => generated 1539 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:53:16 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-e413f889-710a-4369-ae83-cc5b739c0216 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:53:16 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-e413f889-710a-4369-ae83-cc5b739c0216 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] [instance: 9fee43ad-330a-45d7-9374-07feefcf9e14] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:53:16 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-e413f889-710a-4369-ae83-cc5b739c0216 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:16 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-e413f889-710a-4369-ae83-cc5b739c0216 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:16 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-e413f889-710a-4369-ae83-cc5b739c0216 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:16 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-e413f889-710a-4369-ae83-cc5b739c0216 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:16 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-e413f889-710a-4369-ae83-cc5b739c0216 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:16 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-e413f889-710a-4369-ae83-cc5b739c0216 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:17 user devstack@n-api.service[61253]: DEBUG nova.policy [None req-e413f889-710a-4369-ae83-cc5b739c0216 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aab0b2e3424d80852e588323f187bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dbf312f7154ce1ae7fc1403947d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61253) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:53:17 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-e413f889-710a-4369-ae83-cc5b739c0216 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9fee43ad-330a-45d7-9374-07feefcf9e14" status: 200 len: 1539 microversion: 2.1 time: 0.345770 Apr 19 14:53:17 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 46/139] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:53:16 2023] GET /compute/v2.1/servers/9fee43ad-330a-45d7-9374-07feefcf9e14 => generated 1539 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:53:17 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-42433cdf-09a2-41bf-8d76-d3ab6ac9ae08 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:53:17 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-42433cdf-09a2-41bf-8d76-d3ab6ac9ae08 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] [instance: 22962ccc-a7a7-410e-9042-7f01424d38a6] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:53:17 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-42433cdf-09a2-41bf-8d76-d3ab6ac9ae08 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:17 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-42433cdf-09a2-41bf-8d76-d3ab6ac9ae08 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:17 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-42433cdf-09a2-41bf-8d76-d3ab6ac9ae08 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:17 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-42433cdf-09a2-41bf-8d76-d3ab6ac9ae08 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:17 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-42433cdf-09a2-41bf-8d76-d3ab6ac9ae08 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:17 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-42433cdf-09a2-41bf-8d76-d3ab6ac9ae08 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:17 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-42433cdf-09a2-41bf-8d76-d3ab6ac9ae08 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] [instance: 22962ccc-a7a7-410e-9042-7f01424d38a6] Going to try to terminate instance {{(pid=61255) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 14:53:18 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-42433cdf-09a2-41bf-8d76-d3ab6ac9ae08 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/22962ccc-a7a7-410e-9042-7f01424d38a6" status: 204 len: 0 microversion: 2.1 time: 0.126176 Apr 19 14:53:18 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 48/140] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 14:53:17 2023] DELETE /compute/v2.1/servers/22962ccc-a7a7-410e-9042-7f01424d38a6 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 14:53:18 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-6f132e6b-8e08-454d-9a82-bd1a3a60d694 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:53:18 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-6f132e6b-8e08-454d-9a82-bd1a3a60d694 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] [instance: 22962ccc-a7a7-410e-9042-7f01424d38a6] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:53:18 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-6f132e6b-8e08-454d-9a82-bd1a3a60d694 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:18 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-6f132e6b-8e08-454d-9a82-bd1a3a60d694 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:18 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-6f132e6b-8e08-454d-9a82-bd1a3a60d694 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:18 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-6f132e6b-8e08-454d-9a82-bd1a3a60d694 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:18 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-6f132e6b-8e08-454d-9a82-bd1a3a60d694 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:18 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-6f132e6b-8e08-454d-9a82-bd1a3a60d694 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:18 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-6f132e6b-8e08-454d-9a82-bd1a3a60d694 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab5193fb1ec41b8a19e8621843a54a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5383c493e2f049fc9dc06818cb00a6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:53:18 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-6f132e6b-8e08-454d-9a82-bd1a3a60d694 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22962ccc-a7a7-410e-9042-7f01424d38a6" status: 200 len: 1658 microversion: 2.1 time: 0.242785 Apr 19 14:53:18 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 47/141] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:53:18 2023] GET /compute/v2.1/servers/22962ccc-a7a7-410e-9042-7f01424d38a6 => generated 1658 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:53:18 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [req-d8f63837-d114-44f2-b763-312d5dfb80a4 req-1bd944df-c3df-4bfa-8cee-d2b43b25f923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22962ccc-a7a7-410e-9042-7f01424d38a6", "name": "network-vif-unplugged", "status": "completed", "tag": "128b1957-c496-4f3c-a3d6-291d27873173"}]} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:53:18 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-d8f63837-d114-44f2-b763-312d5dfb80a4 req-1bd944df-c3df-4bfa-8cee-d2b43b25f923 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:18 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-d8f63837-d114-44f2-b763-312d5dfb80a4 req-1bd944df-c3df-4bfa-8cee-d2b43b25f923 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:18 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-d8f63837-d114-44f2-b763-312d5dfb80a4 req-1bd944df-c3df-4bfa-8cee-d2b43b25f923 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:18 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-d8f63837-d114-44f2-b763-312d5dfb80a4 req-1bd944df-c3df-4bfa-8cee-d2b43b25f923 service nova] Creating event network-vif-unplugged:128b1957-c496-4f3c-a3d6-291d27873173 for instance 22962ccc-a7a7-410e-9042-7f01424d38a6 on user Apr 19 14:53:18 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [req-d8f63837-d114-44f2-b763-312d5dfb80a4 req-1bd944df-c3df-4bfa-8cee-d2b43b25f923 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034616 Apr 19 14:53:18 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 47/142] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:53:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:53:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-588c16d1-8519-42e2-ad3d-27322265fd03 tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:53:19 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-588c16d1-8519-42e2-ad3d-27322265fd03 tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] [instance: 104344aa-6bec-467b-b519-a2bb1b0b89f8] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:53:19 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-588c16d1-8519-42e2-ad3d-27322265fd03 tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:19 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-588c16d1-8519-42e2-ad3d-27322265fd03 tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:19 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-588c16d1-8519-42e2-ad3d-27322265fd03 tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:19 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-588c16d1-8519-42e2-ad3d-27322265fd03 tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:19 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-588c16d1-8519-42e2-ad3d-27322265fd03 tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:19 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-588c16d1-8519-42e2-ad3d-27322265fd03 tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:19 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-588c16d1-8519-42e2-ad3d-27322265fd03 tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] [instance: 104344aa-6bec-467b-b519-a2bb1b0b89f8] Going to try to terminate instance {{(pid=61255) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 14:53:19 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-588c16d1-8519-42e2-ad3d-27322265fd03 tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/104344aa-6bec-467b-b519-a2bb1b0b89f8" status: 204 len: 0 microversion: 2.1 time: 0.124798 Apr 19 14:53:19 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 49/143] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 14:53:19 2023] DELETE /compute/v2.1/servers/104344aa-6bec-467b-b519-a2bb1b0b89f8 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 14:53:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-1abf6eeb-79fe-4c62-beaa-c6342edac05f tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:53:19 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-1abf6eeb-79fe-4c62-beaa-c6342edac05f tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] [instance: 104344aa-6bec-467b-b519-a2bb1b0b89f8] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:53:19 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-1abf6eeb-79fe-4c62-beaa-c6342edac05f tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:19 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-1abf6eeb-79fe-4c62-beaa-c6342edac05f tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:19 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-1abf6eeb-79fe-4c62-beaa-c6342edac05f tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:19 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-1abf6eeb-79fe-4c62-beaa-c6342edac05f tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:19 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-1abf6eeb-79fe-4c62-beaa-c6342edac05f tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:19 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-1abf6eeb-79fe-4c62-beaa-c6342edac05f tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:19 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [req-86cc142b-15f6-4b9c-9193-1e75739ce91a req-928d5ff7-0a53-4b0f-b8ed-83fbed565a32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "104344aa-6bec-467b-b519-a2bb1b0b89f8", "name": "network-vif-unplugged", "status": "completed", "tag": "3f361385-c381-4731-85a8-4a131c868d65"}]} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:53:19 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-86cc142b-15f6-4b9c-9193-1e75739ce91a req-928d5ff7-0a53-4b0f-b8ed-83fbed565a32 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:19 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-86cc142b-15f6-4b9c-9193-1e75739ce91a req-928d5ff7-0a53-4b0f-b8ed-83fbed565a32 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:19 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-86cc142b-15f6-4b9c-9193-1e75739ce91a req-928d5ff7-0a53-4b0f-b8ed-83fbed565a32 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:19 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-86cc142b-15f6-4b9c-9193-1e75739ce91a req-928d5ff7-0a53-4b0f-b8ed-83fbed565a32 service nova] Creating event network-vif-unplugged:3f361385-c381-4731-85a8-4a131c868d65 for instance 104344aa-6bec-467b-b519-a2bb1b0b89f8 on user Apr 19 14:53:19 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [req-86cc142b-15f6-4b9c-9193-1e75739ce91a req-928d5ff7-0a53-4b0f-b8ed-83fbed565a32 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030665 Apr 19 14:53:19 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 48/144] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:53:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:53:19 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-1abf6eeb-79fe-4c62-beaa-c6342edac05f tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e93c83b829546fbb633032cca416a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14492681eaac49e89054c4fe63074b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:53:19 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-1abf6eeb-79fe-4c62-beaa-c6342edac05f tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] 10.0.0.210 "GET /compute/v2.1/servers/104344aa-6bec-467b-b519-a2bb1b0b89f8" status: 200 len: 1491 microversion: 2.1 time: 0.581151 Apr 19 14:53:19 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 48/145] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:53:19 2023] GET /compute/v2.1/servers/104344aa-6bec-467b-b519-a2bb1b0b89f8 => generated 1491 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:53:20 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-c038f8aa-70b6-48fe-b1a9-24e9fcadccc3 req-780c023b-5d5f-46c3-91e1-2299b685ffe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22962ccc-a7a7-410e-9042-7f01424d38a6", "name": "network-vif-plugged", "status": "completed", "tag": "128b1957-c496-4f3c-a3d6-291d27873173"}, {"server_uuid": "22962ccc-a7a7-410e-9042-7f01424d38a6", "name": "network-vif-deleted", "tag": "128b1957-c496-4f3c-a3d6-291d27873173"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:53:20 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-c038f8aa-70b6-48fe-b1a9-24e9fcadccc3 req-780c023b-5d5f-46c3-91e1-2299b685ffe8 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:20 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-c038f8aa-70b6-48fe-b1a9-24e9fcadccc3 req-780c023b-5d5f-46c3-91e1-2299b685ffe8 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:20 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-c038f8aa-70b6-48fe-b1a9-24e9fcadccc3 req-780c023b-5d5f-46c3-91e1-2299b685ffe8 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:20 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-c038f8aa-70b6-48fe-b1a9-24e9fcadccc3 req-780c023b-5d5f-46c3-91e1-2299b685ffe8 service nova] Creating event network-vif-plugged:128b1957-c496-4f3c-a3d6-291d27873173 for instance 22962ccc-a7a7-410e-9042-7f01424d38a6 on user Apr 19 14:53:20 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-c038f8aa-70b6-48fe-b1a9-24e9fcadccc3 req-780c023b-5d5f-46c3-91e1-2299b685ffe8 service nova] Creating event network-vif-deleted:128b1957-c496-4f3c-a3d6-291d27873173 for instance 22962ccc-a7a7-410e-9042-7f01424d38a6 on user Apr 19 14:53:20 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [req-c038f8aa-70b6-48fe-b1a9-24e9fcadccc3 req-780c023b-5d5f-46c3-91e1-2299b685ffe8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031137 Apr 19 14:53:20 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 50/146] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:53:20 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:53:21 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [req-69554303-8a4f-4e11-ad50-b4f42ac383fb req-9c62d2e0-16ba-43dd-8421-6ccfd81d9290 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "104344aa-6bec-467b-b519-a2bb1b0b89f8", "name": "network-vif-plugged", "status": "completed", "tag": "3f361385-c381-4731-85a8-4a131c868d65"}]} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:53:21 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-69554303-8a4f-4e11-ad50-b4f42ac383fb req-9c62d2e0-16ba-43dd-8421-6ccfd81d9290 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:21 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-69554303-8a4f-4e11-ad50-b4f42ac383fb req-9c62d2e0-16ba-43dd-8421-6ccfd81d9290 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:21 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-69554303-8a4f-4e11-ad50-b4f42ac383fb req-9c62d2e0-16ba-43dd-8421-6ccfd81d9290 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:21 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-69554303-8a4f-4e11-ad50-b4f42ac383fb req-9c62d2e0-16ba-43dd-8421-6ccfd81d9290 service nova] Creating event network-vif-plugged:3f361385-c381-4731-85a8-4a131c868d65 for instance 104344aa-6bec-467b-b519-a2bb1b0b89f8 on user Apr 19 14:53:21 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [req-69554303-8a4f-4e11-ad50-b4f42ac383fb req-9c62d2e0-16ba-43dd-8421-6ccfd81d9290 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027062 Apr 19 14:53:21 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 49/147] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:53:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:53:22 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [req-f0ec4aa3-bd15-4dc8-9110-a94469d20f52 req-b54d1524-deaa-4367-82d2-1f6790b56b68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "104344aa-6bec-467b-b519-a2bb1b0b89f8", "name": "network-vif-deleted", "tag": "3f361385-c381-4731-85a8-4a131c868d65"}]} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:53:22 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-f0ec4aa3-bd15-4dc8-9110-a94469d20f52 req-b54d1524-deaa-4367-82d2-1f6790b56b68 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:22 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-f0ec4aa3-bd15-4dc8-9110-a94469d20f52 req-b54d1524-deaa-4367-82d2-1f6790b56b68 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:22 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-f0ec4aa3-bd15-4dc8-9110-a94469d20f52 req-b54d1524-deaa-4367-82d2-1f6790b56b68 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:22 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-f0ec4aa3-bd15-4dc8-9110-a94469d20f52 req-b54d1524-deaa-4367-82d2-1f6790b56b68 service nova] Creating event network-vif-deleted:3f361385-c381-4731-85a8-4a131c868d65 for instance 104344aa-6bec-467b-b519-a2bb1b0b89f8 on user Apr 19 14:53:22 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [req-f0ec4aa3-bd15-4dc8-9110-a94469d20f52 req-b54d1524-deaa-4367-82d2-1f6790b56b68 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033934 Apr 19 14:53:22 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 49/148] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:53:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:53:23 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-7f3a07f2-dcf3-49da-a035-109d22ff802b tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Calling method '.version_select at 0x7f3cfab9ecb0>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:53:23 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-7f3a07f2-dcf3-49da-a035-109d22ff802b tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] 10.0.0.210 "GET /compute/v2.1/images/02388b55-5cf8-4f6f-a47d-89b8a8cb305b" status: 200 len: 1724 microversion: 2.1 time: 0.050989 Apr 19 14:53:23 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 51/149] 10.0.0.210 () {62 vars in 1310 bytes} [Wed Apr 19 14:53:23 2023] GET /compute/v2.1/images/02388b55-5cf8-4f6f-a47d-89b8a8cb305b => generated 1724 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:53:23 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-fcc529ab-0c64-4656-9ea1-e029686ebd1e tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Calling method '.version_select at 0x7f3cfab1d900>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:53:23 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-fcc529ab-0c64-4656-9ea1-e029686ebd1e tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] 10.0.0.210 "GET /compute/v2.1/images/02388b55-5cf8-4f6f-a47d-89b8a8cb305b" status: 200 len: 1724 microversion: 2.1 time: 0.052959 Apr 19 14:53:23 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 50/150] 10.0.0.210 () {62 vars in 1310 bytes} [Wed Apr 19 14:53:23 2023] GET /compute/v2.1/images/02388b55-5cf8-4f6f-a47d-89b8a8cb305b => generated 1724 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:53:24 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-ae63dba8-c9bf-49f2-8a07-a4846c6fbfff tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:53:24 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-ae63dba8-c9bf-49f2-8a07-a4846c6fbfff tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] [instance: 04ea16ad-a0eb-4187-a966-7ec4f2396852] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:53:24 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-ae63dba8-c9bf-49f2-8a07-a4846c6fbfff tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:24 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-ae63dba8-c9bf-49f2-8a07-a4846c6fbfff tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:24 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-ae63dba8-c9bf-49f2-8a07-a4846c6fbfff tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:24 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-ae63dba8-c9bf-49f2-8a07-a4846c6fbfff tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:24 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-ae63dba8-c9bf-49f2-8a07-a4846c6fbfff tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:24 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-ae63dba8-c9bf-49f2-8a07-a4846c6fbfff tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:24 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-ae63dba8-c9bf-49f2-8a07-a4846c6fbfff tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b888ae3c3540df8cf7953ed5ed90d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de5e8e3b3394f219c8af4b834c85631', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:53:24 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-ae63dba8-c9bf-49f2-8a07-a4846c6fbfff tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04ea16ad-a0eb-4187-a966-7ec4f2396852" status: 200 len: 1671 microversion: 2.1 time: 0.211709 Apr 19 14:53:24 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 50/151] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:53:24 2023] GET /compute/v2.1/servers/04ea16ad-a0eb-4187-a966-7ec4f2396852 => generated 1671 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:53:24 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-b509f827-78f7-4503-ac15-84ccfc4af0d6 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-41590906", "imageRef": "283dcfe8-75fd-4917-902e-1b940387187c", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:53:24 user devstack@n-api.service[61255]: DEBUG nova.network.neutron [None req-b509f827-78f7-4503-ac15-84ccfc4af0d6 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] validate_networks() for [('742f44f6-8c7e-4b7f-bab3-f94ce03a873a', None, None, None, None, None)] {{(pid=61255) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 14:53:25 user devstack@n-api.service[61255]: DEBUG nova.virt.hardware [None req-b509f827-78f7-4503-ac15-84ccfc4af0d6 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Flavor limits 0:0:0 {{(pid=61255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 14:53:25 user devstack@n-api.service[61255]: DEBUG nova.virt.hardware [None req-b509f827-78f7-4503-ac15-84ccfc4af0d6 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Image limits 0:0:0 {{(pid=61255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 14:53:25 user devstack@n-api.service[61255]: DEBUG nova.virt.hardware [None req-b509f827-78f7-4503-ac15-84ccfc4af0d6 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Flavor pref 0:0:0 {{(pid=61255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 14:53:25 user devstack@n-api.service[61255]: DEBUG nova.virt.hardware [None req-b509f827-78f7-4503-ac15-84ccfc4af0d6 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Image pref 0:0:0 {{(pid=61255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 14:53:25 user devstack@n-api.service[61255]: DEBUG nova.virt.hardware [None req-b509f827-78f7-4503-ac15-84ccfc4af0d6 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 14:53:25 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-b509f827-78f7-4503-ac15-84ccfc4af0d6 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:25 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-b509f827-78f7-4503-ac15-84ccfc4af0d6 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:25 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-b509f827-78f7-4503-ac15-84ccfc4af0d6 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:25 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-b509f827-78f7-4503-ac15-84ccfc4af0d6 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:25 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-b509f827-78f7-4503-ac15-84ccfc4af0d6 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:25 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-b509f827-78f7-4503-ac15-84ccfc4af0d6 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:25 user devstack@n-api.service[61255]: DEBUG nova.quota [None req-b509f827-78f7-4503-ac15-84ccfc4af0d6 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Getting quotas for project 8f94be4fa38d44fe84c03b02b09bab0a. Resources: {'ram', 'instances', 'cores'} {{(pid=61255) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:53:25 user devstack@n-api.service[61255]: DEBUG nova.quota [None req-b509f827-78f7-4503-ac15-84ccfc4af0d6 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Getting quotas for user 8683d0564d7c475c9d26f897e0239640 and project 8f94be4fa38d44fe84c03b02b09bab0a. Resources: {'ram', 'instances', 'cores'} {{(pid=61255) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:53:25 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-b509f827-78f7-4503-ac15-84ccfc4af0d6 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Going to run 1 instances... {{(pid=61255) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 14:53:25 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-b509f827-78f7-4503-ac15-84ccfc4af0d6 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] [instance: 9c330e74-9939-422b-88f6-1958857b6c41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='283dcfe8-75fd-4917-902e-1b940387187c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61255) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 14:53:25 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-b509f827-78f7-4503-ac15-84ccfc4af0d6 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.604758 Apr 19 14:53:25 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 52/152] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 14:53:24 2023] POST /compute/v2.1/servers => generated 381 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 14:53:25 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-6502b041-8be3-4ddf-b34f-af244be7fa4b tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:53:25 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-6502b041-8be3-4ddf-b34f-af244be7fa4b tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] [instance: 9c330e74-9939-422b-88f6-1958857b6c41] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:53:25 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:53:25 user devstack@n-api.service[61253]: DEBUG nova.policy [None req-6502b041-8be3-4ddf-b34f-af244be7fa4b tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8683d0564d7c475c9d26f897e0239640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94be4fa38d44fe84c03b02b09bab0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61253) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:53:25 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-6502b041-8be3-4ddf-b34f-af244be7fa4b tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c330e74-9939-422b-88f6-1958857b6c41" status: 200 len: 1214 microversion: 2.1 time: 0.063648 Apr 19 14:53:25 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 51/153] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:53:25 2023] GET /compute/v2.1/servers/9c330e74-9939-422b-88f6-1958857b6c41 => generated 1214 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:53:25 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-bb3dc097-ff6e-4abc-9b78-f8a4497d1a3b tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1814906337", "imageRef": "283dcfe8-75fd-4917-902e-1b940387187c", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:53:25 user devstack@n-api.service[61254]: DEBUG nova.network.neutron [None req-bb3dc097-ff6e-4abc-9b78-f8a4497d1a3b tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] validate_networks() for [('742f44f6-8c7e-4b7f-bab3-f94ce03a873a', None, None, None, None, None)] {{(pid=61254) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 14:53:26 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-bb3dc097-ff6e-4abc-9b78-f8a4497d1a3b tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Flavor limits 0:0:0 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 14:53:26 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-bb3dc097-ff6e-4abc-9b78-f8a4497d1a3b tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Image limits 0:0:0 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 14:53:26 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-bb3dc097-ff6e-4abc-9b78-f8a4497d1a3b tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Flavor pref 0:0:0 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 14:53:26 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-bb3dc097-ff6e-4abc-9b78-f8a4497d1a3b tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Image pref 0:0:0 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 14:53:26 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-bb3dc097-ff6e-4abc-9b78-f8a4497d1a3b tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 14:53:26 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-bb3dc097-ff6e-4abc-9b78-f8a4497d1a3b tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:26 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-bb3dc097-ff6e-4abc-9b78-f8a4497d1a3b tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:26 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-bb3dc097-ff6e-4abc-9b78-f8a4497d1a3b tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:26 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-bb3dc097-ff6e-4abc-9b78-f8a4497d1a3b tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:26 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-bb3dc097-ff6e-4abc-9b78-f8a4497d1a3b tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:26 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-bb3dc097-ff6e-4abc-9b78-f8a4497d1a3b tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:26 user devstack@n-api.service[61254]: DEBUG nova.quota [None req-bb3dc097-ff6e-4abc-9b78-f8a4497d1a3b tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Getting quotas for project 8f94be4fa38d44fe84c03b02b09bab0a. Resources: {'ram', 'instances', 'cores'} {{(pid=61254) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:53:26 user devstack@n-api.service[61254]: DEBUG nova.quota [None req-bb3dc097-ff6e-4abc-9b78-f8a4497d1a3b tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Getting quotas for user 8683d0564d7c475c9d26f897e0239640 and project 8f94be4fa38d44fe84c03b02b09bab0a. Resources: {'ram', 'instances', 'cores'} {{(pid=61254) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:53:26 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-bb3dc097-ff6e-4abc-9b78-f8a4497d1a3b tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Going to run 1 instances... {{(pid=61254) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 14:53:26 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-bb3dc097-ff6e-4abc-9b78-f8a4497d1a3b tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] [instance: 6930db7c-e8e0-4d1d-ac99-952827ff1aa9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='283dcfe8-75fd-4917-902e-1b940387187c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61254) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 14:53:26 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-bb3dc097-ff6e-4abc-9b78-f8a4497d1a3b tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.638009 Apr 19 14:53:26 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 51/154] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 14:53:25 2023] POST /compute/v2.1/servers => generated 381 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 14:53:26 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-052d6a7a-4a2c-412b-9f22-87a7c8d5e833 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:53:26 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-052d6a7a-4a2c-412b-9f22-87a7c8d5e833 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] [instance: 6930db7c-e8e0-4d1d-ac99-952827ff1aa9] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:53:26 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-052d6a7a-4a2c-412b-9f22-87a7c8d5e833 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8683d0564d7c475c9d26f897e0239640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94be4fa38d44fe84c03b02b09bab0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:53:26 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-052d6a7a-4a2c-412b-9f22-87a7c8d5e833 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6930db7c-e8e0-4d1d-ac99-952827ff1aa9" status: 200 len: 1216 microversion: 2.1 time: 0.068909 Apr 19 14:53:26 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 53/155] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:53:26 2023] GET /compute/v2.1/servers/6930db7c-e8e0-4d1d-ac99-952827ff1aa9 => generated 1216 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:53:28 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [req-cdf76de1-6624-4d73-9e6f-9e751da0bf54 req-ec43bb98-50ae-42ff-b038-7a4f14d9f6d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c330e74-9939-422b-88f6-1958857b6c41", "tag": "857c8812-0d5a-4ec9-b7a9-23592a1be890"}]} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:53:28 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-cdf76de1-6624-4d73-9e6f-9e751da0bf54 req-ec43bb98-50ae-42ff-b038-7a4f14d9f6d5 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:28 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-cdf76de1-6624-4d73-9e6f-9e751da0bf54 req-ec43bb98-50ae-42ff-b038-7a4f14d9f6d5 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:28 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-cdf76de1-6624-4d73-9e6f-9e751da0bf54 req-ec43bb98-50ae-42ff-b038-7a4f14d9f6d5 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:28 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:53:28 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-cdf76de1-6624-4d73-9e6f-9e751da0bf54 req-ec43bb98-50ae-42ff-b038-7a4f14d9f6d5 service nova] Creating event network-changed:857c8812-0d5a-4ec9-b7a9-23592a1be890 for instance 9c330e74-9939-422b-88f6-1958857b6c41 on user Apr 19 14:53:28 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [req-cdf76de1-6624-4d73-9e6f-9e751da0bf54 req-ec43bb98-50ae-42ff-b038-7a4f14d9f6d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030496 Apr 19 14:53:28 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 52/156] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:53:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:53:28 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [req-2c08928f-7dd5-4414-a594-bb67ddfa1ed5 req-6e8c4dc4-0b07-4b30-9c90-8f1cb6a3d757 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6930db7c-e8e0-4d1d-ac99-952827ff1aa9", "tag": "a9320570-bc89-45b1-a97c-3da53f2e4b70"}]} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:53:28 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-2c08928f-7dd5-4414-a594-bb67ddfa1ed5 req-6e8c4dc4-0b07-4b30-9c90-8f1cb6a3d757 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:28 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-2c08928f-7dd5-4414-a594-bb67ddfa1ed5 req-6e8c4dc4-0b07-4b30-9c90-8f1cb6a3d757 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:28 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-2c08928f-7dd5-4414-a594-bb67ddfa1ed5 req-6e8c4dc4-0b07-4b30-9c90-8f1cb6a3d757 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:28 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-2c08928f-7dd5-4414-a594-bb67ddfa1ed5 req-6e8c4dc4-0b07-4b30-9c90-8f1cb6a3d757 service nova] Creating event network-changed:a9320570-bc89-45b1-a97c-3da53f2e4b70 for instance 6930db7c-e8e0-4d1d-ac99-952827ff1aa9 on user Apr 19 14:53:28 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [req-2c08928f-7dd5-4414-a594-bb67ddfa1ed5 req-6e8c4dc4-0b07-4b30-9c90-8f1cb6a3d757 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030709 Apr 19 14:53:28 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 52/157] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:53:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:53:30 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-8ae93387-cf45-42de-9312-760381ffdf08 req-e983e036-0b7a-49b9-82a7-e2ea9e0297ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c330e74-9939-422b-88f6-1958857b6c41", "name": "network-vif-plugged", "status": "completed", "tag": "857c8812-0d5a-4ec9-b7a9-23592a1be890"}, {"server_uuid": "9c330e74-9939-422b-88f6-1958857b6c41", "name": "network-vif-plugged", "status": "completed", "tag": "857c8812-0d5a-4ec9-b7a9-23592a1be890"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:53:30 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-8ae93387-cf45-42de-9312-760381ffdf08 req-e983e036-0b7a-49b9-82a7-e2ea9e0297ab service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:30 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-8ae93387-cf45-42de-9312-760381ffdf08 req-e983e036-0b7a-49b9-82a7-e2ea9e0297ab service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:30 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-8ae93387-cf45-42de-9312-760381ffdf08 req-e983e036-0b7a-49b9-82a7-e2ea9e0297ab service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:30 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-8ae93387-cf45-42de-9312-760381ffdf08 req-e983e036-0b7a-49b9-82a7-e2ea9e0297ab service nova] Creating event network-vif-plugged:857c8812-0d5a-4ec9-b7a9-23592a1be890 for instance 9c330e74-9939-422b-88f6-1958857b6c41 on user Apr 19 14:53:30 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-8ae93387-cf45-42de-9312-760381ffdf08 req-e983e036-0b7a-49b9-82a7-e2ea9e0297ab service nova] Creating event network-vif-plugged:857c8812-0d5a-4ec9-b7a9-23592a1be890 for instance 9c330e74-9939-422b-88f6-1958857b6c41 on user Apr 19 14:53:30 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [req-8ae93387-cf45-42de-9312-760381ffdf08 req-e983e036-0b7a-49b9-82a7-e2ea9e0297ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032339 Apr 19 14:53:30 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 54/158] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:53:30 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:53:31 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [req-06b72fba-f254-4005-b2af-01fc37a2852f req-f8b55990-70dd-49db-851e-4fecafa83ffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6930db7c-e8e0-4d1d-ac99-952827ff1aa9", "name": "network-vif-plugged", "status": "completed", "tag": "a9320570-bc89-45b1-a97c-3da53f2e4b70"}]} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:53:31 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-06b72fba-f254-4005-b2af-01fc37a2852f req-f8b55990-70dd-49db-851e-4fecafa83ffc service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:31 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-06b72fba-f254-4005-b2af-01fc37a2852f req-f8b55990-70dd-49db-851e-4fecafa83ffc service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:31 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-06b72fba-f254-4005-b2af-01fc37a2852f req-f8b55990-70dd-49db-851e-4fecafa83ffc service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:31 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-06b72fba-f254-4005-b2af-01fc37a2852f req-f8b55990-70dd-49db-851e-4fecafa83ffc service nova] Creating event network-vif-plugged:a9320570-bc89-45b1-a97c-3da53f2e4b70 for instance 6930db7c-e8e0-4d1d-ac99-952827ff1aa9 on user Apr 19 14:53:31 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [req-06b72fba-f254-4005-b2af-01fc37a2852f req-f8b55990-70dd-49db-851e-4fecafa83ffc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038837 Apr 19 14:53:31 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 53/159] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:53:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:53:32 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-1d9b2ca5-f0ad-47f9-9564-23d9afe4a31a tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1961698390", "imageRef": "283dcfe8-75fd-4917-902e-1b940387187c", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "773ad771-04cd-4587-bc7e-10971f78fa84"}]}} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:53:32 user devstack@n-api.service[61254]: DEBUG nova.network.neutron [None req-1d9b2ca5-f0ad-47f9-9564-23d9afe4a31a tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] validate_networks() for [('773ad771-04cd-4587-bc7e-10971f78fa84', None, None, None, None, None)] {{(pid=61254) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 14:53:33 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-1d9b2ca5-f0ad-47f9-9564-23d9afe4a31a tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Flavor limits 0:0:0 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 14:53:33 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-1d9b2ca5-f0ad-47f9-9564-23d9afe4a31a tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Image limits 0:0:0 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 14:53:33 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-1d9b2ca5-f0ad-47f9-9564-23d9afe4a31a tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Flavor pref 0:0:0 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 14:53:33 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-1d9b2ca5-f0ad-47f9-9564-23d9afe4a31a tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Image pref 0:0:0 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 14:53:33 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-1d9b2ca5-f0ad-47f9-9564-23d9afe4a31a tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 14:53:33 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-1d9b2ca5-f0ad-47f9-9564-23d9afe4a31a tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:33 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-1d9b2ca5-f0ad-47f9-9564-23d9afe4a31a tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:33 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-1d9b2ca5-f0ad-47f9-9564-23d9afe4a31a tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:33 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-1d9b2ca5-f0ad-47f9-9564-23d9afe4a31a tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:33 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-1d9b2ca5-f0ad-47f9-9564-23d9afe4a31a tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:33 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-1d9b2ca5-f0ad-47f9-9564-23d9afe4a31a tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:33 user devstack@n-api.service[61254]: DEBUG nova.quota [None req-1d9b2ca5-f0ad-47f9-9564-23d9afe4a31a tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Getting quotas for project b1bc7474b840449da88a8f420316ecfb. Resources: {'ram', 'instances', 'cores'} {{(pid=61254) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:53:33 user devstack@n-api.service[61254]: DEBUG nova.quota [None req-1d9b2ca5-f0ad-47f9-9564-23d9afe4a31a tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Getting quotas for user b33dd700a9314ab9a70428a3455a571c and project b1bc7474b840449da88a8f420316ecfb. Resources: {'ram', 'instances', 'cores'} {{(pid=61254) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:53:33 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-1d9b2ca5-f0ad-47f9-9564-23d9afe4a31a tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Going to run 1 instances... {{(pid=61254) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 14:53:33 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-1d9b2ca5-f0ad-47f9-9564-23d9afe4a31a tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] [instance: 7211dfd3-7d44-4adf-acfc-6e4715ef7d69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61254) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 14:53:33 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-1d9b2ca5-f0ad-47f9-9564-23d9afe4a31a tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.560277 Apr 19 14:53:33 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 53/160] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 19 14:53:32 2023] POST /compute/v2.1/servers => generated 378 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 19 14:53:33 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-d3cfd6a2-cdab-42df-af3c-273adc7f5bee tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:53:33 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-d3cfd6a2-cdab-42df-af3c-273adc7f5bee tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] [instance: 7211dfd3-7d44-4adf-acfc-6e4715ef7d69] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:53:33 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-d3cfd6a2-cdab-42df-af3c-273adc7f5bee tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33dd700a9314ab9a70428a3455a571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bc7474b840449da88a8f420316ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:53:33 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-d3cfd6a2-cdab-42df-af3c-273adc7f5bee tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b33dd700a9314ab9a70428a3455a571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bc7474b840449da88a8f420316ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:53:33 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-d3cfd6a2-cdab-42df-af3c-273adc7f5bee tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b33dd700a9314ab9a70428a3455a571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bc7474b840449da88a8f420316ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:53:33 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-d3cfd6a2-cdab-42df-af3c-273adc7f5bee tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7211dfd3-7d44-4adf-acfc-6e4715ef7d69" status: 200 len: 1395 microversion: 2.87 time: 0.068948 Apr 19 14:53:33 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 55/161] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 14:53:33 2023] GET /compute/v2.1/servers/7211dfd3-7d44-4adf-acfc-6e4715ef7d69 => generated 1395 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 14:53:33 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [req-e5e50a21-b550-4c58-9d09-4736912a76fe req-6362df71-f19d-4406-a57b-40d948d32ea5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6930db7c-e8e0-4d1d-ac99-952827ff1aa9", "name": "network-vif-plugged", "status": "completed", "tag": "a9320570-bc89-45b1-a97c-3da53f2e4b70"}]} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:53:33 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-e5e50a21-b550-4c58-9d09-4736912a76fe req-6362df71-f19d-4406-a57b-40d948d32ea5 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:33 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-e5e50a21-b550-4c58-9d09-4736912a76fe req-6362df71-f19d-4406-a57b-40d948d32ea5 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:33 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-e5e50a21-b550-4c58-9d09-4736912a76fe req-6362df71-f19d-4406-a57b-40d948d32ea5 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:33 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-e5e50a21-b550-4c58-9d09-4736912a76fe req-6362df71-f19d-4406-a57b-40d948d32ea5 service nova] Creating event network-vif-plugged:a9320570-bc89-45b1-a97c-3da53f2e4b70 for instance 6930db7c-e8e0-4d1d-ac99-952827ff1aa9 on user Apr 19 14:53:33 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [req-e5e50a21-b550-4c58-9d09-4736912a76fe req-6362df71-f19d-4406-a57b-40d948d32ea5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033784 Apr 19 14:53:33 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 54/162] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:53:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:53:35 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [req-66493c70-e43f-41ee-bc98-7977ea3724c2 req-ea63a036-9f8f-4f4c-b6b9-ecd190909035 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7211dfd3-7d44-4adf-acfc-6e4715ef7d69", "tag": "9b4c6cb4-0f0e-4a8d-b827-6bb6a0ba3c61"}]} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:53:35 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-66493c70-e43f-41ee-bc98-7977ea3724c2 req-ea63a036-9f8f-4f4c-b6b9-ecd190909035 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:35 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-66493c70-e43f-41ee-bc98-7977ea3724c2 req-ea63a036-9f8f-4f4c-b6b9-ecd190909035 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:35 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-66493c70-e43f-41ee-bc98-7977ea3724c2 req-ea63a036-9f8f-4f4c-b6b9-ecd190909035 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:35 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-66493c70-e43f-41ee-bc98-7977ea3724c2 req-ea63a036-9f8f-4f4c-b6b9-ecd190909035 service nova] Creating event network-changed:9b4c6cb4-0f0e-4a8d-b827-6bb6a0ba3c61 for instance 7211dfd3-7d44-4adf-acfc-6e4715ef7d69 on user Apr 19 14:53:35 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [req-66493c70-e43f-41ee-bc98-7977ea3724c2 req-ea63a036-9f8f-4f4c-b6b9-ecd190909035 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032444 Apr 19 14:53:35 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 54/163] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:53:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:53:38 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-3263e80b-4fa5-49e9-8772-6052ce4c465a req-429d2717-9a52-4210-847b-dc61fe748d5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7211dfd3-7d44-4adf-acfc-6e4715ef7d69", "name": "network-vif-deleted", "tag": "9b4c6cb4-0f0e-4a8d-b827-6bb6a0ba3c61"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:53:38 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell0:SELECT=2 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:53:38 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-3263e80b-4fa5-49e9-8772-6052ce4c465a req-429d2717-9a52-4210-847b-dc61fe748d5f service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:38 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-3263e80b-4fa5-49e9-8772-6052ce4c465a req-429d2717-9a52-4210-847b-dc61fe748d5f service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:38 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-3263e80b-4fa5-49e9-8772-6052ce4c465a req-429d2717-9a52-4210-847b-dc61fe748d5f service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:38 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.compute.server_external_events [req-3263e80b-4fa5-49e9-8772-6052ce4c465a req-429d2717-9a52-4210-847b-dc61fe748d5f service nova] Unable to find a host for instance 7211dfd3-7d44-4adf-acfc-6e4715ef7d69. Dropping event network-vif-deleted {{(pid=61255) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 19 14:53:38 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [req-3263e80b-4fa5-49e9-8772-6052ce4c465a req-429d2717-9a52-4210-847b-dc61fe748d5f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.032371 Apr 19 14:53:38 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 56/164] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:53:38 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 19 14:53:47 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell0:SELECT=2 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:53:47 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_api:SELECT=9 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:53:47 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell1:SELECT=5 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:53:47 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-9da6aabd-2f0d-43fc-ac33-953d5c6e8ec6 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:53:47 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-9da6aabd-2f0d-43fc-ac33-953d5c6e8ec6 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] [instance: d5629772-08a7-4edb-acd5-4d92d8dbc48b] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:53:47 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-9da6aabd-2f0d-43fc-ac33-953d5c6e8ec6 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:47 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-9da6aabd-2f0d-43fc-ac33-953d5c6e8ec6 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:47 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-9da6aabd-2f0d-43fc-ac33-953d5c6e8ec6 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:47 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-9da6aabd-2f0d-43fc-ac33-953d5c6e8ec6 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:47 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-9da6aabd-2f0d-43fc-ac33-953d5c6e8ec6 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:47 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-9da6aabd-2f0d-43fc-ac33-953d5c6e8ec6 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:47 user devstack@n-api.service[61253]: INFO nova.api.openstack.wsgi [None req-9da6aabd-2f0d-43fc-ac33-953d5c6e8ec6 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] HTTP exception thrown: Instance d5629772-08a7-4edb-acd5-4d92d8dbc48b could not be found. Apr 19 14:53:47 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-9da6aabd-2f0d-43fc-ac33-953d5c6e8ec6 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Request method failure captured: Apr 19 14:53:47 user devstack@n-api.service[61253]: request: GET /compute/v2.1/servers/d5629772-08a7-4edb-acd5-4d92d8dbc48b HTTP/1.1 Apr 19 14:53:47 user devstack@n-api.service[61253]: Accept: application/json Apr 19 14:53:47 user devstack@n-api.service[61253]: Accept-Encoding: identity Apr 19 14:53:47 user devstack@n-api.service[61253]: Connection: close Apr 19 14:53:47 user devstack@n-api.service[61253]: Content-Length: 0 Apr 19 14:53:47 user devstack@n-api.service[61253]: Content-Type: application/json Apr 19 14:53:47 user devstack@n-api.service[61253]: Host: 10.0.0.210 Apr 19 14:53:47 user devstack@n-api.service[61253]: Openstack-System-Scope: None Apr 19 14:53:47 user devstack@n-api.service[61253]: User-Agent: python-urllib3/1.26.15 Apr 19 14:53:47 user devstack@n-api.service[61253]: X-Auth-Token: gAAAAABkP_-3h6LT7SJhUdbdTXkXOXJOWAibd_b8jLL6J5unR5r-yq5CH8aoOBnxkiOucRpdyV-IN3S9T-7hDh9IrAljN-XCczYI55by95g50ooAFrSihLZHKiiWxKaZnJAQ7uY4zgt2PEkf2Zj04ZGSC-_yKZ2ZIROC0CquDsxGzx7Q_MMmhIs Apr 19 14:53:47 user devstack@n-api.service[61253]: X-Domain-Id: None Apr 19 14:53:47 user devstack@n-api.service[61253]: X-Domain-Name: None Apr 19 14:53:47 user devstack@n-api.service[61253]: X-Identity-Status: Confirmed Apr 19 14:53:47 user devstack@n-api.service[61253]: X-Is-Admin-Project: True Apr 19 14:53:47 user devstack@n-api.service[61253]: X-Project-Domain-Id: default Apr 19 14:53:47 user devstack@n-api.service[61253]: X-Project-Domain-Name: Default Apr 19 14:53:47 user devstack@n-api.service[61253]: X-Project-Id: 8e931bbf53a24ad385fd4480c6e34c9e Apr 19 14:53:47 user devstack@n-api.service[61253]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-126974547 Apr 19 14:53:47 user devstack@n-api.service[61253]: X-Role: member,reader Apr 19 14:53:47 user devstack@n-api.service[61253]: X-Roles: member,reader Apr 19 14:53:47 user devstack@n-api.service[61253]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8e931bbf53a24ad385fd4480c6e34c9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8e931bbf53a24ad385fd4480c6e34c9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8e931bbf53a24ad385fd4480c6e34c9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 14:53:47 user devstack@n-api.service[61253]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-126974547 Apr 19 14:53:47 user devstack@n-api.service[61253]: X-Tenant-Id: 8e931bbf53a24ad385fd4480c6e34c9e Apr 19 14:53:47 user devstack@n-api.service[61253]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-126974547 Apr 19 14:53:47 user devstack@n-api.service[61253]: X-User: tempest-AttachSCSIVolumeTestJSON-126974547-project-member Apr 19 14:53:47 user devstack@n-api.service[61253]: X-User-Domain-Id: default Apr 19 14:53:47 user devstack@n-api.service[61253]: X-User-Domain-Name: Default Apr 19 14:53:47 user devstack@n-api.service[61253]: X-User-Id: f959bfd4235e48b89b84317f32887eb8 Apr 19 14:53:47 user devstack@n-api.service[61253]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-126974547-project-member Apr 19 14:53:47 user devstack@n-api.service[61253]: method: > Apr 19 14:53:47 user devstack@n-api.service[61253]: exception: Instance d5629772-08a7-4edb-acd5-4d92d8dbc48b could not be found. Apr 19 14:53:47 user devstack@n-api.service[61253]: action_args: {'id': 'd5629772-08a7-4edb-acd5-4d92d8dbc48b'} Apr 19 14:53:47 user devstack@n-api.service[61253]: {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:53:47 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:53:47 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:53:47 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:53:47 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:53:47 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:53:47 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:53:47 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:53:47 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:53:47 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:53:47 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5629772-08a7-4edb-acd5-4d92d8dbc48b could not be found. Apr 19 14:53:47 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 14:53:47 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:53:47 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 14:53:47 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:53:47 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:53:47 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:53:47 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:53:47 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:53:47 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:53:47 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:53:47 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:53:47 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:53:47 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:53:47 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:53:47 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:53:47 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:53:47 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5629772-08a7-4edb-acd5-4d92d8dbc48b could not be found. Apr 19 14:53:47 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 14:53:47 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:53:47 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 14:53:47 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:53:47 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:53:47 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:53:47 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:53:47 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:53:47 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5629772-08a7-4edb-acd5-4d92d8dbc48b could not be found. Apr 19 14:53:47 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 14:53:47 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-9da6aabd-2f0d-43fc-ac33-953d5c6e8ec6 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Returning 404 to user: Instance d5629772-08a7-4edb-acd5-4d92d8dbc48b could not be found. {{(pid=61253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:53:47 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-9da6aabd-2f0d-43fc-ac33-953d5c6e8ec6 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d5629772-08a7-4edb-acd5-4d92d8dbc48b" status: 404 len: 111 microversion: 2.1 time: 0.050816 Apr 19 14:53:47 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 55/165] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:53:47 2023] GET /compute/v2.1/servers/d5629772-08a7-4edb-acd5-4d92d8dbc48b => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:53:47 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell0:SELECT=4 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:53:47 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell0:SELECT=12 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:53:47 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=6 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:53:47 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell1:SELECT=38 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:53:47 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-90b19736-32be-4d70-bc09-c49bb186a2d1 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Calling method '.version_select at 0x7f3cfa94b520>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:53:47 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-90b19736-32be-4d70-bc09-c49bb186a2d1 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-743362310" status: 202 len: 0 microversion: 2.1 time: 0.053563 Apr 19 14:53:47 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 55/166] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 19 14:53:47 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-743362310 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 14:53:48 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-74fcee57-30fc-4630-af6d-2cd205ce6b26 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:53:48 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-74fcee57-30fc-4630-af6d-2cd205ce6b26 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] [instance: d5629772-08a7-4edb-acd5-4d92d8dbc48b] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:53:48 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell0:SELECT=10 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:53:48 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:53:48 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-74fcee57-30fc-4630-af6d-2cd205ce6b26 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:48 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-74fcee57-30fc-4630-af6d-2cd205ce6b26 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:48 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-74fcee57-30fc-4630-af6d-2cd205ce6b26 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:48 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-74fcee57-30fc-4630-af6d-2cd205ce6b26 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:48 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-74fcee57-30fc-4630-af6d-2cd205ce6b26 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:48 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-74fcee57-30fc-4630-af6d-2cd205ce6b26 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:48 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:53:48 user devstack@n-api.service[61255]: INFO nova.api.openstack.wsgi [None req-74fcee57-30fc-4630-af6d-2cd205ce6b26 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] HTTP exception thrown: Instance d5629772-08a7-4edb-acd5-4d92d8dbc48b could not be found. Apr 19 14:53:48 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-74fcee57-30fc-4630-af6d-2cd205ce6b26 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Request method failure captured: Apr 19 14:53:48 user devstack@n-api.service[61255]: request: DELETE /compute/v2.1/servers/d5629772-08a7-4edb-acd5-4d92d8dbc48b HTTP/1.1 Apr 19 14:53:48 user devstack@n-api.service[61255]: Accept: application/json Apr 19 14:53:48 user devstack@n-api.service[61255]: Accept-Encoding: identity Apr 19 14:53:48 user devstack@n-api.service[61255]: Connection: close Apr 19 14:53:48 user devstack@n-api.service[61255]: Content-Length: 0 Apr 19 14:53:48 user devstack@n-api.service[61255]: Content-Type: application/json Apr 19 14:53:48 user devstack@n-api.service[61255]: Host: 10.0.0.210 Apr 19 14:53:48 user devstack@n-api.service[61255]: Openstack-System-Scope: None Apr 19 14:53:48 user devstack@n-api.service[61255]: User-Agent: python-urllib3/1.26.15 Apr 19 14:53:48 user devstack@n-api.service[61255]: X-Auth-Token: gAAAAABkP_-3h6LT7SJhUdbdTXkXOXJOWAibd_b8jLL6J5unR5r-yq5CH8aoOBnxkiOucRpdyV-IN3S9T-7hDh9IrAljN-XCczYI55by95g50ooAFrSihLZHKiiWxKaZnJAQ7uY4zgt2PEkf2Zj04ZGSC-_yKZ2ZIROC0CquDsxGzx7Q_MMmhIs Apr 19 14:53:48 user devstack@n-api.service[61255]: X-Domain-Id: None Apr 19 14:53:48 user devstack@n-api.service[61255]: X-Domain-Name: None Apr 19 14:53:48 user devstack@n-api.service[61255]: X-Identity-Status: Confirmed Apr 19 14:53:48 user devstack@n-api.service[61255]: X-Is-Admin-Project: True Apr 19 14:53:48 user devstack@n-api.service[61255]: X-Project-Domain-Id: default Apr 19 14:53:48 user devstack@n-api.service[61255]: X-Project-Domain-Name: Default Apr 19 14:53:48 user devstack@n-api.service[61255]: X-Project-Id: 8e931bbf53a24ad385fd4480c6e34c9e Apr 19 14:53:48 user devstack@n-api.service[61255]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-126974547 Apr 19 14:53:48 user devstack@n-api.service[61255]: X-Role: member,reader Apr 19 14:53:48 user devstack@n-api.service[61255]: X-Roles: member,reader Apr 19 14:53:48 user devstack@n-api.service[61255]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8e931bbf53a24ad385fd4480c6e34c9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8e931bbf53a24ad385fd4480c6e34c9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8e931bbf53a24ad385fd4480c6e34c9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 14:53:48 user devstack@n-api.service[61255]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-126974547 Apr 19 14:53:48 user devstack@n-api.service[61255]: X-Tenant-Id: 8e931bbf53a24ad385fd4480c6e34c9e Apr 19 14:53:48 user devstack@n-api.service[61255]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-126974547 Apr 19 14:53:48 user devstack@n-api.service[61255]: X-User: tempest-AttachSCSIVolumeTestJSON-126974547-project-member Apr 19 14:53:48 user devstack@n-api.service[61255]: X-User-Domain-Id: default Apr 19 14:53:48 user devstack@n-api.service[61255]: X-User-Domain-Name: Default Apr 19 14:53:48 user devstack@n-api.service[61255]: X-User-Id: f959bfd4235e48b89b84317f32887eb8 Apr 19 14:53:48 user devstack@n-api.service[61255]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-126974547-project-member Apr 19 14:53:48 user devstack@n-api.service[61255]: method: > Apr 19 14:53:48 user devstack@n-api.service[61255]: exception: Instance d5629772-08a7-4edb-acd5-4d92d8dbc48b could not be found. Apr 19 14:53:48 user devstack@n-api.service[61255]: action_args: {'id': 'd5629772-08a7-4edb-acd5-4d92d8dbc48b'} Apr 19 14:53:48 user devstack@n-api.service[61255]: {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:53:48 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:53:48 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:53:48 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:53:48 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:53:48 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:53:48 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:53:48 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:53:48 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:53:48 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:53:48 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5629772-08a7-4edb-acd5-4d92d8dbc48b could not be found. Apr 19 14:53:48 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:53:48 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:53:48 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:53:48 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:53:48 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:53:48 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:53:48 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:53:48 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:53:48 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:53:48 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:53:48 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 19 14:53:48 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 19 14:53:48 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 19 14:53:48 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 19 14:53:48 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:53:48 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:53:48 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:53:48 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:53:48 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5629772-08a7-4edb-acd5-4d92d8dbc48b could not be found. Apr 19 14:53:48 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:53:48 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:53:48 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:53:48 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:53:48 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:53:48 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:53:48 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:53:48 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:53:48 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5629772-08a7-4edb-acd5-4d92d8dbc48b could not be found. Apr 19 14:53:48 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:53:48 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-74fcee57-30fc-4630-af6d-2cd205ce6b26 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Returning 404 to user: Instance d5629772-08a7-4edb-acd5-4d92d8dbc48b could not be found. {{(pid=61255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:53:48 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-74fcee57-30fc-4630-af6d-2cd205ce6b26 tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d5629772-08a7-4edb-acd5-4d92d8dbc48b" status: 404 len: 111 microversion: 2.1 time: 0.040186 Apr 19 14:53:48 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 57/167] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 14:53:48 2023] DELETE /compute/v2.1/servers/d5629772-08a7-4edb-acd5-4d92d8dbc48b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:53:48 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-e8cb3a86-c148-44b5-b662-6fee54c9828c tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:53:48 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-e8cb3a86-c148-44b5-b662-6fee54c9828c tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] [instance: d5629772-08a7-4edb-acd5-4d92d8dbc48b] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:53:48 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-e8cb3a86-c148-44b5-b662-6fee54c9828c tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:48 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-e8cb3a86-c148-44b5-b662-6fee54c9828c tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:48 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-e8cb3a86-c148-44b5-b662-6fee54c9828c tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:48 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-e8cb3a86-c148-44b5-b662-6fee54c9828c tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:48 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-e8cb3a86-c148-44b5-b662-6fee54c9828c tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:48 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-e8cb3a86-c148-44b5-b662-6fee54c9828c tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:48 user devstack@n-api.service[61253]: INFO nova.api.openstack.wsgi [None req-e8cb3a86-c148-44b5-b662-6fee54c9828c tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] HTTP exception thrown: Instance d5629772-08a7-4edb-acd5-4d92d8dbc48b could not be found. Apr 19 14:53:48 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-e8cb3a86-c148-44b5-b662-6fee54c9828c tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Request method failure captured: Apr 19 14:53:48 user devstack@n-api.service[61253]: request: GET /compute/v2.1/servers/d5629772-08a7-4edb-acd5-4d92d8dbc48b HTTP/1.1 Apr 19 14:53:48 user devstack@n-api.service[61253]: Accept: application/json Apr 19 14:53:48 user devstack@n-api.service[61253]: Accept-Encoding: identity Apr 19 14:53:48 user devstack@n-api.service[61253]: Connection: close Apr 19 14:53:48 user devstack@n-api.service[61253]: Content-Length: 0 Apr 19 14:53:48 user devstack@n-api.service[61253]: Content-Type: application/json Apr 19 14:53:48 user devstack@n-api.service[61253]: Host: 10.0.0.210 Apr 19 14:53:48 user devstack@n-api.service[61253]: Openstack-System-Scope: None Apr 19 14:53:48 user devstack@n-api.service[61253]: User-Agent: python-urllib3/1.26.15 Apr 19 14:53:48 user devstack@n-api.service[61253]: X-Auth-Token: gAAAAABkP_-3h6LT7SJhUdbdTXkXOXJOWAibd_b8jLL6J5unR5r-yq5CH8aoOBnxkiOucRpdyV-IN3S9T-7hDh9IrAljN-XCczYI55by95g50ooAFrSihLZHKiiWxKaZnJAQ7uY4zgt2PEkf2Zj04ZGSC-_yKZ2ZIROC0CquDsxGzx7Q_MMmhIs Apr 19 14:53:48 user devstack@n-api.service[61253]: X-Domain-Id: None Apr 19 14:53:48 user devstack@n-api.service[61253]: X-Domain-Name: None Apr 19 14:53:48 user devstack@n-api.service[61253]: X-Identity-Status: Confirmed Apr 19 14:53:48 user devstack@n-api.service[61253]: X-Is-Admin-Project: True Apr 19 14:53:48 user devstack@n-api.service[61253]: X-Project-Domain-Id: default Apr 19 14:53:48 user devstack@n-api.service[61253]: X-Project-Domain-Name: Default Apr 19 14:53:48 user devstack@n-api.service[61253]: X-Project-Id: 8e931bbf53a24ad385fd4480c6e34c9e Apr 19 14:53:48 user devstack@n-api.service[61253]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-126974547 Apr 19 14:53:48 user devstack@n-api.service[61253]: X-Role: member,reader Apr 19 14:53:48 user devstack@n-api.service[61253]: X-Roles: member,reader Apr 19 14:53:48 user devstack@n-api.service[61253]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8e931bbf53a24ad385fd4480c6e34c9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8e931bbf53a24ad385fd4480c6e34c9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8e931bbf53a24ad385fd4480c6e34c9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 14:53:48 user devstack@n-api.service[61253]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-126974547 Apr 19 14:53:48 user devstack@n-api.service[61253]: X-Tenant-Id: 8e931bbf53a24ad385fd4480c6e34c9e Apr 19 14:53:48 user devstack@n-api.service[61253]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-126974547 Apr 19 14:53:48 user devstack@n-api.service[61253]: X-User: tempest-AttachSCSIVolumeTestJSON-126974547-project-member Apr 19 14:53:48 user devstack@n-api.service[61253]: X-User-Domain-Id: default Apr 19 14:53:48 user devstack@n-api.service[61253]: X-User-Domain-Name: Default Apr 19 14:53:48 user devstack@n-api.service[61253]: X-User-Id: f959bfd4235e48b89b84317f32887eb8 Apr 19 14:53:48 user devstack@n-api.service[61253]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-126974547-project-member Apr 19 14:53:48 user devstack@n-api.service[61253]: method: > Apr 19 14:53:48 user devstack@n-api.service[61253]: exception: Instance d5629772-08a7-4edb-acd5-4d92d8dbc48b could not be found. Apr 19 14:53:48 user devstack@n-api.service[61253]: action_args: {'id': 'd5629772-08a7-4edb-acd5-4d92d8dbc48b'} Apr 19 14:53:48 user devstack@n-api.service[61253]: {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:53:48 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:53:48 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:53:48 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:53:48 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:53:48 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:53:48 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:53:48 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:53:48 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:53:48 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:53:48 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5629772-08a7-4edb-acd5-4d92d8dbc48b could not be found. Apr 19 14:53:48 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 14:53:48 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:53:48 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 14:53:48 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:53:48 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:53:48 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:53:48 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:53:48 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:53:48 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:53:48 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:53:48 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:53:48 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:53:48 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:53:48 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:53:48 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:53:48 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:53:48 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5629772-08a7-4edb-acd5-4d92d8dbc48b could not be found. Apr 19 14:53:48 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 14:53:48 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:53:48 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 14:53:48 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:53:48 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:53:48 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:53:48 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:53:48 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:53:48 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5629772-08a7-4edb-acd5-4d92d8dbc48b could not be found. Apr 19 14:53:48 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 14:53:48 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-e8cb3a86-c148-44b5-b662-6fee54c9828c tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] Returning 404 to user: Instance d5629772-08a7-4edb-acd5-4d92d8dbc48b could not be found. {{(pid=61253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:53:48 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-e8cb3a86-c148-44b5-b662-6fee54c9828c tempest-AttachSCSIVolumeTestJSON-126974547 tempest-AttachSCSIVolumeTestJSON-126974547-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d5629772-08a7-4edb-acd5-4d92d8dbc48b" status: 404 len: 111 microversion: 2.1 time: 0.029732 Apr 19 14:53:48 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 56/168] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:53:48 2023] GET /compute/v2.1/servers/d5629772-08a7-4edb-acd5-4d92d8dbc48b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:53:49 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-e38ae197-cb00-41b7-82c2-15bcb78d59d8 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:53:49 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-e38ae197-cb00-41b7-82c2-15bcb78d59d8 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] [instance: 0a8c97e3-3c9e-4a4a-bc86-ee3c313cb1d3] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:53:49 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-e38ae197-cb00-41b7-82c2-15bcb78d59d8 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:49 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-e38ae197-cb00-41b7-82c2-15bcb78d59d8 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:49 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-e38ae197-cb00-41b7-82c2-15bcb78d59d8 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:49 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-e38ae197-cb00-41b7-82c2-15bcb78d59d8 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:53:49 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-e38ae197-cb00-41b7-82c2-15bcb78d59d8 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:53:49 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-e38ae197-cb00-41b7-82c2-15bcb78d59d8 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:53:50 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-e38ae197-cb00-41b7-82c2-15bcb78d59d8 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708068c5f6f5451fbcd6c24235a185d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da86be1a28254582b530973fbf7f724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:53:50 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-e38ae197-cb00-41b7-82c2-15bcb78d59d8 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0a8c97e3-3c9e-4a4a-bc86-ee3c313cb1d3" status: 200 len: 1497 microversion: 2.1 time: 0.351922 Apr 19 14:53:50 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 56/169] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:53:49 2023] GET /compute/v2.1/servers/0a8c97e3-3c9e-4a4a-bc86-ee3c313cb1d3 => generated 1497 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:54:01 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_api:SELECT=1 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:54:01 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell1:SELECT=1 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:54:01 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-ac03e8be-266e-4cff-8221-da663d663148 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Action: 'create', calling method: .version_select at 0x7f3cfa9c01f0>, body: {"keypair": {"name": "tempest-keypair-786936530", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRF9Vq9Bpy75/WYoCZzuPFgtzAR+X5onVVNjSyqM0BI6eKJsQD976wz4UuEoNRYN10FgF7yPzh/4ew6E2XnJM46mXnwbfGtM93W+HLifud2cDL2oMHuTMlCmv7KNnk7zg=="}} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:54:02 user devstack@n-api.service[61255]: DEBUG nova.quota [None req-ac03e8be-266e-4cff-8221-da663d663148 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Getting quotas for project 9a5079ce8a52417fb2b8b8122bfeaa5e. Resources: {'key_pairs'} {{(pid=61255) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:54:02 user devstack@n-api.service[61255]: DEBUG nova.quota [None req-ac03e8be-266e-4cff-8221-da663d663148 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Getting quotas for user 35b23f0d7300496990e74b2fb4945c15 and project 9a5079ce8a52417fb2b8b8122bfeaa5e. Resources: {'key_pairs'} {{(pid=61255) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:54:02 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-ac03e8be-266e-4cff-8221-da663d663148 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.149256 Apr 19 14:54:02 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 58/170] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 14:54:01 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:54:03 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-5d95092b-893a-4f28-a612-fc6bfb8b2f1d tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1802607696", "imageRef": "283dcfe8-75fd-4917-902e-1b940387187c", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "c9614385-ce43-416a-aeee-94db7fe5338e"}], "security_groups": [{"name": "tempest-securitygroup--427790850"}], "key_name": "tempest-keypair-786936530", "user_data": "}} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:54:03 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_api:SELECT=4 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:54:03 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell1:SELECT=4 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:54:03 user devstack@n-api.service[61253]: DEBUG nova.network.neutron [None req-5d95092b-893a-4f28-a612-fc6bfb8b2f1d tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] validate_networks() for [('c9614385-ce43-416a-aeee-94db7fe5338e', None, None, None, None, None)] {{(pid=61253) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 14:54:04 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-5d95092b-893a-4f28-a612-fc6bfb8b2f1d tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Flavor limits 0:0:0 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 14:54:04 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-5d95092b-893a-4f28-a612-fc6bfb8b2f1d tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Image limits 0:0:0 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 14:54:04 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-5d95092b-893a-4f28-a612-fc6bfb8b2f1d tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Flavor pref 0:0:0 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 14:54:04 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-5d95092b-893a-4f28-a612-fc6bfb8b2f1d tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Image pref 0:0:0 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 14:54:04 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-5d95092b-893a-4f28-a612-fc6bfb8b2f1d tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 14:54:04 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-5d95092b-893a-4f28-a612-fc6bfb8b2f1d tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:04 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-5d95092b-893a-4f28-a612-fc6bfb8b2f1d tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:04 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-5d95092b-893a-4f28-a612-fc6bfb8b2f1d tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:04 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-5d95092b-893a-4f28-a612-fc6bfb8b2f1d tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:04 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-5d95092b-893a-4f28-a612-fc6bfb8b2f1d tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:04 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-5d95092b-893a-4f28-a612-fc6bfb8b2f1d tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:04 user devstack@n-api.service[61253]: DEBUG nova.quota [None req-5d95092b-893a-4f28-a612-fc6bfb8b2f1d tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Getting quotas for project 9a5079ce8a52417fb2b8b8122bfeaa5e. Resources: {'ram', 'instances', 'cores'} {{(pid=61253) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:54:04 user devstack@n-api.service[61253]: DEBUG nova.quota [None req-5d95092b-893a-4f28-a612-fc6bfb8b2f1d tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Getting quotas for user 35b23f0d7300496990e74b2fb4945c15 and project 9a5079ce8a52417fb2b8b8122bfeaa5e. Resources: {'ram', 'instances', 'cores'} {{(pid=61253) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:54:04 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-5d95092b-893a-4f28-a612-fc6bfb8b2f1d tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Going to run 1 instances... {{(pid=61253) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 14:54:04 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-5d95092b-893a-4f28-a612-fc6bfb8b2f1d tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] [instance: ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='283dcfe8-75fd-4917-902e-1b940387187c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61253) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 14:54:04 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-5d95092b-893a-4f28-a612-fc6bfb8b2f1d tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 1.005842 Apr 19 14:54:04 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 57/171] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 14:54:03 2023] POST /compute/v2.1/servers => generated 399 bytes in 1007 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 14:54:04 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-53387227-6400-46bd-9f1d-319aa88fcf1a tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:54:04 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-53387227-6400-46bd-9f1d-319aa88fcf1a tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] [instance: ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:54:04 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:54:04 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell1:SELECT=6 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:54:04 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-53387227-6400-46bd-9f1d-319aa88fcf1a tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b23f0d7300496990e74b2fb4945c15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5079ce8a52417fb2b8b8122bfeaa5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:54:04 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-53387227-6400-46bd-9f1d-319aa88fcf1a tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084" status: 200 len: 1235 microversion: 2.1 time: 0.065786 Apr 19 14:54:04 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 57/172] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:54:04 2023] GET /compute/v2.1/servers/ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084 => generated 1235 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:54:06 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-c912e17a-5cc7-4fa2-be9f-1fb9d3d99268 req-301ee469-1f70-45d0-8a48-f77e0dc898c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084", "tag": "4f5f9b2b-57b0-4c33-8f63-bac94722e9d0"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:54:06 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-c912e17a-5cc7-4fa2-be9f-1fb9d3d99268 req-301ee469-1f70-45d0-8a48-f77e0dc898c6 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:06 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-c912e17a-5cc7-4fa2-be9f-1fb9d3d99268 req-301ee469-1f70-45d0-8a48-f77e0dc898c6 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:06 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-c912e17a-5cc7-4fa2-be9f-1fb9d3d99268 req-301ee469-1f70-45d0-8a48-f77e0dc898c6 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:07 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-c912e17a-5cc7-4fa2-be9f-1fb9d3d99268 req-301ee469-1f70-45d0-8a48-f77e0dc898c6 service nova] Creating event network-changed:4f5f9b2b-57b0-4c33-8f63-bac94722e9d0 for instance ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084 on user Apr 19 14:54:07 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [req-c912e17a-5cc7-4fa2-be9f-1fb9d3d99268 req-301ee469-1f70-45d0-8a48-f77e0dc898c6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031571 Apr 19 14:54:07 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 59/173] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:54:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:54:07 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-8fd111a2-aa1c-4db0-9879-cf22e0746718 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:54:07 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-8fd111a2-aa1c-4db0-9879-cf22e0746718 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] [instance: 9fee43ad-330a-45d7-9374-07feefcf9e14] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:54:07 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-8fd111a2-aa1c-4db0-9879-cf22e0746718 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:07 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-8fd111a2-aa1c-4db0-9879-cf22e0746718 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:07 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-8fd111a2-aa1c-4db0-9879-cf22e0746718 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:07 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-8fd111a2-aa1c-4db0-9879-cf22e0746718 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:07 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-8fd111a2-aa1c-4db0-9879-cf22e0746718 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:07 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-8fd111a2-aa1c-4db0-9879-cf22e0746718 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:07 user devstack@n-api.service[61253]: DEBUG nova.policy [None req-8fd111a2-aa1c-4db0-9879-cf22e0746718 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aab0b2e3424d80852e588323f187bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dbf312f7154ce1ae7fc1403947d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61253) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:54:07 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-8fd111a2-aa1c-4db0-9879-cf22e0746718 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9fee43ad-330a-45d7-9374-07feefcf9e14" status: 200 len: 1658 microversion: 2.1 time: 0.345451 Apr 19 14:54:07 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 58/174] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:54:07 2023] GET /compute/v2.1/servers/9fee43ad-330a-45d7-9374-07feefcf9e14 => generated 1658 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:54:07 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-d19071b0-1b80-474d-aa5b-ce643dd4b24b tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:54:07 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-d19071b0-1b80-474d-aa5b-ce643dd4b24b tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] [instance: 9fee43ad-330a-45d7-9374-07feefcf9e14] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:54:07 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-d19071b0-1b80-474d-aa5b-ce643dd4b24b tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:07 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-d19071b0-1b80-474d-aa5b-ce643dd4b24b tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:07 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-d19071b0-1b80-474d-aa5b-ce643dd4b24b tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:07 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-d19071b0-1b80-474d-aa5b-ce643dd4b24b tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:07 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-d19071b0-1b80-474d-aa5b-ce643dd4b24b tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:07 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-d19071b0-1b80-474d-aa5b-ce643dd4b24b tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:07 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-d19071b0-1b80-474d-aa5b-ce643dd4b24b tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aab0b2e3424d80852e588323f187bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dbf312f7154ce1ae7fc1403947d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:54:07 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-d19071b0-1b80-474d-aa5b-ce643dd4b24b tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9fee43ad-330a-45d7-9374-07feefcf9e14" status: 200 len: 1658 microversion: 2.1 time: 0.268730 Apr 19 14:54:07 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 58/175] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:54:07 2023] GET /compute/v2.1/servers/9fee43ad-330a-45d7-9374-07feefcf9e14 => generated 1658 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:54:08 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-b7556030-0124-4ed0-9693-3764cd8b8f06 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:54:08 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-b7556030-0124-4ed0-9693-3764cd8b8f06 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] [instance: 22962ccc-a7a7-410e-9042-7f01424d38a6] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:54:08 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-b7556030-0124-4ed0-9693-3764cd8b8f06 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:08 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-b7556030-0124-4ed0-9693-3764cd8b8f06 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:08 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-b7556030-0124-4ed0-9693-3764cd8b8f06 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:08 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-b7556030-0124-4ed0-9693-3764cd8b8f06 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:08 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-b7556030-0124-4ed0-9693-3764cd8b8f06 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:08 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-b7556030-0124-4ed0-9693-3764cd8b8f06 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:08 user devstack@n-api.service[61255]: INFO nova.api.openstack.wsgi [None req-b7556030-0124-4ed0-9693-3764cd8b8f06 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] HTTP exception thrown: Instance 22962ccc-a7a7-410e-9042-7f01424d38a6 could not be found. Apr 19 14:54:08 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-b7556030-0124-4ed0-9693-3764cd8b8f06 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Request method failure captured: Apr 19 14:54:08 user devstack@n-api.service[61255]: request: GET /compute/v2.1/servers/22962ccc-a7a7-410e-9042-7f01424d38a6 HTTP/1.1 Apr 19 14:54:08 user devstack@n-api.service[61255]: Accept: application/json Apr 19 14:54:08 user devstack@n-api.service[61255]: Accept-Encoding: identity Apr 19 14:54:08 user devstack@n-api.service[61255]: Connection: close Apr 19 14:54:08 user devstack@n-api.service[61255]: Content-Length: 0 Apr 19 14:54:08 user devstack@n-api.service[61255]: Content-Type: application/json Apr 19 14:54:08 user devstack@n-api.service[61255]: Host: 10.0.0.210 Apr 19 14:54:08 user devstack@n-api.service[61255]: Openstack-System-Scope: None Apr 19 14:54:08 user devstack@n-api.service[61255]: User-Agent: python-urllib3/1.26.15 Apr 19 14:54:08 user devstack@n-api.service[61255]: X-Auth-Token: gAAAAABkP__nBc-ul2ufoIQ-8a_Y4r9ASP1GRxqxQT3qVrql0XilsRYx4mIkZNYlsOoIwBwsX-ssFI74wD4GjeHqArwF2sBQ688xnYvSvWU9BDPO0yM1Q2bDGkmbK6UbCvuk3t44otfV4zsHNr3E5-JFvwI1Ati_9EKl_KmECWXEf0mzig4GctY Apr 19 14:54:08 user devstack@n-api.service[61255]: X-Domain-Id: None Apr 19 14:54:08 user devstack@n-api.service[61255]: X-Domain-Name: None Apr 19 14:54:08 user devstack@n-api.service[61255]: X-Identity-Status: Confirmed Apr 19 14:54:08 user devstack@n-api.service[61255]: X-Is-Admin-Project: True Apr 19 14:54:08 user devstack@n-api.service[61255]: X-Project-Domain-Id: default Apr 19 14:54:08 user devstack@n-api.service[61255]: X-Project-Domain-Name: Default Apr 19 14:54:08 user devstack@n-api.service[61255]: X-Project-Id: 5383c493e2f049fc9dc06818cb00a6f2 Apr 19 14:54:08 user devstack@n-api.service[61255]: X-Project-Name: tempest-AttachVolumeTestJSON-605670681 Apr 19 14:54:08 user devstack@n-api.service[61255]: X-Role: member,reader Apr 19 14:54:08 user devstack@n-api.service[61255]: X-Roles: member,reader Apr 19 14:54:08 user devstack@n-api.service[61255]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5383c493e2f049fc9dc06818cb00a6f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5383c493e2f049fc9dc06818cb00a6f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5383c493e2f049fc9dc06818cb00a6f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 14:54:08 user devstack@n-api.service[61255]: X-Tenant: tempest-AttachVolumeTestJSON-605670681 Apr 19 14:54:08 user devstack@n-api.service[61255]: X-Tenant-Id: 5383c493e2f049fc9dc06818cb00a6f2 Apr 19 14:54:08 user devstack@n-api.service[61255]: X-Tenant-Name: tempest-AttachVolumeTestJSON-605670681 Apr 19 14:54:08 user devstack@n-api.service[61255]: X-User: tempest-AttachVolumeTestJSON-605670681-project-member Apr 19 14:54:08 user devstack@n-api.service[61255]: X-User-Domain-Id: default Apr 19 14:54:08 user devstack@n-api.service[61255]: X-User-Domain-Name: Default Apr 19 14:54:08 user devstack@n-api.service[61255]: X-User-Id: fab5193fb1ec41b8a19e8621843a54a7 Apr 19 14:54:08 user devstack@n-api.service[61255]: X-User-Name: tempest-AttachVolumeTestJSON-605670681-project-member Apr 19 14:54:08 user devstack@n-api.service[61255]: method: > Apr 19 14:54:08 user devstack@n-api.service[61255]: exception: Instance 22962ccc-a7a7-410e-9042-7f01424d38a6 could not be found. Apr 19 14:54:08 user devstack@n-api.service[61255]: action_args: {'id': '22962ccc-a7a7-410e-9042-7f01424d38a6'} Apr 19 14:54:08 user devstack@n-api.service[61255]: {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:54:08 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:54:08 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:54:08 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:54:08 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:54:08 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:54:08 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:54:08 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:54:08 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:54:08 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:54:08 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22962ccc-a7a7-410e-9042-7f01424d38a6 could not be found. Apr 19 14:54:08 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:54:08 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:54:08 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:54:08 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:54:08 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:54:08 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:54:08 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:54:08 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:54:08 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:54:08 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:54:08 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:54:08 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:54:08 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:54:08 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:54:08 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:54:08 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:54:08 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22962ccc-a7a7-410e-9042-7f01424d38a6 could not be found. Apr 19 14:54:08 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:54:08 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:54:08 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:54:08 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:54:08 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:54:08 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:54:08 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:54:08 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:54:08 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22962ccc-a7a7-410e-9042-7f01424d38a6 could not be found. Apr 19 14:54:08 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:54:08 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-b7556030-0124-4ed0-9693-3764cd8b8f06 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Returning 404 to user: Instance 22962ccc-a7a7-410e-9042-7f01424d38a6 could not be found. {{(pid=61255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:54:08 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-b7556030-0124-4ed0-9693-3764cd8b8f06 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22962ccc-a7a7-410e-9042-7f01424d38a6" status: 404 len: 111 microversion: 2.1 time: 0.030797 Apr 19 14:54:08 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 60/176] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:54:08 2023] GET /compute/v2.1/servers/22962ccc-a7a7-410e-9042-7f01424d38a6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:54:08 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-3e3d629b-2780-45d0-acab-6d406a87f82f tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Calling method '.version_select at 0x7f3cfa90f5b0>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:54:08 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-3e3d629b-2780-45d0-acab-6d406a87f82f tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-805315041" status: 202 len: 0 microversion: 2.1 time: 0.036556 Apr 19 14:54:08 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 59/177] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 19 14:54:08 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-805315041 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 14:54:09 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [req-639e2b5d-aa2d-4b50-9663-819fa02678c7 req-7b4dcdec-9815-486f-bc21-a12d65a5c42d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084", "name": "network-vif-plugged", "status": "completed", "tag": "4f5f9b2b-57b0-4c33-8f63-bac94722e9d0"}]} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:54:09 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-639e2b5d-aa2d-4b50-9663-819fa02678c7 req-7b4dcdec-9815-486f-bc21-a12d65a5c42d service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:09 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-639e2b5d-aa2d-4b50-9663-819fa02678c7 req-7b4dcdec-9815-486f-bc21-a12d65a5c42d service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:09 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-639e2b5d-aa2d-4b50-9663-819fa02678c7 req-7b4dcdec-9815-486f-bc21-a12d65a5c42d service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:09 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-639e2b5d-aa2d-4b50-9663-819fa02678c7 req-7b4dcdec-9815-486f-bc21-a12d65a5c42d service nova] Creating event network-vif-plugged:4f5f9b2b-57b0-4c33-8f63-bac94722e9d0 for instance ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084 on user Apr 19 14:54:09 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-ef3830e4-82a2-416f-9969-2373c4fb69a3 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Action: 'create', calling method: .version_select at 0x7f3cfb4e3eb0>, body: {"keypair": {"name": "tempest-keypair-144624132", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbr7AitAfPAoPVlBRKQIHQSBA+AOHZRfLsT8X6QKlQZ4/v4vGmkf43mkcJJr8Y+INLAyzHSM5MmOcnizxybSB7iCKOytFSA24cuSI7Wkj9fZOjueIh5k7pFLKOAIgiMJw=="}} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:54:09 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [req-639e2b5d-aa2d-4b50-9663-819fa02678c7 req-7b4dcdec-9815-486f-bc21-a12d65a5c42d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050223 Apr 19 14:54:09 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 59/178] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:54:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:54:09 user devstack@n-api.service[61255]: DEBUG nova.quota [None req-ef3830e4-82a2-416f-9969-2373c4fb69a3 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Getting quotas for project 5383c493e2f049fc9dc06818cb00a6f2. Resources: {'key_pairs'} {{(pid=61255) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:54:09 user devstack@n-api.service[61255]: DEBUG nova.quota [None req-ef3830e4-82a2-416f-9969-2373c4fb69a3 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Getting quotas for user fab5193fb1ec41b8a19e8621843a54a7 and project 5383c493e2f049fc9dc06818cb00a6f2. Resources: {'key_pairs'} {{(pid=61255) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:54:09 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-ef3830e4-82a2-416f-9969-2373c4fb69a3 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.042958 Apr 19 14:54:09 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 61/179] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 14:54:09 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:54:09 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-55df5dd0-5ff8-418a-928e-ccdaa99afed3 tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:54:09 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-55df5dd0-5ff8-418a-928e-ccdaa99afed3 tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] [instance: 104344aa-6bec-467b-b519-a2bb1b0b89f8] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:54:09 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-55df5dd0-5ff8-418a-928e-ccdaa99afed3 tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:09 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-55df5dd0-5ff8-418a-928e-ccdaa99afed3 tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:09 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-55df5dd0-5ff8-418a-928e-ccdaa99afed3 tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:09 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-55df5dd0-5ff8-418a-928e-ccdaa99afed3 tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:09 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-55df5dd0-5ff8-418a-928e-ccdaa99afed3 tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:09 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-55df5dd0-5ff8-418a-928e-ccdaa99afed3 tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:09 user devstack@n-api.service[61253]: INFO nova.api.openstack.wsgi [None req-55df5dd0-5ff8-418a-928e-ccdaa99afed3 tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] HTTP exception thrown: Instance 104344aa-6bec-467b-b519-a2bb1b0b89f8 could not be found. Apr 19 14:54:09 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-55df5dd0-5ff8-418a-928e-ccdaa99afed3 tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Request method failure captured: Apr 19 14:54:09 user devstack@n-api.service[61253]: request: GET /compute/v2.1/servers/104344aa-6bec-467b-b519-a2bb1b0b89f8 HTTP/1.1 Apr 19 14:54:09 user devstack@n-api.service[61253]: Accept: application/json Apr 19 14:54:09 user devstack@n-api.service[61253]: Accept-Encoding: identity Apr 19 14:54:09 user devstack@n-api.service[61253]: Connection: close Apr 19 14:54:09 user devstack@n-api.service[61253]: Content-Length: 0 Apr 19 14:54:09 user devstack@n-api.service[61253]: Content-Type: application/json Apr 19 14:54:09 user devstack@n-api.service[61253]: Host: 10.0.0.210 Apr 19 14:54:09 user devstack@n-api.service[61253]: Openstack-System-Scope: None Apr 19 14:54:09 user devstack@n-api.service[61253]: User-Agent: python-urllib3/1.26.15 Apr 19 14:54:09 user devstack@n-api.service[61253]: X-Auth-Token: gAAAAABkP__rbXr9ZydsrkP1NB4iELksbfC3tplB5RhIJ1NxzJxSJsi5JWlD5hVJXa2ugXC3ytEKlkPTvindOLaZKFHj-5qv--0nDqYchdyCntkRXXupltdiORYc-25O63TieFq5R-ckcuA25YNHbU_1D9xB7VRKpkKueNInc3zdUneYXB9lb0o Apr 19 14:54:09 user devstack@n-api.service[61253]: X-Domain-Id: None Apr 19 14:54:09 user devstack@n-api.service[61253]: X-Domain-Name: None Apr 19 14:54:09 user devstack@n-api.service[61253]: X-Identity-Status: Confirmed Apr 19 14:54:09 user devstack@n-api.service[61253]: X-Is-Admin-Project: True Apr 19 14:54:09 user devstack@n-api.service[61253]: X-Project-Domain-Id: default Apr 19 14:54:09 user devstack@n-api.service[61253]: X-Project-Domain-Name: Default Apr 19 14:54:09 user devstack@n-api.service[61253]: X-Project-Id: 14492681eaac49e89054c4fe63074b53 Apr 19 14:54:09 user devstack@n-api.service[61253]: X-Project-Name: tempest-VolumesActionsTest-1512562937 Apr 19 14:54:09 user devstack@n-api.service[61253]: X-Role: member,reader Apr 19 14:54:09 user devstack@n-api.service[61253]: X-Roles: member,reader Apr 19 14:54:09 user devstack@n-api.service[61253]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/14492681eaac49e89054c4fe63074b53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/14492681eaac49e89054c4fe63074b53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/14492681eaac49e89054c4fe63074b53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 14:54:09 user devstack@n-api.service[61253]: X-Tenant: tempest-VolumesActionsTest-1512562937 Apr 19 14:54:09 user devstack@n-api.service[61253]: X-Tenant-Id: 14492681eaac49e89054c4fe63074b53 Apr 19 14:54:09 user devstack@n-api.service[61253]: X-Tenant-Name: tempest-VolumesActionsTest-1512562937 Apr 19 14:54:09 user devstack@n-api.service[61253]: X-User: tempest-VolumesActionsTest-1512562937-project-member Apr 19 14:54:09 user devstack@n-api.service[61253]: X-User-Domain-Id: default Apr 19 14:54:09 user devstack@n-api.service[61253]: X-User-Domain-Name: Default Apr 19 14:54:09 user devstack@n-api.service[61253]: X-User-Id: 5e93c83b829546fbb633032cca416a31 Apr 19 14:54:09 user devstack@n-api.service[61253]: X-User-Name: tempest-VolumesActionsTest-1512562937-project-member Apr 19 14:54:09 user devstack@n-api.service[61253]: method: > Apr 19 14:54:09 user devstack@n-api.service[61253]: exception: Instance 104344aa-6bec-467b-b519-a2bb1b0b89f8 could not be found. Apr 19 14:54:09 user devstack@n-api.service[61253]: action_args: {'id': '104344aa-6bec-467b-b519-a2bb1b0b89f8'} Apr 19 14:54:09 user devstack@n-api.service[61253]: {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:54:09 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:54:09 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:54:09 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:54:09 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:54:09 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:54:09 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:54:09 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:54:09 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:54:09 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:54:09 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 104344aa-6bec-467b-b519-a2bb1b0b89f8 could not be found. Apr 19 14:54:09 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 14:54:09 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:54:09 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 14:54:09 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:54:09 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:54:09 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:54:09 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:54:09 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:54:09 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:54:09 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:54:09 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:54:09 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:54:09 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:54:09 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:54:09 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:54:09 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:54:09 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 104344aa-6bec-467b-b519-a2bb1b0b89f8 could not be found. Apr 19 14:54:09 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 14:54:09 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:54:09 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 14:54:09 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:54:09 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:54:09 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:54:09 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:54:09 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:54:09 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 104344aa-6bec-467b-b519-a2bb1b0b89f8 could not be found. Apr 19 14:54:09 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 14:54:09 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-55df5dd0-5ff8-418a-928e-ccdaa99afed3 tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] Returning 404 to user: Instance 104344aa-6bec-467b-b519-a2bb1b0b89f8 could not be found. {{(pid=61253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:54:09 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-55df5dd0-5ff8-418a-928e-ccdaa99afed3 tempest-VolumesActionsTest-1512562937 tempest-VolumesActionsTest-1512562937-project-member] 10.0.0.210 "GET /compute/v2.1/servers/104344aa-6bec-467b-b519-a2bb1b0b89f8" status: 404 len: 111 microversion: 2.1 time: 0.027211 Apr 19 14:54:09 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 60/180] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:54:09 2023] GET /compute/v2.1/servers/104344aa-6bec-467b-b519-a2bb1b0b89f8 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:54:10 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-75048422-16ce-4f31-a13f-7b9a29147a39 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1519019376", "imageRef": "283dcfe8-75fd-4917-902e-1b940387187c", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "17166877-bda4-4d38-864d-f92eab0126b0"}], "security_groups": [{"name": "tempest-securitygroup--2034898640"}], "key_name": "tempest-keypair-144624132", "user_data": "}} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:54:10 user devstack@n-api.service[61254]: DEBUG nova.network.neutron [None req-75048422-16ce-4f31-a13f-7b9a29147a39 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] validate_networks() for [('17166877-bda4-4d38-864d-f92eab0126b0', None, None, None, None, None)] {{(pid=61254) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 14:54:11 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-dbf37d8e-587d-47d2-b8a3-81e3dca3ae5b req-57ac77d2-b9dd-47c0-a473-42f767efe22d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084", "name": "network-vif-plugged", "status": "completed", "tag": "4f5f9b2b-57b0-4c33-8f63-bac94722e9d0"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:54:11 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-dbf37d8e-587d-47d2-b8a3-81e3dca3ae5b req-57ac77d2-b9dd-47c0-a473-42f767efe22d service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:11 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-dbf37d8e-587d-47d2-b8a3-81e3dca3ae5b req-57ac77d2-b9dd-47c0-a473-42f767efe22d service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:11 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-dbf37d8e-587d-47d2-b8a3-81e3dca3ae5b req-57ac77d2-b9dd-47c0-a473-42f767efe22d service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:11 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-dbf37d8e-587d-47d2-b8a3-81e3dca3ae5b req-57ac77d2-b9dd-47c0-a473-42f767efe22d service nova] Creating event network-vif-plugged:4f5f9b2b-57b0-4c33-8f63-bac94722e9d0 for instance ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084 on user Apr 19 14:54:11 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [req-dbf37d8e-587d-47d2-b8a3-81e3dca3ae5b req-57ac77d2-b9dd-47c0-a473-42f767efe22d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028245 Apr 19 14:54:11 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 62/181] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:54:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:54:11 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-75048422-16ce-4f31-a13f-7b9a29147a39 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Flavor limits 0:0:0 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 14:54:11 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-75048422-16ce-4f31-a13f-7b9a29147a39 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Image limits 0:0:0 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 14:54:11 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-75048422-16ce-4f31-a13f-7b9a29147a39 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Flavor pref 0:0:0 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 14:54:11 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-75048422-16ce-4f31-a13f-7b9a29147a39 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Image pref 0:0:0 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 14:54:11 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-75048422-16ce-4f31-a13f-7b9a29147a39 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 14:54:11 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-75048422-16ce-4f31-a13f-7b9a29147a39 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:11 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-75048422-16ce-4f31-a13f-7b9a29147a39 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:11 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-75048422-16ce-4f31-a13f-7b9a29147a39 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:11 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-75048422-16ce-4f31-a13f-7b9a29147a39 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:11 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-75048422-16ce-4f31-a13f-7b9a29147a39 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:11 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-75048422-16ce-4f31-a13f-7b9a29147a39 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:11 user devstack@n-api.service[61254]: DEBUG nova.quota [None req-75048422-16ce-4f31-a13f-7b9a29147a39 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Getting quotas for project 5383c493e2f049fc9dc06818cb00a6f2. Resources: {'ram', 'instances', 'cores'} {{(pid=61254) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:54:11 user devstack@n-api.service[61254]: DEBUG nova.quota [None req-75048422-16ce-4f31-a13f-7b9a29147a39 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Getting quotas for user fab5193fb1ec41b8a19e8621843a54a7 and project 5383c493e2f049fc9dc06818cb00a6f2. Resources: {'ram', 'instances', 'cores'} {{(pid=61254) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:54:11 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-75048422-16ce-4f31-a13f-7b9a29147a39 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Going to run 1 instances... {{(pid=61254) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 14:54:11 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-75048422-16ce-4f31-a13f-7b9a29147a39 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] [instance: 55679a8c-4cb6-4862-8ab8-ce2820166b07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='283dcfe8-75fd-4917-902e-1b940387187c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61254) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 14:54:11 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-75048422-16ce-4f31-a13f-7b9a29147a39 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.603002 Apr 19 14:54:11 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 60/182] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 14:54:10 2023] POST /compute/v2.1/servers => generated 400 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 14:54:11 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-a756ea33-1a6f-42dc-9926-1e8df542ae61 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:54:11 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-a756ea33-1a6f-42dc-9926-1e8df542ae61 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] [instance: 55679a8c-4cb6-4862-8ab8-ce2820166b07] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:54:11 user devstack@n-api.service[61253]: DEBUG nova.policy [None req-a756ea33-1a6f-42dc-9926-1e8df542ae61 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab5193fb1ec41b8a19e8621843a54a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5383c493e2f049fc9dc06818cb00a6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61253) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:54:11 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-a756ea33-1a6f-42dc-9926-1e8df542ae61 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55679a8c-4cb6-4862-8ab8-ce2820166b07" status: 200 len: 1231 microversion: 2.1 time: 0.069248 Apr 19 14:54:11 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 61/183] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:54:11 2023] GET /compute/v2.1/servers/55679a8c-4cb6-4862-8ab8-ce2820166b07 => generated 1231 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:54:14 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-dec705da-e76d-47b7-a660-aca42445d085 req-96068ddc-509b-4aac-ae8b-29587e38256d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55679a8c-4cb6-4862-8ab8-ce2820166b07", "tag": "71edbaec-5b65-43f4-adbc-51fef2badb3b"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:54:14 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-dec705da-e76d-47b7-a660-aca42445d085 req-96068ddc-509b-4aac-ae8b-29587e38256d service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:14 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-dec705da-e76d-47b7-a660-aca42445d085 req-96068ddc-509b-4aac-ae8b-29587e38256d service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:14 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-dec705da-e76d-47b7-a660-aca42445d085 req-96068ddc-509b-4aac-ae8b-29587e38256d service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:14 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-dec705da-e76d-47b7-a660-aca42445d085 req-96068ddc-509b-4aac-ae8b-29587e38256d service nova] Creating event network-changed:71edbaec-5b65-43f4-adbc-51fef2badb3b for instance 55679a8c-4cb6-4862-8ab8-ce2820166b07 on user Apr 19 14:54:14 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [req-dec705da-e76d-47b7-a660-aca42445d085 req-96068ddc-509b-4aac-ae8b-29587e38256d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030355 Apr 19 14:54:14 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 63/184] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:54:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:54:16 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-cdfeca66-ea17-4c9d-a184-0499e6d24935 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:54:16 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-cdfeca66-ea17-4c9d-a184-0499e6d24935 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] [instance: 6930db7c-e8e0-4d1d-ac99-952827ff1aa9] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:54:16 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-cdfeca66-ea17-4c9d-a184-0499e6d24935 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:16 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-cdfeca66-ea17-4c9d-a184-0499e6d24935 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:16 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-cdfeca66-ea17-4c9d-a184-0499e6d24935 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:16 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-cdfeca66-ea17-4c9d-a184-0499e6d24935 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:16 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-cdfeca66-ea17-4c9d-a184-0499e6d24935 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:16 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-cdfeca66-ea17-4c9d-a184-0499e6d24935 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:16 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-cdfeca66-ea17-4c9d-a184-0499e6d24935 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8683d0564d7c475c9d26f897e0239640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94be4fa38d44fe84c03b02b09bab0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:54:16 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-cdfeca66-ea17-4c9d-a184-0499e6d24935 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6930db7c-e8e0-4d1d-ac99-952827ff1aa9" status: 200 len: 1503 microversion: 2.1 time: 0.247041 Apr 19 14:54:16 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 61/185] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:54:16 2023] GET /compute/v2.1/servers/6930db7c-e8e0-4d1d-ac99-952827ff1aa9 => generated 1503 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:54:16 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [req-dcd4a555-0f82-4f49-92c5-15ac0b9fe679 req-61ad3010-a96f-43f2-8c78-83bbe82fc664 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55679a8c-4cb6-4862-8ab8-ce2820166b07", "name": "network-vif-plugged", "status": "completed", "tag": "71edbaec-5b65-43f4-adbc-51fef2badb3b"}]} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:54:16 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell0:SELECT=2 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:54:16 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-dcd4a555-0f82-4f49-92c5-15ac0b9fe679 req-61ad3010-a96f-43f2-8c78-83bbe82fc664 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:16 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-dcd4a555-0f82-4f49-92c5-15ac0b9fe679 req-61ad3010-a96f-43f2-8c78-83bbe82fc664 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:16 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-dcd4a555-0f82-4f49-92c5-15ac0b9fe679 req-61ad3010-a96f-43f2-8c78-83bbe82fc664 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:16 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-dcd4a555-0f82-4f49-92c5-15ac0b9fe679 req-61ad3010-a96f-43f2-8c78-83bbe82fc664 service nova] Creating event network-vif-plugged:71edbaec-5b65-43f4-adbc-51fef2badb3b for instance 55679a8c-4cb6-4862-8ab8-ce2820166b07 on user Apr 19 14:54:16 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [req-dcd4a555-0f82-4f49-92c5-15ac0b9fe679 req-61ad3010-a96f-43f2-8c78-83bbe82fc664 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036808 Apr 19 14:54:16 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 62/186] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:54:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:54:18 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-77920b3a-b49e-480d-9003-0276d8f1b568 req-ede12342-df7d-41f5-a93e-0239c458f310 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55679a8c-4cb6-4862-8ab8-ce2820166b07", "name": "network-vif-plugged", "status": "completed", "tag": "71edbaec-5b65-43f4-adbc-51fef2badb3b"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:54:18 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-77920b3a-b49e-480d-9003-0276d8f1b568 req-ede12342-df7d-41f5-a93e-0239c458f310 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:18 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-77920b3a-b49e-480d-9003-0276d8f1b568 req-ede12342-df7d-41f5-a93e-0239c458f310 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:18 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-77920b3a-b49e-480d-9003-0276d8f1b568 req-ede12342-df7d-41f5-a93e-0239c458f310 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:18 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-77920b3a-b49e-480d-9003-0276d8f1b568 req-ede12342-df7d-41f5-a93e-0239c458f310 service nova] Creating event network-vif-plugged:71edbaec-5b65-43f4-adbc-51fef2badb3b for instance 55679a8c-4cb6-4862-8ab8-ce2820166b07 on user Apr 19 14:54:18 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [req-77920b3a-b49e-480d-9003-0276d8f1b568 req-ede12342-df7d-41f5-a93e-0239c458f310 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028827 Apr 19 14:54:18 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 64/187] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:54:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:54:23 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-bf51f086-0611-4bc8-8711-fcf314b29843 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:54:23 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-bf51f086-0611-4bc8-8711-fcf314b29843 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] [instance: 7211dfd3-7d44-4adf-acfc-6e4715ef7d69] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:54:23 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell0:SELECT=2 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:54:23 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell0:SELECT=8 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:54:23 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-bf51f086-0611-4bc8-8711-fcf314b29843 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:23 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-bf51f086-0611-4bc8-8711-fcf314b29843 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:23 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-bf51f086-0611-4bc8-8711-fcf314b29843 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:23 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-bf51f086-0611-4bc8-8711-fcf314b29843 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:23 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-bf51f086-0611-4bc8-8711-fcf314b29843 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:23 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-bf51f086-0611-4bc8-8711-fcf314b29843 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:23 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-bf51f086-0611-4bc8-8711-fcf314b29843 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:23 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-bf51f086-0611-4bc8-8711-fcf314b29843 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:23 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-bf51f086-0611-4bc8-8711-fcf314b29843 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:23 user devstack@n-api.service[61254]: DEBUG nova.objects.instance [None req-bf51f086-0611-4bc8-8711-fcf314b29843 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lazy-loading 'fault' on Instance uuid 7211dfd3-7d44-4adf-acfc-6e4715ef7d69 {{(pid=61254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 19 14:54:23 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-bf51f086-0611-4bc8-8711-fcf314b29843 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33dd700a9314ab9a70428a3455a571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bc7474b840449da88a8f420316ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:54:23 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-bf51f086-0611-4bc8-8711-fcf314b29843 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b33dd700a9314ab9a70428a3455a571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bc7474b840449da88a8f420316ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:54:23 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-bf51f086-0611-4bc8-8711-fcf314b29843 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b33dd700a9314ab9a70428a3455a571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bc7474b840449da88a8f420316ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:54:23 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-bf51f086-0611-4bc8-8711-fcf314b29843 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7211dfd3-7d44-4adf-acfc-6e4715ef7d69" status: 200 len: 1650 microversion: 2.87 time: 0.109140 Apr 19 14:54:23 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 62/188] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 14:54:23 2023] GET /compute/v2.1/servers/7211dfd3-7d44-4adf-acfc-6e4715ef7d69 => generated 1650 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 14:54:23 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-6edf95e1-4412-4a57-88f8-65a9758b425e tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:54:23 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-6edf95e1-4412-4a57-88f8-65a9758b425e tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] [instance: 7211dfd3-7d44-4adf-acfc-6e4715ef7d69] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:54:23 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell0:SELECT=8 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:54:23 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-6edf95e1-4412-4a57-88f8-65a9758b425e tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:23 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-6edf95e1-4412-4a57-88f8-65a9758b425e tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:23 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-6edf95e1-4412-4a57-88f8-65a9758b425e tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:23 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-6edf95e1-4412-4a57-88f8-65a9758b425e tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:23 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-6edf95e1-4412-4a57-88f8-65a9758b425e tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:23 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-6edf95e1-4412-4a57-88f8-65a9758b425e tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:23 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-6edf95e1-4412-4a57-88f8-65a9758b425e tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] [instance: 7211dfd3-7d44-4adf-acfc-6e4715ef7d69] Going to try to terminate instance {{(pid=61253) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 14:54:23 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-6edf95e1-4412-4a57-88f8-65a9758b425e tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] [instance: 7211dfd3-7d44-4adf-acfc-6e4715ef7d69] Doing local delete in cell 294c8cd7-7972-4e5f-a789-800b7d5aa37d(cell1) {{(pid=61253) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 19 14:54:23 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-6edf95e1-4412-4a57-88f8-65a9758b425e tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:23 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-6edf95e1-4412-4a57-88f8-65a9758b425e tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:23 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-6edf95e1-4412-4a57-88f8-65a9758b425e tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:23 user devstack@n-api.service[61253]: WARNING nova.compute.api [None req-6edf95e1-4412-4a57-88f8-65a9758b425e tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] [instance: 7211dfd3-7d44-4adf-acfc-6e4715ef7d69] instance's host None is down, deleting from database Apr 19 14:54:23 user devstack@n-api.service[61253]: DEBUG nova.network.neutron [None req-6edf95e1-4412-4a57-88f8-65a9758b425e tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] [instance: 7211dfd3-7d44-4adf-acfc-6e4715ef7d69] deallocate_for_instance() {{(pid=61253) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 19 14:54:23 user devstack@n-api.service[61253]: DEBUG nova.network.neutron [None req-6edf95e1-4412-4a57-88f8-65a9758b425e tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] [instance: 7211dfd3-7d44-4adf-acfc-6e4715ef7d69] Instance cache missing network info. {{(pid=61253) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 19 14:54:23 user devstack@n-api.service[61253]: DEBUG nova.network.neutron [None req-6edf95e1-4412-4a57-88f8-65a9758b425e tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] [instance: 7211dfd3-7d44-4adf-acfc-6e4715ef7d69] Updating instance_info_cache with network_info: [] {{(pid=61253) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 19 14:54:23 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-6edf95e1-4412-4a57-88f8-65a9758b425e tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] [instance: 7211dfd3-7d44-4adf-acfc-6e4715ef7d69] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61253) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 19 14:54:23 user devstack@n-api.service[61253]: WARNING nova.compute.api [None req-6edf95e1-4412-4a57-88f8-65a9758b425e tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] [instance: 7211dfd3-7d44-4adf-acfc-6e4715ef7d69] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 19 14:54:24 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-6edf95e1-4412-4a57-88f8-65a9758b425e tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7211dfd3-7d44-4adf-acfc-6e4715ef7d69" status: 204 len: 0 microversion: 2.87 time: 0.684341 Apr 19 14:54:24 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 63/189] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 19 14:54:23 2023] DELETE /compute/v2.1/servers/7211dfd3-7d44-4adf-acfc-6e4715ef7d69 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 19 14:54:24 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell0:SELECT=8 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:54:24 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-2682e7c0-0dd8-4f0f-94af-8ffefc342e1a tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:54:24 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-2682e7c0-0dd8-4f0f-94af-8ffefc342e1a tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] [instance: 7211dfd3-7d44-4adf-acfc-6e4715ef7d69] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:54:24 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-2682e7c0-0dd8-4f0f-94af-8ffefc342e1a tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:24 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-2682e7c0-0dd8-4f0f-94af-8ffefc342e1a tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:24 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-2682e7c0-0dd8-4f0f-94af-8ffefc342e1a tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:24 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-2682e7c0-0dd8-4f0f-94af-8ffefc342e1a tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:24 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-2682e7c0-0dd8-4f0f-94af-8ffefc342e1a tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:24 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-2682e7c0-0dd8-4f0f-94af-8ffefc342e1a tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:24 user devstack@n-api.service[61255]: INFO nova.api.openstack.wsgi [None req-2682e7c0-0dd8-4f0f-94af-8ffefc342e1a tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] HTTP exception thrown: Instance 7211dfd3-7d44-4adf-acfc-6e4715ef7d69 could not be found. Apr 19 14:54:24 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-2682e7c0-0dd8-4f0f-94af-8ffefc342e1a tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Request method failure captured: Apr 19 14:54:24 user devstack@n-api.service[61255]: request: GET /compute/v2.1/servers/7211dfd3-7d44-4adf-acfc-6e4715ef7d69 HTTP/1.1 Apr 19 14:54:24 user devstack@n-api.service[61255]: Accept: application/json Apr 19 14:54:24 user devstack@n-api.service[61255]: Accept-Encoding: identity Apr 19 14:54:24 user devstack@n-api.service[61255]: Connection: close Apr 19 14:54:24 user devstack@n-api.service[61255]: Content-Length: 0 Apr 19 14:54:24 user devstack@n-api.service[61255]: Content-Type: application/json Apr 19 14:54:24 user devstack@n-api.service[61255]: Host: 10.0.0.210 Apr 19 14:54:24 user devstack@n-api.service[61255]: Openstack-System-Scope: None Apr 19 14:54:24 user devstack@n-api.service[61255]: User-Agent: python-urllib3/1.26.15 Apr 19 14:54:24 user devstack@n-api.service[61255]: X-Auth-Token: gAAAAABkP_-41ftQj_8wSAoFbkjOmwhZZoFbhh5figS3gy8Y-8Rr62DKw5pnfvwe3_ePsrBFzQDyXP0nE89w-ekmIB6jyLYgHp7dbA5RtqoBabtEuFUzFLm8IICf13TYAYTMmMrKMqZW2nq03-vXmmLdmC3MxGkuS1Zo6VWlf5dHBSwp9Fet2j8 Apr 19 14:54:24 user devstack@n-api.service[61255]: X-Domain-Id: None Apr 19 14:54:24 user devstack@n-api.service[61255]: X-Domain-Name: None Apr 19 14:54:24 user devstack@n-api.service[61255]: X-Identity-Status: Confirmed Apr 19 14:54:24 user devstack@n-api.service[61255]: X-Is-Admin-Project: True Apr 19 14:54:24 user devstack@n-api.service[61255]: X-Openstack-Nova-Api-Version: 2.87 Apr 19 14:54:24 user devstack@n-api.service[61255]: X-Project-Domain-Id: default Apr 19 14:54:24 user devstack@n-api.service[61255]: X-Project-Domain-Name: Default Apr 19 14:54:24 user devstack@n-api.service[61255]: X-Project-Id: b1bc7474b840449da88a8f420316ecfb Apr 19 14:54:24 user devstack@n-api.service[61255]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1484020474 Apr 19 14:54:24 user devstack@n-api.service[61255]: X-Role: member,reader Apr 19 14:54:24 user devstack@n-api.service[61255]: X-Roles: member,reader Apr 19 14:54:24 user devstack@n-api.service[61255]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b1bc7474b840449da88a8f420316ecfb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b1bc7474b840449da88a8f420316ecfb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b1bc7474b840449da88a8f420316ecfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 14:54:24 user devstack@n-api.service[61255]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1484020474 Apr 19 14:54:24 user devstack@n-api.service[61255]: X-Tenant-Id: b1bc7474b840449da88a8f420316ecfb Apr 19 14:54:24 user devstack@n-api.service[61255]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1484020474 Apr 19 14:54:24 user devstack@n-api.service[61255]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member Apr 19 14:54:24 user devstack@n-api.service[61255]: X-User-Domain-Id: default Apr 19 14:54:24 user devstack@n-api.service[61255]: X-User-Domain-Name: Default Apr 19 14:54:24 user devstack@n-api.service[61255]: X-User-Id: b33dd700a9314ab9a70428a3455a571c Apr 19 14:54:24 user devstack@n-api.service[61255]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member Apr 19 14:54:24 user devstack@n-api.service[61255]: method: > Apr 19 14:54:24 user devstack@n-api.service[61255]: exception: Instance 7211dfd3-7d44-4adf-acfc-6e4715ef7d69 could not be found. Apr 19 14:54:24 user devstack@n-api.service[61255]: action_args: {'id': '7211dfd3-7d44-4adf-acfc-6e4715ef7d69'} Apr 19 14:54:24 user devstack@n-api.service[61255]: {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:54:24 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:54:24 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:54:24 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:54:24 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:54:24 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:54:24 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:54:24 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:54:24 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:54:24 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:54:24 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7211dfd3-7d44-4adf-acfc-6e4715ef7d69 could not be found. Apr 19 14:54:24 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:54:24 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:54:24 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:54:24 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:54:24 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:54:24 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:54:24 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:54:24 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:54:24 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:54:24 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:54:24 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:54:24 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:54:24 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:54:24 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:54:24 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:54:24 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:54:24 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7211dfd3-7d44-4adf-acfc-6e4715ef7d69 could not be found. Apr 19 14:54:24 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:54:24 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:54:24 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:54:24 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:54:24 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:54:24 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:54:24 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:54:24 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:54:24 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7211dfd3-7d44-4adf-acfc-6e4715ef7d69 could not be found. Apr 19 14:54:24 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:54:24 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-2682e7c0-0dd8-4f0f-94af-8ffefc342e1a tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Returning 404 to user: Instance 7211dfd3-7d44-4adf-acfc-6e4715ef7d69 could not be found. {{(pid=61255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:54:24 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-2682e7c0-0dd8-4f0f-94af-8ffefc342e1a tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7211dfd3-7d44-4adf-acfc-6e4715ef7d69" status: 404 len: 111 microversion: 2.87 time: 0.072219 Apr 19 14:54:24 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 65/190] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 14:54:24 2023] GET /compute/v2.1/servers/7211dfd3-7d44-4adf-acfc-6e4715ef7d69 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 14:54:24 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-a128f5b1-0dca-4f18-b577-e844cc2b4919 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-798834270", "imageRef": "283dcfe8-75fd-4917-902e-1b940387187c", "flavorRef": "42", "networks": [{"uuid": "773ad771-04cd-4587-bc7e-10971f78fa84"}]}} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:54:24 user devstack@n-api.service[61254]: DEBUG nova.network.neutron [None req-a128f5b1-0dca-4f18-b577-e844cc2b4919 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] validate_networks() for [('773ad771-04cd-4587-bc7e-10971f78fa84', None, None, None, None, None)] {{(pid=61254) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 14:54:24 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-cebb082e-707f-4be7-bb41-94f50fc5dda8 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:54:24 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-cebb082e-707f-4be7-bb41-94f50fc5dda8 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] [instance: 04ea16ad-a0eb-4187-a966-7ec4f2396852] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:54:24 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-cebb082e-707f-4be7-bb41-94f50fc5dda8 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:24 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-cebb082e-707f-4be7-bb41-94f50fc5dda8 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:24 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-cebb082e-707f-4be7-bb41-94f50fc5dda8 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:24 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-cebb082e-707f-4be7-bb41-94f50fc5dda8 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:24 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-cebb082e-707f-4be7-bb41-94f50fc5dda8 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:24 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-cebb082e-707f-4be7-bb41-94f50fc5dda8 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:24 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-a128f5b1-0dca-4f18-b577-e844cc2b4919 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Flavor limits 0:0:0 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 14:54:24 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-a128f5b1-0dca-4f18-b577-e844cc2b4919 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Image limits 0:0:0 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 14:54:24 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-a128f5b1-0dca-4f18-b577-e844cc2b4919 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Flavor pref 0:0:0 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 14:54:24 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-a128f5b1-0dca-4f18-b577-e844cc2b4919 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Image pref 0:0:0 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 14:54:24 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-a128f5b1-0dca-4f18-b577-e844cc2b4919 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 14:54:24 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-a128f5b1-0dca-4f18-b577-e844cc2b4919 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:24 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-a128f5b1-0dca-4f18-b577-e844cc2b4919 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:24 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-a128f5b1-0dca-4f18-b577-e844cc2b4919 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:24 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-a128f5b1-0dca-4f18-b577-e844cc2b4919 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:24 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-a128f5b1-0dca-4f18-b577-e844cc2b4919 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:24 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-a128f5b1-0dca-4f18-b577-e844cc2b4919 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:24 user devstack@n-api.service[61254]: DEBUG nova.quota [None req-a128f5b1-0dca-4f18-b577-e844cc2b4919 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Getting quotas for project b1bc7474b840449da88a8f420316ecfb. Resources: {'ram', 'instances', 'cores'} {{(pid=61254) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:54:24 user devstack@n-api.service[61254]: DEBUG nova.quota [None req-a128f5b1-0dca-4f18-b577-e844cc2b4919 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Getting quotas for user b33dd700a9314ab9a70428a3455a571c and project b1bc7474b840449da88a8f420316ecfb. Resources: {'ram', 'instances', 'cores'} {{(pid=61254) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:54:24 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-a128f5b1-0dca-4f18-b577-e844cc2b4919 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Going to run 1 instances... {{(pid=61254) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 14:54:24 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-a128f5b1-0dca-4f18-b577-e844cc2b4919 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] [instance: 2a5ed5bc-23a0-42f5-8b38-167d24e822b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='283dcfe8-75fd-4917-902e-1b940387187c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61254) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 14:54:24 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-a128f5b1-0dca-4f18-b577-e844cc2b4919 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.613638 Apr 19 14:54:24 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 63/191] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 19 14:54:24 2023] POST /compute/v2.1/servers => generated 378 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 19 14:54:24 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-4938711d-39b4-41da-a48f-4675f7baae52 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:54:24 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-4938711d-39b4-41da-a48f-4675f7baae52 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] [instance: 2a5ed5bc-23a0-42f5-8b38-167d24e822b7] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:54:24 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-4938711d-39b4-41da-a48f-4675f7baae52 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33dd700a9314ab9a70428a3455a571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bc7474b840449da88a8f420316ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:54:24 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-4938711d-39b4-41da-a48f-4675f7baae52 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b33dd700a9314ab9a70428a3455a571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bc7474b840449da88a8f420316ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:54:24 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-4938711d-39b4-41da-a48f-4675f7baae52 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b33dd700a9314ab9a70428a3455a571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bc7474b840449da88a8f420316ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:54:24 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-4938711d-39b4-41da-a48f-4675f7baae52 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2a5ed5bc-23a0-42f5-8b38-167d24e822b7" status: 200 len: 1394 microversion: 2.87 time: 0.070295 Apr 19 14:54:24 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 66/192] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 14:54:24 2023] GET /compute/v2.1/servers/2a5ed5bc-23a0-42f5-8b38-167d24e822b7 => generated 1394 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 14:54:24 user devstack@n-api.service[61253]: DEBUG nova.policy [None req-cebb082e-707f-4be7-bb41-94f50fc5dda8 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b888ae3c3540df8cf7953ed5ed90d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de5e8e3b3394f219c8af4b834c85631', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61253) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:54:24 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-cebb082e-707f-4be7-bb41-94f50fc5dda8 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04ea16ad-a0eb-4187-a966-7ec4f2396852" status: 200 len: 1671 microversion: 2.1 time: 0.374959 Apr 19 14:54:24 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 64/193] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:54:24 2023] GET /compute/v2.1/servers/04ea16ad-a0eb-4187-a966-7ec4f2396852 => generated 1671 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:54:26 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-739669e6-1182-4ab1-9f2a-80ae0b5feccd tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Calling method '.version_select at 0x7f3cfa949f30>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:54:26 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-739669e6-1182-4ab1-9f2a-80ae0b5feccd tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/02388b55-5cf8-4f6f-a47d-89b8a8cb305b" status: 204 len: 0 microversion: 2.1 time: 0.269003 Apr 19 14:54:26 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 64/194] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:54:26 2023] DELETE /compute/v2.1/images/02388b55-5cf8-4f6f-a47d-89b8a8cb305b => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 14:54:26 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-fbf4f9aa-2857-422c-a30e-bcac6aee8d5a tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:54:26 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-fbf4f9aa-2857-422c-a30e-bcac6aee8d5a tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] [instance: 04ea16ad-a0eb-4187-a966-7ec4f2396852] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:54:26 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-fbf4f9aa-2857-422c-a30e-bcac6aee8d5a tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:26 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-fbf4f9aa-2857-422c-a30e-bcac6aee8d5a tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:26 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-fbf4f9aa-2857-422c-a30e-bcac6aee8d5a tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:26 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-fbf4f9aa-2857-422c-a30e-bcac6aee8d5a tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:26 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-fbf4f9aa-2857-422c-a30e-bcac6aee8d5a tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:26 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-fbf4f9aa-2857-422c-a30e-bcac6aee8d5a tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:26 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-fbf4f9aa-2857-422c-a30e-bcac6aee8d5a tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] [instance: 04ea16ad-a0eb-4187-a966-7ec4f2396852] Going to try to terminate instance {{(pid=61255) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 14:54:27 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-fbf4f9aa-2857-422c-a30e-bcac6aee8d5a tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/04ea16ad-a0eb-4187-a966-7ec4f2396852" status: 204 len: 0 microversion: 2.1 time: 0.154718 Apr 19 14:54:27 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 67/195] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 14:54:26 2023] DELETE /compute/v2.1/servers/04ea16ad-a0eb-4187-a966-7ec4f2396852 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 14:54:27 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-347f442f-8ed9-4245-8594-7c88e6df94f1 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:54:27 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-347f442f-8ed9-4245-8594-7c88e6df94f1 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] [instance: 04ea16ad-a0eb-4187-a966-7ec4f2396852] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:54:27 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-347f442f-8ed9-4245-8594-7c88e6df94f1 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:27 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-347f442f-8ed9-4245-8594-7c88e6df94f1 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:27 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-347f442f-8ed9-4245-8594-7c88e6df94f1 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:27 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-347f442f-8ed9-4245-8594-7c88e6df94f1 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:27 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-347f442f-8ed9-4245-8594-7c88e6df94f1 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:27 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-347f442f-8ed9-4245-8594-7c88e6df94f1 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:27 user devstack@n-api.service[61253]: DEBUG nova.policy [None req-347f442f-8ed9-4245-8594-7c88e6df94f1 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b888ae3c3540df8cf7953ed5ed90d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de5e8e3b3394f219c8af4b834c85631', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61253) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:54:27 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-347f442f-8ed9-4245-8594-7c88e6df94f1 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04ea16ad-a0eb-4187-a966-7ec4f2396852" status: 200 len: 1677 microversion: 2.1 time: 0.272656 Apr 19 14:54:27 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 65/196] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:54:27 2023] GET /compute/v2.1/servers/04ea16ad-a0eb-4187-a966-7ec4f2396852 => generated 1677 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:54:27 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [req-6e973572-0113-47d6-a3f1-cf24491085c2 req-a393d676-5b16-4a6c-9de1-470a0365359b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04ea16ad-a0eb-4187-a966-7ec4f2396852", "name": "network-vif-unplugged", "status": "completed", "tag": "17cc0520-8e21-4a1d-80b2-3520c4a13a61"}]} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:54:27 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-6e973572-0113-47d6-a3f1-cf24491085c2 req-a393d676-5b16-4a6c-9de1-470a0365359b service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:27 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-6e973572-0113-47d6-a3f1-cf24491085c2 req-a393d676-5b16-4a6c-9de1-470a0365359b service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:27 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-6e973572-0113-47d6-a3f1-cf24491085c2 req-a393d676-5b16-4a6c-9de1-470a0365359b service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:27 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-6e973572-0113-47d6-a3f1-cf24491085c2 req-a393d676-5b16-4a6c-9de1-470a0365359b service nova] Creating event network-vif-unplugged:17cc0520-8e21-4a1d-80b2-3520c4a13a61 for instance 04ea16ad-a0eb-4187-a966-7ec4f2396852 on user Apr 19 14:54:27 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [req-6e973572-0113-47d6-a3f1-cf24491085c2 req-a393d676-5b16-4a6c-9de1-470a0365359b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028899 Apr 19 14:54:27 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 65/197] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:54:27 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:54:28 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-d053d095-2b06-464f-befb-a9631c00ce05 req-b8155f8e-1777-4acc-af42-5219116daccd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04ea16ad-a0eb-4187-a966-7ec4f2396852", "name": "network-vif-deleted", "tag": "17cc0520-8e21-4a1d-80b2-3520c4a13a61"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:54:28 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-d053d095-2b06-464f-befb-a9631c00ce05 req-b8155f8e-1777-4acc-af42-5219116daccd service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:28 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-d053d095-2b06-464f-befb-a9631c00ce05 req-b8155f8e-1777-4acc-af42-5219116daccd service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:28 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-d053d095-2b06-464f-befb-a9631c00ce05 req-b8155f8e-1777-4acc-af42-5219116daccd service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:28 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-d053d095-2b06-464f-befb-a9631c00ce05 req-b8155f8e-1777-4acc-af42-5219116daccd service nova] Creating event network-vif-deleted:17cc0520-8e21-4a1d-80b2-3520c4a13a61 for instance 04ea16ad-a0eb-4187-a966-7ec4f2396852 on user Apr 19 14:54:28 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [req-d053d095-2b06-464f-befb-a9631c00ce05 req-b8155f8e-1777-4acc-af42-5219116daccd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047039 Apr 19 14:54:28 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 68/198] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:54:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:54:29 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [req-6fb55ab8-ebfa-4960-8984-e67c5e76abd1 req-a90cb41c-9c1c-47a0-8811-65cd0ef921b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04ea16ad-a0eb-4187-a966-7ec4f2396852", "name": "network-vif-plugged", "status": "completed", "tag": "17cc0520-8e21-4a1d-80b2-3520c4a13a61"}, {"name": "network-changed", "server_uuid": "2a5ed5bc-23a0-42f5-8b38-167d24e822b7", "tag": "146691c0-5b82-412e-8a59-5b0e90496d92"}]} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:54:29 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-6fb55ab8-ebfa-4960-8984-e67c5e76abd1 req-a90cb41c-9c1c-47a0-8811-65cd0ef921b9 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:29 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-6fb55ab8-ebfa-4960-8984-e67c5e76abd1 req-a90cb41c-9c1c-47a0-8811-65cd0ef921b9 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:29 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-6fb55ab8-ebfa-4960-8984-e67c5e76abd1 req-a90cb41c-9c1c-47a0-8811-65cd0ef921b9 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:29 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-6fb55ab8-ebfa-4960-8984-e67c5e76abd1 req-a90cb41c-9c1c-47a0-8811-65cd0ef921b9 service nova] Creating event network-vif-plugged:17cc0520-8e21-4a1d-80b2-3520c4a13a61 for instance 04ea16ad-a0eb-4187-a966-7ec4f2396852 on user Apr 19 14:54:29 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-6fb55ab8-ebfa-4960-8984-e67c5e76abd1 req-a90cb41c-9c1c-47a0-8811-65cd0ef921b9 service nova] Creating event network-changed:146691c0-5b82-412e-8a59-5b0e90496d92 for instance 2a5ed5bc-23a0-42f5-8b38-167d24e822b7 on user Apr 19 14:54:29 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [req-6fb55ab8-ebfa-4960-8984-e67c5e76abd1 req-a90cb41c-9c1c-47a0-8811-65cd0ef921b9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.050072 Apr 19 14:54:29 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 66/199] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:54:29 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:54:30 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [req-2895f114-768f-408a-aa7e-725400728a47 req-ffe630e3-8d53-48a7-8f21-cdaec4345bae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a5ed5bc-23a0-42f5-8b38-167d24e822b7", "name": "network-vif-plugged", "status": "completed", "tag": "146691c0-5b82-412e-8a59-5b0e90496d92"}]} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:54:30 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-2895f114-768f-408a-aa7e-725400728a47 req-ffe630e3-8d53-48a7-8f21-cdaec4345bae service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:30 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-2895f114-768f-408a-aa7e-725400728a47 req-ffe630e3-8d53-48a7-8f21-cdaec4345bae service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:30 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-2895f114-768f-408a-aa7e-725400728a47 req-ffe630e3-8d53-48a7-8f21-cdaec4345bae service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:30 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-2895f114-768f-408a-aa7e-725400728a47 req-ffe630e3-8d53-48a7-8f21-cdaec4345bae service nova] Creating event network-vif-plugged:146691c0-5b82-412e-8a59-5b0e90496d92 for instance 2a5ed5bc-23a0-42f5-8b38-167d24e822b7 on user Apr 19 14:54:30 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [req-2895f114-768f-408a-aa7e-725400728a47 req-ffe630e3-8d53-48a7-8f21-cdaec4345bae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029056 Apr 19 14:54:30 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 66/200] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:54:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:54:32 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-b183aaf1-30f8-4d47-b766-73413008f0c7 req-0e03bb10-2738-48f2-b920-ba50f0a48feb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a5ed5bc-23a0-42f5-8b38-167d24e822b7", "name": "network-vif-plugged", "status": "completed", "tag": "146691c0-5b82-412e-8a59-5b0e90496d92"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:54:32 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:54:32 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-b183aaf1-30f8-4d47-b766-73413008f0c7 req-0e03bb10-2738-48f2-b920-ba50f0a48feb service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:32 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-b183aaf1-30f8-4d47-b766-73413008f0c7 req-0e03bb10-2738-48f2-b920-ba50f0a48feb service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:32 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-b183aaf1-30f8-4d47-b766-73413008f0c7 req-0e03bb10-2738-48f2-b920-ba50f0a48feb service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:32 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:54:32 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-b183aaf1-30f8-4d47-b766-73413008f0c7 req-0e03bb10-2738-48f2-b920-ba50f0a48feb service nova] Creating event network-vif-plugged:146691c0-5b82-412e-8a59-5b0e90496d92 for instance 2a5ed5bc-23a0-42f5-8b38-167d24e822b7 on user Apr 19 14:54:32 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [req-b183aaf1-30f8-4d47-b766-73413008f0c7 req-0e03bb10-2738-48f2-b920-ba50f0a48feb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033226 Apr 19 14:54:32 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 69/201] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:54:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:54:49 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:54:49 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:54:49 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-8abda984-b813-45d5-b464-1d12cc62e95f tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Action: 'create', calling method: .version_select at 0x7f3cfa846320>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1461142894", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPH3zKW7lMZP0BP/yCr/QnCqe1JpYDiYnTDoYNLq4bf1nEX2SDP9DBOmIu6FJGIb5YUqjd/R4K9cJj0ULxTJ+pr5aGWIYRSWfKQEGILvtJjVgNOaAOPAj8vD9cbtKqcmDg=="}} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:54:49 user devstack@n-api.service[61253]: DEBUG nova.quota [None req-8abda984-b813-45d5-b464-1d12cc62e95f tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Getting quotas for project 3c121e3e3fa440d8a2e1c3e42975a9a1. Resources: {'key_pairs'} {{(pid=61253) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:54:49 user devstack@n-api.service[61253]: DEBUG nova.quota [None req-8abda984-b813-45d5-b464-1d12cc62e95f tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Getting quotas for user 7e2985fabe974b80a37af599e28c8fbb and project 3c121e3e3fa440d8a2e1c3e42975a9a1. Resources: {'key_pairs'} {{(pid=61253) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:54:49 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-8abda984-b813-45d5-b464-1d12cc62e95f tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.058297 Apr 19 14:54:49 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 67/202] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 14:54:49 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:54:49 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell0:SELECT=2 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:54:49 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell0:SELECT=6 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:54:49 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=6 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:54:49 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell1:SELECT=30 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:54:49 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-507d23b6-c9ae-42d7-ad4c-bd381f0821ee tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1903531577", "imageRef": "25584db0-1882-4dc3-a803-97ac00cfa1b9", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1461142894", "networks": [{"uuid": "e3b4815b-7cb5-4343-9337-5dde5a6c5fc1"}]}} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:54:49 user devstack@n-api.service[61254]: DEBUG nova.network.neutron [None req-507d23b6-c9ae-42d7-ad4c-bd381f0821ee tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] validate_networks() for [('e3b4815b-7cb5-4343-9337-5dde5a6c5fc1', None, None, None, None, None)] {{(pid=61254) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 14:54:49 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-507d23b6-c9ae-42d7-ad4c-bd381f0821ee tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Flavor limits 0:0:0 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 14:54:49 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-507d23b6-c9ae-42d7-ad4c-bd381f0821ee tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Image limits 0:0:0 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 14:54:49 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-507d23b6-c9ae-42d7-ad4c-bd381f0821ee tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Flavor pref 0:0:0 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 14:54:49 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-507d23b6-c9ae-42d7-ad4c-bd381f0821ee tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Image pref 0:0:0 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 14:54:49 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-507d23b6-c9ae-42d7-ad4c-bd381f0821ee tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 14:54:49 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-507d23b6-c9ae-42d7-ad4c-bd381f0821ee tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:49 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-507d23b6-c9ae-42d7-ad4c-bd381f0821ee tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:49 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-507d23b6-c9ae-42d7-ad4c-bd381f0821ee tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:49 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-507d23b6-c9ae-42d7-ad4c-bd381f0821ee tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:49 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-507d23b6-c9ae-42d7-ad4c-bd381f0821ee tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:49 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-507d23b6-c9ae-42d7-ad4c-bd381f0821ee tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:49 user devstack@n-api.service[61254]: DEBUG nova.quota [None req-507d23b6-c9ae-42d7-ad4c-bd381f0821ee tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Getting quotas for project 3c121e3e3fa440d8a2e1c3e42975a9a1. Resources: {'ram', 'instances', 'cores'} {{(pid=61254) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:54:49 user devstack@n-api.service[61254]: DEBUG nova.quota [None req-507d23b6-c9ae-42d7-ad4c-bd381f0821ee tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Getting quotas for user 7e2985fabe974b80a37af599e28c8fbb and project 3c121e3e3fa440d8a2e1c3e42975a9a1. Resources: {'ram', 'instances', 'cores'} {{(pid=61254) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:54:49 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-507d23b6-c9ae-42d7-ad4c-bd381f0821ee tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Going to run 1 instances... {{(pid=61254) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 14:54:49 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-507d23b6-c9ae-42d7-ad4c-bd381f0821ee tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] [instance: 3478c35c-c27b-4480-ad89-4b9cd7ebeb40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='25584db0-1882-4dc3-a803-97ac00cfa1b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61254) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 14:54:50 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-507d23b6-c9ae-42d7-ad4c-bd381f0821ee tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.541192 Apr 19 14:54:50 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 67/203] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 14:54:49 2023] POST /compute/v2.1/servers => generated 378 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 14:54:50 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-a64b757f-94f6-4409-9f77-95a02055d251 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:54:50 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-a64b757f-94f6-4409-9f77-95a02055d251 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] [instance: 3478c35c-c27b-4480-ad89-4b9cd7ebeb40] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:54:50 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell0:SELECT=2 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:54:50 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-a64b757f-94f6-4409-9f77-95a02055d251 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2985fabe974b80a37af599e28c8fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c121e3e3fa440d8a2e1c3e42975a9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:54:50 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-a64b757f-94f6-4409-9f77-95a02055d251 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3478c35c-c27b-4480-ad89-4b9cd7ebeb40" status: 200 len: 1253 microversion: 2.1 time: 0.080046 Apr 19 14:54:50 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 70/204] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:54:50 2023] GET /compute/v2.1/servers/3478c35c-c27b-4480-ad89-4b9cd7ebeb40 => generated 1253 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:54:51 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-79bd8238-3305-47cf-80ac-341798e8967a tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:54:51 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-79bd8238-3305-47cf-80ac-341798e8967a tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] [instance: 0a8c97e3-3c9e-4a4a-bc86-ee3c313cb1d3] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:54:51 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-79bd8238-3305-47cf-80ac-341798e8967a tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:51 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-79bd8238-3305-47cf-80ac-341798e8967a tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:51 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-79bd8238-3305-47cf-80ac-341798e8967a tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:51 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-79bd8238-3305-47cf-80ac-341798e8967a tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:51 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-79bd8238-3305-47cf-80ac-341798e8967a tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:51 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-79bd8238-3305-47cf-80ac-341798e8967a tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:51 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-79bd8238-3305-47cf-80ac-341798e8967a tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] [instance: 0a8c97e3-3c9e-4a4a-bc86-ee3c313cb1d3] Going to try to terminate instance {{(pid=61253) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 14:54:51 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-79bd8238-3305-47cf-80ac-341798e8967a tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0a8c97e3-3c9e-4a4a-bc86-ee3c313cb1d3" status: 204 len: 0 microversion: 2.1 time: 0.134327 Apr 19 14:54:51 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 68/205] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 14:54:51 2023] DELETE /compute/v2.1/servers/0a8c97e3-3c9e-4a4a-bc86-ee3c313cb1d3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 14:54:51 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-357d6637-5231-48e5-8b61-2dcd0c2181fd tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:54:51 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-357d6637-5231-48e5-8b61-2dcd0c2181fd tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] [instance: 0a8c97e3-3c9e-4a4a-bc86-ee3c313cb1d3] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:54:51 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-357d6637-5231-48e5-8b61-2dcd0c2181fd tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:51 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-357d6637-5231-48e5-8b61-2dcd0c2181fd tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:51 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-357d6637-5231-48e5-8b61-2dcd0c2181fd tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:51 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-357d6637-5231-48e5-8b61-2dcd0c2181fd tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:51 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-357d6637-5231-48e5-8b61-2dcd0c2181fd tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:51 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-357d6637-5231-48e5-8b61-2dcd0c2181fd tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:52 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-357d6637-5231-48e5-8b61-2dcd0c2181fd tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708068c5f6f5451fbcd6c24235a185d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da86be1a28254582b530973fbf7f724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:54:52 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-357d6637-5231-48e5-8b61-2dcd0c2181fd tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0a8c97e3-3c9e-4a4a-bc86-ee3c313cb1d3" status: 200 len: 1503 microversion: 2.1 time: 0.265901 Apr 19 14:54:52 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 68/206] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:54:51 2023] GET /compute/v2.1/servers/0a8c97e3-3c9e-4a4a-bc86-ee3c313cb1d3 => generated 1503 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:54:52 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-bbd55b24-f8ec-43ca-8588-760b6b4a98b2 req-5c555c29-e396-44aa-9839-43eff22c6410 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a8c97e3-3c9e-4a4a-bc86-ee3c313cb1d3", "name": "network-vif-unplugged", "status": "completed", "tag": "878e79b6-c83f-4872-9143-cb5f61cd413a"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:54:52 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-bbd55b24-f8ec-43ca-8588-760b6b4a98b2 req-5c555c29-e396-44aa-9839-43eff22c6410 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:52 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-bbd55b24-f8ec-43ca-8588-760b6b4a98b2 req-5c555c29-e396-44aa-9839-43eff22c6410 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:52 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-bbd55b24-f8ec-43ca-8588-760b6b4a98b2 req-5c555c29-e396-44aa-9839-43eff22c6410 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:52 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-bbd55b24-f8ec-43ca-8588-760b6b4a98b2 req-5c555c29-e396-44aa-9839-43eff22c6410 service nova] Creating event network-vif-unplugged:878e79b6-c83f-4872-9143-cb5f61cd413a for instance 0a8c97e3-3c9e-4a4a-bc86-ee3c313cb1d3 on user Apr 19 14:54:52 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [req-bbd55b24-f8ec-43ca-8588-760b6b4a98b2 req-5c555c29-e396-44aa-9839-43eff22c6410 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031136 Apr 19 14:54:52 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 71/207] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:54:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:54:52 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [req-2aaeb577-cb76-4346-8679-bc5fb3569ff2 req-2811b5b1-94b1-442a-a75d-62066ae73f3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3478c35c-c27b-4480-ad89-4b9cd7ebeb40", "tag": "999d1646-6f9f-4f3b-84cb-61953c2e3097"}]} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:54:52 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-2aaeb577-cb76-4346-8679-bc5fb3569ff2 req-2811b5b1-94b1-442a-a75d-62066ae73f3d service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:52 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-2aaeb577-cb76-4346-8679-bc5fb3569ff2 req-2811b5b1-94b1-442a-a75d-62066ae73f3d service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:52 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-2aaeb577-cb76-4346-8679-bc5fb3569ff2 req-2811b5b1-94b1-442a-a75d-62066ae73f3d service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:52 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-2aaeb577-cb76-4346-8679-bc5fb3569ff2 req-2811b5b1-94b1-442a-a75d-62066ae73f3d service nova] Creating event network-changed:999d1646-6f9f-4f3b-84cb-61953c2e3097 for instance 3478c35c-c27b-4480-ad89-4b9cd7ebeb40 on user Apr 19 14:54:52 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [req-2aaeb577-cb76-4346-8679-bc5fb3569ff2 req-2811b5b1-94b1-442a-a75d-62066ae73f3d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030528 Apr 19 14:54:52 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 69/208] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:54:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:54:54 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [req-4e80334a-72c3-48ae-8382-5c443411ffb0 req-08508c2f-676e-41df-83b0-720e95912702 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a8c97e3-3c9e-4a4a-bc86-ee3c313cb1d3", "name": "network-vif-plugged", "status": "completed", "tag": "878e79b6-c83f-4872-9143-cb5f61cd413a"}, {"server_uuid": "0a8c97e3-3c9e-4a4a-bc86-ee3c313cb1d3", "name": "network-vif-deleted", "tag": "878e79b6-c83f-4872-9143-cb5f61cd413a"}]} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:54:54 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-4e80334a-72c3-48ae-8382-5c443411ffb0 req-08508c2f-676e-41df-83b0-720e95912702 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:54 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-4e80334a-72c3-48ae-8382-5c443411ffb0 req-08508c2f-676e-41df-83b0-720e95912702 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:54 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-4e80334a-72c3-48ae-8382-5c443411ffb0 req-08508c2f-676e-41df-83b0-720e95912702 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:54 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-4e80334a-72c3-48ae-8382-5c443411ffb0 req-08508c2f-676e-41df-83b0-720e95912702 service nova] Creating event network-vif-plugged:878e79b6-c83f-4872-9143-cb5f61cd413a for instance 0a8c97e3-3c9e-4a4a-bc86-ee3c313cb1d3 on user Apr 19 14:54:54 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-4e80334a-72c3-48ae-8382-5c443411ffb0 req-08508c2f-676e-41df-83b0-720e95912702 service nova] Creating event network-vif-deleted:878e79b6-c83f-4872-9143-cb5f61cd413a for instance 0a8c97e3-3c9e-4a4a-bc86-ee3c313cb1d3 on user Apr 19 14:54:54 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [req-4e80334a-72c3-48ae-8382-5c443411ffb0 req-08508c2f-676e-41df-83b0-720e95912702 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029665 Apr 19 14:54:54 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 69/209] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:54:54 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:54:54 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-1d9080f9-bd9f-4931-94fe-0e0d9ec4c760 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:54:54 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-1d9080f9-bd9f-4931-94fe-0e0d9ec4c760 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] [instance: ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:54:54 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-1d9080f9-bd9f-4931-94fe-0e0d9ec4c760 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:54 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-1d9080f9-bd9f-4931-94fe-0e0d9ec4c760 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:54 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-1d9080f9-bd9f-4931-94fe-0e0d9ec4c760 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:54 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-1d9080f9-bd9f-4931-94fe-0e0d9ec4c760 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:54 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-1d9080f9-bd9f-4931-94fe-0e0d9ec4c760 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:54 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-1d9080f9-bd9f-4931-94fe-0e0d9ec4c760 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:54 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [req-92c21a93-b4e0-476b-be85-225287e31e31 req-de386510-375b-41a9-9fdb-fc0e4e0ac957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3478c35c-c27b-4480-ad89-4b9cd7ebeb40", "name": "network-vif-plugged", "status": "completed", "tag": "999d1646-6f9f-4f3b-84cb-61953c2e3097"}]} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:54:54 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-92c21a93-b4e0-476b-be85-225287e31e31 req-de386510-375b-41a9-9fdb-fc0e4e0ac957 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:54 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-92c21a93-b4e0-476b-be85-225287e31e31 req-de386510-375b-41a9-9fdb-fc0e4e0ac957 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:54 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-92c21a93-b4e0-476b-be85-225287e31e31 req-de386510-375b-41a9-9fdb-fc0e4e0ac957 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:54 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-92c21a93-b4e0-476b-be85-225287e31e31 req-de386510-375b-41a9-9fdb-fc0e4e0ac957 service nova] Creating event network-vif-plugged:999d1646-6f9f-4f3b-84cb-61953c2e3097 for instance 3478c35c-c27b-4480-ad89-4b9cd7ebeb40 on user Apr 19 14:54:54 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [req-92c21a93-b4e0-476b-be85-225287e31e31 req-de386510-375b-41a9-9fdb-fc0e4e0ac957 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032031 Apr 19 14:54:54 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 70/210] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:54:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:54:54 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-1d9080f9-bd9f-4931-94fe-0e0d9ec4c760 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b23f0d7300496990e74b2fb4945c15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5079ce8a52417fb2b8b8122bfeaa5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:54:54 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-1d9080f9-bd9f-4931-94fe-0e0d9ec4c760 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084" status: 200 len: 1544 microversion: 2.1 time: 0.230372 Apr 19 14:54:54 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 72/211] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:54:54 2023] GET /compute/v2.1/servers/ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084 => generated 1544 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:54:56 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [req-2f41edde-1703-44f4-8157-d31d566f6d97 req-47db92ad-344e-4a15-9a47-9511556d8494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3478c35c-c27b-4480-ad89-4b9cd7ebeb40", "name": "network-vif-plugged", "status": "completed", "tag": "999d1646-6f9f-4f3b-84cb-61953c2e3097"}]} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:54:56 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-2f41edde-1703-44f4-8157-d31d566f6d97 req-47db92ad-344e-4a15-9a47-9511556d8494 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:54:56 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-2f41edde-1703-44f4-8157-d31d566f6d97 req-47db92ad-344e-4a15-9a47-9511556d8494 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:54:56 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-2f41edde-1703-44f4-8157-d31d566f6d97 req-47db92ad-344e-4a15-9a47-9511556d8494 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:54:56 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-2f41edde-1703-44f4-8157-d31d566f6d97 req-47db92ad-344e-4a15-9a47-9511556d8494 service nova] Creating event network-vif-plugged:999d1646-6f9f-4f3b-84cb-61953c2e3097 for instance 3478c35c-c27b-4480-ad89-4b9cd7ebeb40 on user Apr 19 14:54:56 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [req-2f41edde-1703-44f4-8157-d31d566f6d97 req-47db92ad-344e-4a15-9a47-9511556d8494 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045238 Apr 19 14:54:56 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 70/212] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:54:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:55:01 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell0:SELECT=4 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:55:01 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-7e73fa9c-0f3f-4e8d-b8ce-accd4da2e269 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:55:01 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-7e73fa9c-0f3f-4e8d-b8ce-accd4da2e269 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] [instance: 55679a8c-4cb6-4862-8ab8-ce2820166b07] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:55:01 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-7e73fa9c-0f3f-4e8d-b8ce-accd4da2e269 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:55:01 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-7e73fa9c-0f3f-4e8d-b8ce-accd4da2e269 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:55:01 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-7e73fa9c-0f3f-4e8d-b8ce-accd4da2e269 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:55:01 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-7e73fa9c-0f3f-4e8d-b8ce-accd4da2e269 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:55:01 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-7e73fa9c-0f3f-4e8d-b8ce-accd4da2e269 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:55:01 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-7e73fa9c-0f3f-4e8d-b8ce-accd4da2e269 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:55:01 user devstack@n-api.service[61253]: DEBUG nova.policy [None req-7e73fa9c-0f3f-4e8d-b8ce-accd4da2e269 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab5193fb1ec41b8a19e8621843a54a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5383c493e2f049fc9dc06818cb00a6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61253) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:55:01 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-7e73fa9c-0f3f-4e8d-b8ce-accd4da2e269 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55679a8c-4cb6-4862-8ab8-ce2820166b07" status: 200 len: 1537 microversion: 2.1 time: 0.257721 Apr 19 14:55:01 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 71/213] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:55:01 2023] GET /compute/v2.1/servers/55679a8c-4cb6-4862-8ab8-ce2820166b07 => generated 1537 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:55:09 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-a8244c22-878d-4898-8ea5-22b5753e9173 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:55:09 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-a8244c22-878d-4898-8ea5-22b5753e9173 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] [instance: 9fee43ad-330a-45d7-9374-07feefcf9e14] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:55:09 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell0:SELECT=2 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:55:09 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_api:SELECT=9 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:55:09 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell1:SELECT=9 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:55:09 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-a8244c22-878d-4898-8ea5-22b5753e9173 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:55:09 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-a8244c22-878d-4898-8ea5-22b5753e9173 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:55:09 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-a8244c22-878d-4898-8ea5-22b5753e9173 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:55:09 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-a8244c22-878d-4898-8ea5-22b5753e9173 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:55:09 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-a8244c22-878d-4898-8ea5-22b5753e9173 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:55:09 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-a8244c22-878d-4898-8ea5-22b5753e9173 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:55:09 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-a8244c22-878d-4898-8ea5-22b5753e9173 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aab0b2e3424d80852e588323f187bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dbf312f7154ce1ae7fc1403947d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:55:09 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-a8244c22-878d-4898-8ea5-22b5753e9173 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9fee43ad-330a-45d7-9374-07feefcf9e14" status: 200 len: 1658 microversion: 2.1 time: 0.230182 Apr 19 14:55:09 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 73/214] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:55:09 2023] GET /compute/v2.1/servers/9fee43ad-330a-45d7-9374-07feefcf9e14 => generated 1658 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:55:14 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-858b1c11-2250-40b7-a4d0-f121d137cefb tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:55:14 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-858b1c11-2250-40b7-a4d0-f121d137cefb tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] [instance: 2a5ed5bc-23a0-42f5-8b38-167d24e822b7] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:55:14 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell0:SELECT=2 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:55:14 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell0:SELECT=6 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:55:14 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:55:15 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell1:SELECT=12 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:55:15 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-858b1c11-2250-40b7-a4d0-f121d137cefb tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:55:15 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-858b1c11-2250-40b7-a4d0-f121d137cefb tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:55:15 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-858b1c11-2250-40b7-a4d0-f121d137cefb tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:55:15 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-858b1c11-2250-40b7-a4d0-f121d137cefb tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:55:15 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-858b1c11-2250-40b7-a4d0-f121d137cefb tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:55:15 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-858b1c11-2250-40b7-a4d0-f121d137cefb tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:55:15 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-858b1c11-2250-40b7-a4d0-f121d137cefb tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33dd700a9314ab9a70428a3455a571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bc7474b840449da88a8f420316ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:55:15 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-858b1c11-2250-40b7-a4d0-f121d137cefb tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b33dd700a9314ab9a70428a3455a571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bc7474b840449da88a8f420316ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:55:15 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-858b1c11-2250-40b7-a4d0-f121d137cefb tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b33dd700a9314ab9a70428a3455a571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bc7474b840449da88a8f420316ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:55:15 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-858b1c11-2250-40b7-a4d0-f121d137cefb tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2a5ed5bc-23a0-42f5-8b38-167d24e822b7" status: 200 len: 1690 microversion: 2.87 time: 0.391303 Apr 19 14:55:15 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 71/215] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 14:55:14 2023] GET /compute/v2.1/servers/2a5ed5bc-23a0-42f5-8b38-167d24e822b7 => generated 1690 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 14:55:16 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-80fb9475-5e67-47cd-aca9-716ddf27c7bc tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:55:16 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-80fb9475-5e67-47cd-aca9-716ddf27c7bc tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] [instance: 6930db7c-e8e0-4d1d-ac99-952827ff1aa9] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:55:16 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:55:16 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:55:16 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-80fb9475-5e67-47cd-aca9-716ddf27c7bc tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:55:16 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-80fb9475-5e67-47cd-aca9-716ddf27c7bc tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:55:16 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-80fb9475-5e67-47cd-aca9-716ddf27c7bc tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:55:16 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-80fb9475-5e67-47cd-aca9-716ddf27c7bc tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:55:16 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-80fb9475-5e67-47cd-aca9-716ddf27c7bc tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:55:16 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-80fb9475-5e67-47cd-aca9-716ddf27c7bc tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:55:16 user devstack@n-api.service[61253]: DEBUG nova.objects.instance [None req-80fb9475-5e67-47cd-aca9-716ddf27c7bc tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lazy-loading 'flavor' on Instance uuid 6930db7c-e8e0-4d1d-ac99-952827ff1aa9 {{(pid=61253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 19 14:55:16 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-80fb9475-5e67-47cd-aca9-716ddf27c7bc tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6930db7c-e8e0-4d1d-ac99-952827ff1aa9/action" status: 200 len: 32 microversion: 2.1 time: 0.143868 Apr 19 14:55:16 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 72/216] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 19 14:55:16 2023] POST /compute/v2.1/servers/6930db7c-e8e0-4d1d-ac99-952827ff1aa9/action => generated 32 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 19 14:55:16 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-42bbfd27-7cde-4501-9c13-6ea446317fbf tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:55:16 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-42bbfd27-7cde-4501-9c13-6ea446317fbf tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] [instance: 6930db7c-e8e0-4d1d-ac99-952827ff1aa9] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:55:16 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-42bbfd27-7cde-4501-9c13-6ea446317fbf tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:55:16 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-42bbfd27-7cde-4501-9c13-6ea446317fbf tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:55:16 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-42bbfd27-7cde-4501-9c13-6ea446317fbf tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:55:16 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-42bbfd27-7cde-4501-9c13-6ea446317fbf tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:55:16 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-42bbfd27-7cde-4501-9c13-6ea446317fbf tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:55:16 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-42bbfd27-7cde-4501-9c13-6ea446317fbf tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:55:17 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-42bbfd27-7cde-4501-9c13-6ea446317fbf tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8683d0564d7c475c9d26f897e0239640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94be4fa38d44fe84c03b02b09bab0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:55:17 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-42bbfd27-7cde-4501-9c13-6ea446317fbf tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6930db7c-e8e0-4d1d-ac99-952827ff1aa9" status: 200 len: 1509 microversion: 2.1 time: 0.511311 Apr 19 14:55:17 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 74/217] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:55:16 2023] GET /compute/v2.1/servers/6930db7c-e8e0-4d1d-ac99-952827ff1aa9 => generated 1509 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:55:17 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-7b81d500-dc6c-4fd7-bc25-b2c36b5f5c79 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:55:17 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-7b81d500-dc6c-4fd7-bc25-b2c36b5f5c79 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] [instance: 04ea16ad-a0eb-4187-a966-7ec4f2396852] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:55:17 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-7b81d500-dc6c-4fd7-bc25-b2c36b5f5c79 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:55:17 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-7b81d500-dc6c-4fd7-bc25-b2c36b5f5c79 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:55:17 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-7b81d500-dc6c-4fd7-bc25-b2c36b5f5c79 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:55:17 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-7b81d500-dc6c-4fd7-bc25-b2c36b5f5c79 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:55:17 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-7b81d500-dc6c-4fd7-bc25-b2c36b5f5c79 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:55:17 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-7b81d500-dc6c-4fd7-bc25-b2c36b5f5c79 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:55:17 user devstack@n-api.service[61254]: INFO nova.api.openstack.wsgi [None req-7b81d500-dc6c-4fd7-bc25-b2c36b5f5c79 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] HTTP exception thrown: Instance 04ea16ad-a0eb-4187-a966-7ec4f2396852 could not be found. Apr 19 14:55:17 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-7b81d500-dc6c-4fd7-bc25-b2c36b5f5c79 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Request method failure captured: Apr 19 14:55:17 user devstack@n-api.service[61254]: request: GET /compute/v2.1/servers/04ea16ad-a0eb-4187-a966-7ec4f2396852 HTTP/1.1 Apr 19 14:55:17 user devstack@n-api.service[61254]: Accept: application/json Apr 19 14:55:17 user devstack@n-api.service[61254]: Accept-Encoding: identity Apr 19 14:55:17 user devstack@n-api.service[61254]: Connection: close Apr 19 14:55:17 user devstack@n-api.service[61254]: Content-Length: 0 Apr 19 14:55:17 user devstack@n-api.service[61254]: Content-Type: application/json Apr 19 14:55:17 user devstack@n-api.service[61254]: Host: 10.0.0.210 Apr 19 14:55:17 user devstack@n-api.service[61254]: Openstack-System-Scope: None Apr 19 14:55:17 user devstack@n-api.service[61254]: User-Agent: python-urllib3/1.26.15 Apr 19 14:55:17 user devstack@n-api.service[61254]: X-Auth-Token: gAAAAABkP_-4pFfQDvBJogKMR4RI9nrMOPmsw828wswGvRh91FjKkIxIizgF2n1Tma9QPyD6yE89K87zqz39ZQF4rcR8qiKThTJ-qXAbuSOPs-MKz5WWdGlhKIgkA7YwUpJ1uVW0VH-af6jTtyYPG2Lap682FQ2HF7GyvOwmINuFty8nq3WyruU Apr 19 14:55:17 user devstack@n-api.service[61254]: X-Domain-Id: None Apr 19 14:55:17 user devstack@n-api.service[61254]: X-Domain-Name: None Apr 19 14:55:17 user devstack@n-api.service[61254]: X-Identity-Status: Confirmed Apr 19 14:55:17 user devstack@n-api.service[61254]: X-Is-Admin-Project: True Apr 19 14:55:17 user devstack@n-api.service[61254]: X-Project-Domain-Id: default Apr 19 14:55:17 user devstack@n-api.service[61254]: X-Project-Domain-Name: Default Apr 19 14:55:17 user devstack@n-api.service[61254]: X-Project-Id: 4de5e8e3b3394f219c8af4b834c85631 Apr 19 14:55:17 user devstack@n-api.service[61254]: X-Project-Name: tempest-ServerStableDeviceRescueTest-1761332643 Apr 19 14:55:17 user devstack@n-api.service[61254]: X-Role: member,reader Apr 19 14:55:17 user devstack@n-api.service[61254]: X-Roles: member,reader Apr 19 14:55:17 user devstack@n-api.service[61254]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4de5e8e3b3394f219c8af4b834c85631"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4de5e8e3b3394f219c8af4b834c85631"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4de5e8e3b3394f219c8af4b834c85631"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 14:55:17 user devstack@n-api.service[61254]: X-Tenant: tempest-ServerStableDeviceRescueTest-1761332643 Apr 19 14:55:17 user devstack@n-api.service[61254]: X-Tenant-Id: 4de5e8e3b3394f219c8af4b834c85631 Apr 19 14:55:17 user devstack@n-api.service[61254]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-1761332643 Apr 19 14:55:17 user devstack@n-api.service[61254]: X-User: tempest-ServerStableDeviceRescueTest-1761332643-project-member Apr 19 14:55:17 user devstack@n-api.service[61254]: X-User-Domain-Id: default Apr 19 14:55:17 user devstack@n-api.service[61254]: X-User-Domain-Name: Default Apr 19 14:55:17 user devstack@n-api.service[61254]: X-User-Id: 31b888ae3c3540df8cf7953ed5ed90d1 Apr 19 14:55:17 user devstack@n-api.service[61254]: X-User-Name: tempest-ServerStableDeviceRescueTest-1761332643-project-member Apr 19 14:55:17 user devstack@n-api.service[61254]: method: > Apr 19 14:55:17 user devstack@n-api.service[61254]: exception: Instance 04ea16ad-a0eb-4187-a966-7ec4f2396852 could not be found. Apr 19 14:55:17 user devstack@n-api.service[61254]: action_args: {'id': '04ea16ad-a0eb-4187-a966-7ec4f2396852'} Apr 19 14:55:17 user devstack@n-api.service[61254]: {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:55:17 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:55:17 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:55:17 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:55:17 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:55:17 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:55:17 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:55:17 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:55:17 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:55:17 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:55:17 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04ea16ad-a0eb-4187-a966-7ec4f2396852 could not be found. Apr 19 14:55:17 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:55:17 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:55:17 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:55:17 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:55:17 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:55:17 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:55:17 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:55:17 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:55:17 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:55:17 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:55:17 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:55:17 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:55:17 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:55:17 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:55:17 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:55:17 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:55:17 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04ea16ad-a0eb-4187-a966-7ec4f2396852 could not be found. Apr 19 14:55:17 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:55:17 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:55:17 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:55:17 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:55:17 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:55:17 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:55:17 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:55:17 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:55:17 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04ea16ad-a0eb-4187-a966-7ec4f2396852 could not be found. Apr 19 14:55:17 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:55:17 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-7b81d500-dc6c-4fd7-bc25-b2c36b5f5c79 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Returning 404 to user: Instance 04ea16ad-a0eb-4187-a966-7ec4f2396852 could not be found. {{(pid=61254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:55:17 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-7b81d500-dc6c-4fd7-bc25-b2c36b5f5c79 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04ea16ad-a0eb-4187-a966-7ec4f2396852" status: 404 len: 111 microversion: 2.1 time: 0.031382 Apr 19 14:55:17 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 72/218] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:55:17 2023] GET /compute/v2.1/servers/04ea16ad-a0eb-4187-a966-7ec4f2396852 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:55:17 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-2f706881-dc61-4668-b39c-d671bc12ea21 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] Calling method '.version_select at 0x7f3cfa845120>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:55:17 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-2f706881-dc61-4668-b39c-d671bc12ea21 tempest-ServerStableDeviceRescueTest-1761332643 tempest-ServerStableDeviceRescueTest-1761332643-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-417331245" status: 202 len: 0 microversion: 2.1 time: 0.033463 Apr 19 14:55:17 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 73/219] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 19 14:55:17 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-417331245 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 14:55:17 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-6a37e11c-c63b-43aa-af83-73feebfd5517 req-52f433d0-e6bc-413e-83af-9b19d68783e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6930db7c-e8e0-4d1d-ac99-952827ff1aa9", "name": "network-vif-unplugged", "status": "completed", "tag": "a9320570-bc89-45b1-a97c-3da53f2e4b70"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:55:17 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-6a37e11c-c63b-43aa-af83-73feebfd5517 req-52f433d0-e6bc-413e-83af-9b19d68783e5 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:55:17 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-6a37e11c-c63b-43aa-af83-73feebfd5517 req-52f433d0-e6bc-413e-83af-9b19d68783e5 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:55:17 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-6a37e11c-c63b-43aa-af83-73feebfd5517 req-52f433d0-e6bc-413e-83af-9b19d68783e5 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:55:17 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-6a37e11c-c63b-43aa-af83-73feebfd5517 req-52f433d0-e6bc-413e-83af-9b19d68783e5 service nova] Creating event network-vif-unplugged:a9320570-bc89-45b1-a97c-3da53f2e4b70 for instance 6930db7c-e8e0-4d1d-ac99-952827ff1aa9 on user Apr 19 14:55:17 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [req-6a37e11c-c63b-43aa-af83-73feebfd5517 req-52f433d0-e6bc-413e-83af-9b19d68783e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032676 Apr 19 14:55:17 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 75/220] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:55:17 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:55:19 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [req-4b079f97-5465-4576-9b0c-3513de050f86 req-103ea4df-76f3-4a05-8bd5-2a0148f80d0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6930db7c-e8e0-4d1d-ac99-952827ff1aa9", "name": "network-vif-plugged", "status": "completed", "tag": "a9320570-bc89-45b1-a97c-3da53f2e4b70"}]} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:55:19 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-4b079f97-5465-4576-9b0c-3513de050f86 req-103ea4df-76f3-4a05-8bd5-2a0148f80d0a service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:55:19 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-4b079f97-5465-4576-9b0c-3513de050f86 req-103ea4df-76f3-4a05-8bd5-2a0148f80d0a service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:55:19 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-4b079f97-5465-4576-9b0c-3513de050f86 req-103ea4df-76f3-4a05-8bd5-2a0148f80d0a service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:55:19 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-4b079f97-5465-4576-9b0c-3513de050f86 req-103ea4df-76f3-4a05-8bd5-2a0148f80d0a service nova] Creating event network-vif-plugged:a9320570-bc89-45b1-a97c-3da53f2e4b70 for instance 6930db7c-e8e0-4d1d-ac99-952827ff1aa9 on user Apr 19 14:55:19 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [req-4b079f97-5465-4576-9b0c-3513de050f86 req-103ea4df-76f3-4a05-8bd5-2a0148f80d0a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055231 Apr 19 14:55:19 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 73/221] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:55:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:55:21 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [req-97778b04-3e00-4bcb-ae3b-d64eefb4f386 req-99cb4bc5-f266-454a-a35d-441a5184cb2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6930db7c-e8e0-4d1d-ac99-952827ff1aa9", "name": "network-vif-plugged", "status": "completed", "tag": "a9320570-bc89-45b1-a97c-3da53f2e4b70"}, {"server_uuid": "6930db7c-e8e0-4d1d-ac99-952827ff1aa9", "name": "network-vif-plugged", "status": "completed", "tag": "a9320570-bc89-45b1-a97c-3da53f2e4b70"}]} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:55:21 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-97778b04-3e00-4bcb-ae3b-d64eefb4f386 req-99cb4bc5-f266-454a-a35d-441a5184cb2b service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:55:21 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-97778b04-3e00-4bcb-ae3b-d64eefb4f386 req-99cb4bc5-f266-454a-a35d-441a5184cb2b service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:55:21 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-97778b04-3e00-4bcb-ae3b-d64eefb4f386 req-99cb4bc5-f266-454a-a35d-441a5184cb2b service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:55:21 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-97778b04-3e00-4bcb-ae3b-d64eefb4f386 req-99cb4bc5-f266-454a-a35d-441a5184cb2b service nova] Creating event network-vif-plugged:a9320570-bc89-45b1-a97c-3da53f2e4b70 for instance 6930db7c-e8e0-4d1d-ac99-952827ff1aa9 on user Apr 19 14:55:21 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-97778b04-3e00-4bcb-ae3b-d64eefb4f386 req-99cb4bc5-f266-454a-a35d-441a5184cb2b service nova] Creating event network-vif-plugged:a9320570-bc89-45b1-a97c-3da53f2e4b70 for instance 6930db7c-e8e0-4d1d-ac99-952827ff1aa9 on user Apr 19 14:55:21 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [req-97778b04-3e00-4bcb-ae3b-d64eefb4f386 req-99cb4bc5-f266-454a-a35d-441a5184cb2b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037495 Apr 19 14:55:21 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 74/222] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:55:21 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:55:23 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-c0a4c64e-ac72-4fe8-81e3-e92323eb54b4 tempest-VolumesGetTestJSON-480567671 tempest-VolumesGetTestJSON-480567671-project-member] Action: 'create', calling method: .version_select at 0x7f3cfb588d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-600826343", "metadata": {"Type": "work"}}} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:55:23 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-c0a4c64e-ac72-4fe8-81e3-e92323eb54b4 tempest-VolumesGetTestJSON-480567671 tempest-VolumesGetTestJSON-480567671-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.474425 Apr 19 14:55:23 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 76/223] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 19 14:55:23 2023] POST /compute/v2.1/os-volumes => generated 352 bytes in 477 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 19 14:55:23 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-e9e10340-6c45-4197-b279-5c12786bc40c tempest-VolumesGetTestJSON-480567671 tempest-VolumesGetTestJSON-480567671-project-member] Calling method '.version_select at 0x7f3cfa94a3b0>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:55:23 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-e9e10340-6c45-4197-b279-5c12786bc40c tempest-VolumesGetTestJSON-480567671 tempest-VolumesGetTestJSON-480567671-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3a922d90-f733-4968-b505-370b8c62069e" status: 200 len: 349 microversion: 2.1 time: 0.062952 Apr 19 14:55:23 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 74/224] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 19 14:55:23 2023] GET /compute/v2.1/os-volumes/3a922d90-f733-4968-b505-370b8c62069e => generated 349 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:55:24 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-57d6df83-cbc1-4f88-8639-45e7a8bd4b42 tempest-VolumesGetTestJSON-480567671 tempest-VolumesGetTestJSON-480567671-project-member] Calling method '.version_select at 0x7f3cfa845a20>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:55:24 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-57d6df83-cbc1-4f88-8639-45e7a8bd4b42 tempest-VolumesGetTestJSON-480567671 tempest-VolumesGetTestJSON-480567671-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3a922d90-f733-4968-b505-370b8c62069e" status: 200 len: 349 microversion: 2.1 time: 0.063635 Apr 19 14:55:24 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 75/225] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 19 14:55:24 2023] GET /compute/v2.1/os-volumes/3a922d90-f733-4968-b505-370b8c62069e => generated 349 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 14:55:24 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-0aba3e0a-e6e9-4c20-9874-986e0da11210 tempest-VolumesGetTestJSON-480567671 tempest-VolumesGetTestJSON-480567671-project-member] Calling method '.version_select at 0x7f3cfa9c1d80>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:55:24 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-0aba3e0a-e6e9-4c20-9874-986e0da11210 tempest-VolumesGetTestJSON-480567671 tempest-VolumesGetTestJSON-480567671-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/3a922d90-f733-4968-b505-370b8c62069e" status: 202 len: 0 microversion: 2.1 time: 0.118976 Apr 19 14:55:24 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 77/226] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 19 14:55:24 2023] DELETE /compute/v2.1/os-volumes/3a922d90-f733-4968-b505-370b8c62069e => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 14:55:24 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-dce2f23e-b6e8-43b7-a567-c7b36e984f60 tempest-VolumesGetTestJSON-480567671 tempest-VolumesGetTestJSON-480567671-project-member] Calling method '.version_select at 0x7f3cfa9497e0>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:55:25 user devstack@n-api.service[61254]: INFO nova.api.openstack.wsgi [None req-dce2f23e-b6e8-43b7-a567-c7b36e984f60 tempest-VolumesGetTestJSON-480567671 tempest-VolumesGetTestJSON-480567671-project-member] HTTP exception thrown: Volume 3a922d90-f733-4968-b505-370b8c62069e could not be found. Apr 19 14:55:25 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-dce2f23e-b6e8-43b7-a567-c7b36e984f60 tempest-VolumesGetTestJSON-480567671 tempest-VolumesGetTestJSON-480567671-project-member] Request method failure captured: Apr 19 14:55:25 user devstack@n-api.service[61254]: request: GET /compute/v2.1/os-volumes/3a922d90-f733-4968-b505-370b8c62069e HTTP/1.1 Apr 19 14:55:25 user devstack@n-api.service[61254]: Accept: application/json Apr 19 14:55:25 user devstack@n-api.service[61254]: Accept-Encoding: identity Apr 19 14:55:25 user devstack@n-api.service[61254]: Connection: close Apr 19 14:55:25 user devstack@n-api.service[61254]: Content-Length: 0 Apr 19 14:55:25 user devstack@n-api.service[61254]: Content-Type: application/json Apr 19 14:55:25 user devstack@n-api.service[61254]: Host: 10.0.0.210 Apr 19 14:55:25 user devstack@n-api.service[61254]: Openstack-System-Scope: None Apr 19 14:55:25 user devstack@n-api.service[61254]: User-Agent: python-urllib3/1.26.15 Apr 19 14:55:25 user devstack@n-api.service[61254]: X-Auth-Token: gAAAAABkQADbSveTtMgLaBK3t9aCvXwoJvB4NHrq_VMrd_I9SNzR4rU5o_HEfEOe5QYxSHpWchFcW6p38CPp-fGTNKykjVA85ckqIx3SNK67Z2j52UftyV3Qw0-WV_aBHZFw4KRipkZKQmMVBx1p5XKb8nf7uxWA7X9xJ-YDBPRKr9d896QqS-8 Apr 19 14:55:25 user devstack@n-api.service[61254]: X-Domain-Id: None Apr 19 14:55:25 user devstack@n-api.service[61254]: X-Domain-Name: None Apr 19 14:55:25 user devstack@n-api.service[61254]: X-Identity-Status: Confirmed Apr 19 14:55:25 user devstack@n-api.service[61254]: X-Is-Admin-Project: True Apr 19 14:55:25 user devstack@n-api.service[61254]: X-Project-Domain-Id: default Apr 19 14:55:25 user devstack@n-api.service[61254]: X-Project-Domain-Name: Default Apr 19 14:55:25 user devstack@n-api.service[61254]: X-Project-Id: c6f379537fa0492ebb968f85242d3595 Apr 19 14:55:25 user devstack@n-api.service[61254]: X-Project-Name: tempest-VolumesGetTestJSON-480567671 Apr 19 14:55:25 user devstack@n-api.service[61254]: X-Role: member,reader Apr 19 14:55:25 user devstack@n-api.service[61254]: X-Roles: member,reader Apr 19 14:55:25 user devstack@n-api.service[61254]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c6f379537fa0492ebb968f85242d3595"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c6f379537fa0492ebb968f85242d3595"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c6f379537fa0492ebb968f85242d3595"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 14:55:25 user devstack@n-api.service[61254]: X-Tenant: tempest-VolumesGetTestJSON-480567671 Apr 19 14:55:25 user devstack@n-api.service[61254]: X-Tenant-Id: c6f379537fa0492ebb968f85242d3595 Apr 19 14:55:25 user devstack@n-api.service[61254]: X-Tenant-Name: tempest-VolumesGetTestJSON-480567671 Apr 19 14:55:25 user devstack@n-api.service[61254]: X-User: tempest-VolumesGetTestJSON-480567671-project-member Apr 19 14:55:25 user devstack@n-api.service[61254]: X-User-Domain-Id: default Apr 19 14:55:25 user devstack@n-api.service[61254]: X-User-Domain-Name: Default Apr 19 14:55:25 user devstack@n-api.service[61254]: X-User-Id: faac1d98f6ce4912a3e6250fcdd2dff5 Apr 19 14:55:25 user devstack@n-api.service[61254]: X-User-Name: tempest-VolumesGetTestJSON-480567671-project-member Apr 19 14:55:25 user devstack@n-api.service[61254]: method: Apr 19 14:55:25 user devstack@n-api.service[61254]: exception: Volume 3a922d90-f733-4968-b505-370b8c62069e could not be found. Apr 19 14:55:25 user devstack@n-api.service[61254]: action_args: {'id': '3a922d90-f733-4968-b505-370b8c62069e'} Apr 19 14:55:25 user devstack@n-api.service[61254]: {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3a922d90-f733-4968-b505-370b8c62069e could not be found. (HTTP 404) (Request-ID: req-4ad7ab8d-e441-4e1a-895c-289bd0087e01) Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3a922d90-f733-4968-b505-370b8c62069e could not be found. Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3a922d90-f733-4968-b505-370b8c62069e could not be found. Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3a922d90-f733-4968-b505-370b8c62069e could not be found. Apr 19 14:55:25 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:55:25 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-dce2f23e-b6e8-43b7-a567-c7b36e984f60 tempest-VolumesGetTestJSON-480567671 tempest-VolumesGetTestJSON-480567671-project-member] Returning 404 to user: Volume 3a922d90-f733-4968-b505-370b8c62069e could not be found. {{(pid=61254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:55:25 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-dce2f23e-b6e8-43b7-a567-c7b36e984f60 tempest-VolumesGetTestJSON-480567671 tempest-VolumesGetTestJSON-480567671-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3a922d90-f733-4968-b505-370b8c62069e" status: 404 len: 109 microversion: 2.1 time: 0.035422 Apr 19 14:55:25 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 75/227] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 19 14:55:24 2023] GET /compute/v2.1/os-volumes/3a922d90-f733-4968-b505-370b8c62069e => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:55:40 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:55:40 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:55:40 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-58ade893-157a-4a48-9a09-86585e5c105c tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:55:40 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-58ade893-157a-4a48-9a09-86585e5c105c tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] [instance: 3478c35c-c27b-4480-ad89-4b9cd7ebeb40] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:55:40 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-58ade893-157a-4a48-9a09-86585e5c105c tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:55:40 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-58ade893-157a-4a48-9a09-86585e5c105c tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:55:40 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-58ade893-157a-4a48-9a09-86585e5c105c tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:55:40 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-58ade893-157a-4a48-9a09-86585e5c105c tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:55:40 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-58ade893-157a-4a48-9a09-86585e5c105c tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:55:40 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-58ade893-157a-4a48-9a09-86585e5c105c tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:55:40 user devstack@n-api.service[61253]: DEBUG nova.policy [None req-58ade893-157a-4a48-9a09-86585e5c105c tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2985fabe974b80a37af599e28c8fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c121e3e3fa440d8a2e1c3e42975a9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61253) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:55:40 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-58ade893-157a-4a48-9a09-86585e5c105c tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3478c35c-c27b-4480-ad89-4b9cd7ebeb40" status: 200 len: 1537 microversion: 2.1 time: 0.416167 Apr 19 14:55:40 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 76/228] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:55:40 2023] GET /compute/v2.1/servers/3478c35c-c27b-4480-ad89-4b9cd7ebeb40 => generated 1537 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:55:42 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_api:SELECT=6 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:55:42 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell1:SELECT=14 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:55:42 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-5be6a99b-c1d2-4eb4-9923-09741352332d tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:55:42 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-5be6a99b-c1d2-4eb4-9923-09741352332d tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] [instance: 0a8c97e3-3c9e-4a4a-bc86-ee3c313cb1d3] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:55:42 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-5be6a99b-c1d2-4eb4-9923-09741352332d tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:55:42 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-5be6a99b-c1d2-4eb4-9923-09741352332d tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:55:42 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-5be6a99b-c1d2-4eb4-9923-09741352332d tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:55:42 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-5be6a99b-c1d2-4eb4-9923-09741352332d tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:55:42 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-5be6a99b-c1d2-4eb4-9923-09741352332d tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:55:42 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-5be6a99b-c1d2-4eb4-9923-09741352332d tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:55:42 user devstack@n-api.service[61255]: INFO nova.api.openstack.wsgi [None req-5be6a99b-c1d2-4eb4-9923-09741352332d tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] HTTP exception thrown: Instance 0a8c97e3-3c9e-4a4a-bc86-ee3c313cb1d3 could not be found. Apr 19 14:55:42 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-5be6a99b-c1d2-4eb4-9923-09741352332d tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Request method failure captured: Apr 19 14:55:42 user devstack@n-api.service[61255]: request: GET /compute/v2.1/servers/0a8c97e3-3c9e-4a4a-bc86-ee3c313cb1d3 HTTP/1.1 Apr 19 14:55:42 user devstack@n-api.service[61255]: Accept: application/json Apr 19 14:55:42 user devstack@n-api.service[61255]: Accept-Encoding: identity Apr 19 14:55:42 user devstack@n-api.service[61255]: Connection: close Apr 19 14:55:42 user devstack@n-api.service[61255]: Content-Length: 0 Apr 19 14:55:42 user devstack@n-api.service[61255]: Content-Type: application/json Apr 19 14:55:42 user devstack@n-api.service[61255]: Host: 10.0.0.210 Apr 19 14:55:42 user devstack@n-api.service[61255]: Openstack-System-Scope: None Apr 19 14:55:42 user devstack@n-api.service[61255]: User-Agent: python-urllib3/1.26.15 Apr 19 14:55:42 user devstack@n-api.service[61255]: X-Auth-Token: gAAAAABkP_-7uQ4onjKbLKosvPMLyf_P-W_7RI6oGGymarzIji4ujzAdtGn3WT5cVdNh2qQAgjy4-ZyamhJcHbxPnJ40DXzRRyDs8wA60kgR8W5zr3io8r3buMz2k6RJRKQ4urLrM-GzHTnH1hwTbTaaLo1UvGUalteNyC_yGJiXenA-H0GWRgw Apr 19 14:55:42 user devstack@n-api.service[61255]: X-Domain-Id: None Apr 19 14:55:42 user devstack@n-api.service[61255]: X-Domain-Name: None Apr 19 14:55:42 user devstack@n-api.service[61255]: X-Identity-Status: Confirmed Apr 19 14:55:42 user devstack@n-api.service[61255]: X-Is-Admin-Project: True Apr 19 14:55:42 user devstack@n-api.service[61255]: X-Project-Domain-Id: default Apr 19 14:55:42 user devstack@n-api.service[61255]: X-Project-Domain-Name: Default Apr 19 14:55:42 user devstack@n-api.service[61255]: X-Project-Id: da86be1a28254582b530973fbf7f724c Apr 19 14:55:42 user devstack@n-api.service[61255]: X-Project-Name: tempest-VolumesAdminNegativeTest-1054877387 Apr 19 14:55:42 user devstack@n-api.service[61255]: X-Role: member,reader Apr 19 14:55:42 user devstack@n-api.service[61255]: X-Roles: member,reader Apr 19 14:55:42 user devstack@n-api.service[61255]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/da86be1a28254582b530973fbf7f724c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/da86be1a28254582b530973fbf7f724c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/da86be1a28254582b530973fbf7f724c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 14:55:42 user devstack@n-api.service[61255]: X-Tenant: tempest-VolumesAdminNegativeTest-1054877387 Apr 19 14:55:42 user devstack@n-api.service[61255]: X-Tenant-Id: da86be1a28254582b530973fbf7f724c Apr 19 14:55:42 user devstack@n-api.service[61255]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1054877387 Apr 19 14:55:42 user devstack@n-api.service[61255]: X-User: tempest-VolumesAdminNegativeTest-1054877387-project-member Apr 19 14:55:42 user devstack@n-api.service[61255]: X-User-Domain-Id: default Apr 19 14:55:42 user devstack@n-api.service[61255]: X-User-Domain-Name: Default Apr 19 14:55:42 user devstack@n-api.service[61255]: X-User-Id: 708068c5f6f5451fbcd6c24235a185d2 Apr 19 14:55:42 user devstack@n-api.service[61255]: X-User-Name: tempest-VolumesAdminNegativeTest-1054877387-project-member Apr 19 14:55:42 user devstack@n-api.service[61255]: method: > Apr 19 14:55:42 user devstack@n-api.service[61255]: exception: Instance 0a8c97e3-3c9e-4a4a-bc86-ee3c313cb1d3 could not be found. Apr 19 14:55:42 user devstack@n-api.service[61255]: action_args: {'id': '0a8c97e3-3c9e-4a4a-bc86-ee3c313cb1d3'} Apr 19 14:55:42 user devstack@n-api.service[61255]: {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:55:42 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:55:42 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:55:42 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:55:42 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:55:42 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:55:42 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:55:42 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:55:42 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:55:42 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:55:42 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a8c97e3-3c9e-4a4a-bc86-ee3c313cb1d3 could not be found. Apr 19 14:55:42 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:55:42 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:55:42 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:55:42 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:55:42 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:55:42 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:55:42 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:55:42 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:55:42 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:55:42 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:55:42 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:55:42 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:55:42 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:55:42 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:55:42 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:55:42 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:55:42 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a8c97e3-3c9e-4a4a-bc86-ee3c313cb1d3 could not be found. Apr 19 14:55:42 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:55:42 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:55:42 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:55:42 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:55:42 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:55:42 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:55:42 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:55:42 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:55:42 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a8c97e3-3c9e-4a4a-bc86-ee3c313cb1d3 could not be found. Apr 19 14:55:42 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:55:42 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-5be6a99b-c1d2-4eb4-9923-09741352332d tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Returning 404 to user: Instance 0a8c97e3-3c9e-4a4a-bc86-ee3c313cb1d3 could not be found. {{(pid=61255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:55:42 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-5be6a99b-c1d2-4eb4-9923-09741352332d tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0a8c97e3-3c9e-4a4a-bc86-ee3c313cb1d3" status: 404 len: 111 microversion: 2.1 time: 0.036100 Apr 19 14:55:42 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 78/229] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:55:42 2023] GET /compute/v2.1/servers/0a8c97e3-3c9e-4a4a-bc86-ee3c313cb1d3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:55:42 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_api:SELECT=8 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:55:42 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell1:SELECT=10 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:55:42 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-a2a9ed7a-c722-41e9-8496-99b6ab05e9fd tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:55:42 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-a2a9ed7a-c722-41e9-8496-99b6ab05e9fd tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] [instance: a499484d-dfca-44f4-9ab0-ecabbf88f06d] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:55:42 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-a2a9ed7a-c722-41e9-8496-99b6ab05e9fd tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:55:42 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-a2a9ed7a-c722-41e9-8496-99b6ab05e9fd tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:55:42 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-a2a9ed7a-c722-41e9-8496-99b6ab05e9fd tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:55:42 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-a2a9ed7a-c722-41e9-8496-99b6ab05e9fd tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:55:42 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-a2a9ed7a-c722-41e9-8496-99b6ab05e9fd tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:55:42 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-a2a9ed7a-c722-41e9-8496-99b6ab05e9fd tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:55:42 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-a2a9ed7a-c722-41e9-8496-99b6ab05e9fd tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] [instance: a499484d-dfca-44f4-9ab0-ecabbf88f06d] Going to try to terminate instance {{(pid=61254) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 14:55:42 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-a2a9ed7a-c722-41e9-8496-99b6ab05e9fd tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a499484d-dfca-44f4-9ab0-ecabbf88f06d" status: 204 len: 0 microversion: 2.1 time: 0.151826 Apr 19 14:55:42 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 76/230] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 14:55:42 2023] DELETE /compute/v2.1/servers/a499484d-dfca-44f4-9ab0-ecabbf88f06d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 14:55:42 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-3b5e26e4-b940-4082-8fbe-1c6092f94c71 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:55:42 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-3b5e26e4-b940-4082-8fbe-1c6092f94c71 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] [instance: a499484d-dfca-44f4-9ab0-ecabbf88f06d] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:55:42 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-3b5e26e4-b940-4082-8fbe-1c6092f94c71 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:55:42 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-3b5e26e4-b940-4082-8fbe-1c6092f94c71 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:55:42 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-3b5e26e4-b940-4082-8fbe-1c6092f94c71 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:55:42 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-3b5e26e4-b940-4082-8fbe-1c6092f94c71 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:55:42 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-3b5e26e4-b940-4082-8fbe-1c6092f94c71 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:55:42 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-3b5e26e4-b940-4082-8fbe-1c6092f94c71 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:55:42 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-7f1d279f-162d-4134-93bb-30c62ccab0a3 req-4d17b7d1-c426-4a01-bfc4-295524112335 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a499484d-dfca-44f4-9ab0-ecabbf88f06d", "name": "network-vif-unplugged", "status": "completed", "tag": "cd2ec5dc-a7b9-4af8-8e23-c269ffdd095f"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:55:42 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-7f1d279f-162d-4134-93bb-30c62ccab0a3 req-4d17b7d1-c426-4a01-bfc4-295524112335 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:55:42 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-7f1d279f-162d-4134-93bb-30c62ccab0a3 req-4d17b7d1-c426-4a01-bfc4-295524112335 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:55:42 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-7f1d279f-162d-4134-93bb-30c62ccab0a3 req-4d17b7d1-c426-4a01-bfc4-295524112335 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:55:42 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-7f1d279f-162d-4134-93bb-30c62ccab0a3 req-4d17b7d1-c426-4a01-bfc4-295524112335 service nova] Creating event network-vif-unplugged:cd2ec5dc-a7b9-4af8-8e23-c269ffdd095f for instance a499484d-dfca-44f4-9ab0-ecabbf88f06d on user Apr 19 14:55:42 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [req-7f1d279f-162d-4134-93bb-30c62ccab0a3 req-4d17b7d1-c426-4a01-bfc4-295524112335 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111790 Apr 19 14:55:42 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 79/231] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:55:42 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:55:43 user devstack@n-api.service[61253]: DEBUG nova.policy [None req-3b5e26e4-b940-4082-8fbe-1c6092f94c71 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708068c5f6f5451fbcd6c24235a185d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da86be1a28254582b530973fbf7f724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61253) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:55:43 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-3b5e26e4-b940-4082-8fbe-1c6092f94c71 tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a499484d-dfca-44f4-9ab0-ecabbf88f06d" status: 200 len: 1669 microversion: 2.1 time: 0.642869 Apr 19 14:55:43 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 77/232] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:55:42 2023] GET /compute/v2.1/servers/a499484d-dfca-44f4-9ab0-ecabbf88f06d => generated 1669 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:55:44 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [req-47551062-df97-4c28-a3f3-3942909eee31 req-56eafff2-5a44-4f05-a684-d38c2121ddf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a499484d-dfca-44f4-9ab0-ecabbf88f06d", "name": "network-vif-plugged", "status": "completed", "tag": "cd2ec5dc-a7b9-4af8-8e23-c269ffdd095f"}, {"server_uuid": "a499484d-dfca-44f4-9ab0-ecabbf88f06d", "name": "network-vif-deleted", "tag": "cd2ec5dc-a7b9-4af8-8e23-c269ffdd095f"}]} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:55:44 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-47551062-df97-4c28-a3f3-3942909eee31 req-56eafff2-5a44-4f05-a684-d38c2121ddf3 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:55:44 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-47551062-df97-4c28-a3f3-3942909eee31 req-56eafff2-5a44-4f05-a684-d38c2121ddf3 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:55:44 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-47551062-df97-4c28-a3f3-3942909eee31 req-56eafff2-5a44-4f05-a684-d38c2121ddf3 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:55:44 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-47551062-df97-4c28-a3f3-3942909eee31 req-56eafff2-5a44-4f05-a684-d38c2121ddf3 service nova] Creating event network-vif-plugged:cd2ec5dc-a7b9-4af8-8e23-c269ffdd095f for instance a499484d-dfca-44f4-9ab0-ecabbf88f06d on user Apr 19 14:55:44 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-47551062-df97-4c28-a3f3-3942909eee31 req-56eafff2-5a44-4f05-a684-d38c2121ddf3 service nova] Creating event network-vif-deleted:cd2ec5dc-a7b9-4af8-8e23-c269ffdd095f for instance a499484d-dfca-44f4-9ab0-ecabbf88f06d on user Apr 19 14:55:44 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [req-47551062-df97-4c28-a3f3-3942909eee31 req-56eafff2-5a44-4f05-a684-d38c2121ddf3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033260 Apr 19 14:55:44 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 77/233] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:55:44 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:55:54 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_api:SELECT=4 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:55:54 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell1:SELECT=4 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:55:54 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-8029f1f3-41be-46ae-9360-88f665e87ad2 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:55:54 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-8029f1f3-41be-46ae-9360-88f665e87ad2 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] [instance: ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:55:54 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-8029f1f3-41be-46ae-9360-88f665e87ad2 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:55:54 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-8029f1f3-41be-46ae-9360-88f665e87ad2 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:55:54 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-8029f1f3-41be-46ae-9360-88f665e87ad2 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:55:54 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-8029f1f3-41be-46ae-9360-88f665e87ad2 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:55:54 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-8029f1f3-41be-46ae-9360-88f665e87ad2 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:55:54 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-8029f1f3-41be-46ae-9360-88f665e87ad2 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:55:55 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-8029f1f3-41be-46ae-9360-88f665e87ad2 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.337576 Apr 19 14:55:55 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 80/234] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 14:55:54 2023] GET /compute/v2.1/servers/ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084/os-interface => generated 283 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:55:55 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [req-dd6e283a-707c-4c0b-b6b9-6528b02ebf8a req-a6195739-f1de-485b-9d4b-984eb33affab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084", "tag": "4f5f9b2b-57b0-4c33-8f63-bac94722e9d0"}]} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:55:55 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_api:SELECT=4 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:55:55 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell1:SELECT=12 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:55:55 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-dd6e283a-707c-4c0b-b6b9-6528b02ebf8a req-a6195739-f1de-485b-9d4b-984eb33affab service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:55:55 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-dd6e283a-707c-4c0b-b6b9-6528b02ebf8a req-a6195739-f1de-485b-9d4b-984eb33affab service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:55:55 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-dd6e283a-707c-4c0b-b6b9-6528b02ebf8a req-a6195739-f1de-485b-9d4b-984eb33affab service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:55:55 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-dd6e283a-707c-4c0b-b6b9-6528b02ebf8a req-a6195739-f1de-485b-9d4b-984eb33affab service nova] Creating event network-changed:4f5f9b2b-57b0-4c33-8f63-bac94722e9d0 for instance ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084 on user Apr 19 14:55:55 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [req-dd6e283a-707c-4c0b-b6b9-6528b02ebf8a req-a6195739-f1de-485b-9d4b-984eb33affab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042293 Apr 19 14:55:55 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 78/235] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:55:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:55:56 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:55:56 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:55:56 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-8993c785-9088-4364-a2db-ef17577c8029 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:55:56 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-8993c785-9088-4364-a2db-ef17577c8029 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] [instance: ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:55:56 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-8993c785-9088-4364-a2db-ef17577c8029 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:55:56 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-8993c785-9088-4364-a2db-ef17577c8029 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:55:56 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-8993c785-9088-4364-a2db-ef17577c8029 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:55:56 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-8993c785-9088-4364-a2db-ef17577c8029 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:55:56 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-8993c785-9088-4364-a2db-ef17577c8029 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:55:56 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-8993c785-9088-4364-a2db-ef17577c8029 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:55:56 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-8993c785-9088-4364-a2db-ef17577c8029 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084/ips" status: 200 len: 108 microversion: 2.1 time: 0.042890 Apr 19 14:55:56 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 78/236] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 19 14:55:55 2023] GET /compute/v2.1/servers/ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084/ips => generated 108 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:55:57 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-dac5f99e-89f6-4a3b-a76e-6b7f68aae7eb tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:55:57 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-dac5f99e-89f6-4a3b-a76e-6b7f68aae7eb tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] [instance: ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:55:57 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-dac5f99e-89f6-4a3b-a76e-6b7f68aae7eb tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:55:57 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-dac5f99e-89f6-4a3b-a76e-6b7f68aae7eb tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:55:57 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-dac5f99e-89f6-4a3b-a76e-6b7f68aae7eb tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:55:57 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-dac5f99e-89f6-4a3b-a76e-6b7f68aae7eb tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:55:57 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-dac5f99e-89f6-4a3b-a76e-6b7f68aae7eb tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:55:57 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-dac5f99e-89f6-4a3b-a76e-6b7f68aae7eb tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:55:57 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-dac5f99e-89f6-4a3b-a76e-6b7f68aae7eb tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] [instance: ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084] Going to try to terminate instance {{(pid=61255) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 14:55:57 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-dac5f99e-89f6-4a3b-a76e-6b7f68aae7eb tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084" status: 204 len: 0 microversion: 2.1 time: 0.140628 Apr 19 14:55:57 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 81/237] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 14:55:57 2023] DELETE /compute/v2.1/servers/ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 14:55:57 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-758ab553-1598-47e9-9fa6-c93a07ca7a58 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:55:57 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-758ab553-1598-47e9-9fa6-c93a07ca7a58 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] [instance: ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:55:57 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-758ab553-1598-47e9-9fa6-c93a07ca7a58 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:55:57 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-758ab553-1598-47e9-9fa6-c93a07ca7a58 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:55:57 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-758ab553-1598-47e9-9fa6-c93a07ca7a58 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:55:57 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-758ab553-1598-47e9-9fa6-c93a07ca7a58 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:55:57 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-758ab553-1598-47e9-9fa6-c93a07ca7a58 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:55:57 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-758ab553-1598-47e9-9fa6-c93a07ca7a58 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:55:57 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-39b2b6f1-c9aa-450b-9f35-b37c30573948 tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Action: 'create', calling method: .version_select at 0x7f3cfa846830>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-265701621", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBXPfBlnKmiYoCMQHEozZpVDBR1vQ7mMA3b0HVquQDJixWTTJSlP1U/xCCTkO/SAhuMiwD68WOYT+8CS6ZIC+5i/OicC61AsTVYgs5TeX9O2jKGRk1VL2xUJM04QX/5yQ=="}} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:55:57 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-758ab553-1598-47e9-9fa6-c93a07ca7a58 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b23f0d7300496990e74b2fb4945c15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5079ce8a52417fb2b8b8122bfeaa5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:55:57 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-758ab553-1598-47e9-9fa6-c93a07ca7a58 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084" status: 200 len: 1669 microversion: 2.1 time: 0.231337 Apr 19 14:55:57 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 79/238] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:55:57 2023] GET /compute/v2.1/servers/ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084 => generated 1669 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:55:57 user devstack@n-api.service[61253]: DEBUG nova.quota [None req-39b2b6f1-c9aa-450b-9f35-b37c30573948 tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Getting quotas for project adb7a6d6040c4475b034b1f33f97a491. Resources: {'key_pairs'} {{(pid=61253) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:55:57 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-34759e42-86f8-44d5-841d-d05f60aa137a req-57255e7b-2f47-43fa-a672-06b6df8fc944 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084", "name": "network-vif-unplugged", "status": "completed", "tag": "4f5f9b2b-57b0-4c33-8f63-bac94722e9d0"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:55:57 user devstack@n-api.service[61253]: DEBUG nova.quota [None req-39b2b6f1-c9aa-450b-9f35-b37c30573948 tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Getting quotas for user b2057a3280134a99bc9a97c66ad51220 and project adb7a6d6040c4475b034b1f33f97a491. Resources: {'key_pairs'} {{(pid=61253) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:55:57 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-34759e42-86f8-44d5-841d-d05f60aa137a req-57255e7b-2f47-43fa-a672-06b6df8fc944 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:55:57 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-34759e42-86f8-44d5-841d-d05f60aa137a req-57255e7b-2f47-43fa-a672-06b6df8fc944 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:55:57 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-34759e42-86f8-44d5-841d-d05f60aa137a req-57255e7b-2f47-43fa-a672-06b6df8fc944 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:55:57 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-39b2b6f1-c9aa-450b-9f35-b37c30573948 tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.312695 Apr 19 14:55:57 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 79/239] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 14:55:57 2023] POST /compute/v2.1/os-keypairs => generated 404 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:55:57 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-34759e42-86f8-44d5-841d-d05f60aa137a req-57255e7b-2f47-43fa-a672-06b6df8fc944 service nova] Creating event network-vif-unplugged:4f5f9b2b-57b0-4c33-8f63-bac94722e9d0 for instance ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084 on user Apr 19 14:55:57 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [req-34759e42-86f8-44d5-841d-d05f60aa137a req-57255e7b-2f47-43fa-a672-06b6df8fc944 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042507 Apr 19 14:55:57 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 82/240] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:55:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:55:59 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-389fe67f-da02-4a0f-aa4a-402aff9903d1 tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-368163969", "imageRef": "283dcfe8-75fd-4917-902e-1b940387187c", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-265701621", "security_groups": [{"name": "tempest-secgroup-smoke-1440741971"}], "networks": [{"uuid": "15212b97-6bac-48a8-a4e2-1c59f9303d73"}]}} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:55:59 user devstack@n-api.service[61254]: DEBUG nova.network.neutron [None req-389fe67f-da02-4a0f-aa4a-402aff9903d1 tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] validate_networks() for [('15212b97-6bac-48a8-a4e2-1c59f9303d73', None, None, None, None, None)] {{(pid=61254) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 14:55:59 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [req-efc87ad8-bc4c-4cd5-a906-86b8bb011ae9 req-db89cb86-7b70-4c36-a514-2b4316b62af8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084", "name": "network-vif-plugged", "status": "completed", "tag": "4f5f9b2b-57b0-4c33-8f63-bac94722e9d0"}, {"server_uuid": "ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084", "name": "network-vif-plugged", "status": "completed", "tag": "4f5f9b2b-57b0-4c33-8f63-bac94722e9d0"}, {"server_uuid": "ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084", "name": "network-vif-plugged", "status": "completed", "tag": "4f5f9b2b-57b0-4c33-8f63-bac94722e9d0"}, {"server_uuid": "ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084", "name": "network-vif-unplugged", "status": "completed", "tag": "4f5f9b2b-57b0-4c33-8f63-bac94722e9d0"}, {"server_uuid": "ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084", "name": "network-vif-plugged", "status": "completed", "tag": "4f5f9b2b-57b0-4c33-8f63-bac94722e9d0"}, {"server_uuid": "ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084", "name": "network-vif-deleted", "tag": "4f5f9b2b-57b0-4c33-8f63-bac94722e9d0"}]} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:55:59 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-efc87ad8-bc4c-4cd5-a906-86b8bb011ae9 req-db89cb86-7b70-4c36-a514-2b4316b62af8 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:55:59 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-efc87ad8-bc4c-4cd5-a906-86b8bb011ae9 req-db89cb86-7b70-4c36-a514-2b4316b62af8 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:55:59 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-efc87ad8-bc4c-4cd5-a906-86b8bb011ae9 req-db89cb86-7b70-4c36-a514-2b4316b62af8 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:55:59 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-efc87ad8-bc4c-4cd5-a906-86b8bb011ae9 req-db89cb86-7b70-4c36-a514-2b4316b62af8 service nova] Creating event network-vif-plugged:4f5f9b2b-57b0-4c33-8f63-bac94722e9d0 for instance ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084 on user Apr 19 14:55:59 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-efc87ad8-bc4c-4cd5-a906-86b8bb011ae9 req-db89cb86-7b70-4c36-a514-2b4316b62af8 service nova] Creating event network-vif-plugged:4f5f9b2b-57b0-4c33-8f63-bac94722e9d0 for instance ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084 on user Apr 19 14:55:59 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-efc87ad8-bc4c-4cd5-a906-86b8bb011ae9 req-db89cb86-7b70-4c36-a514-2b4316b62af8 service nova] Creating event network-vif-plugged:4f5f9b2b-57b0-4c33-8f63-bac94722e9d0 for instance ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084 on user Apr 19 14:55:59 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-efc87ad8-bc4c-4cd5-a906-86b8bb011ae9 req-db89cb86-7b70-4c36-a514-2b4316b62af8 service nova] Creating event network-vif-unplugged:4f5f9b2b-57b0-4c33-8f63-bac94722e9d0 for instance ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084 on user Apr 19 14:55:59 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-efc87ad8-bc4c-4cd5-a906-86b8bb011ae9 req-db89cb86-7b70-4c36-a514-2b4316b62af8 service nova] Creating event network-vif-plugged:4f5f9b2b-57b0-4c33-8f63-bac94722e9d0 for instance ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084 on user Apr 19 14:55:59 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-efc87ad8-bc4c-4cd5-a906-86b8bb011ae9 req-db89cb86-7b70-4c36-a514-2b4316b62af8 service nova] Creating event network-vif-deleted:4f5f9b2b-57b0-4c33-8f63-bac94722e9d0 for instance ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084 on user Apr 19 14:55:59 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [req-efc87ad8-bc4c-4cd5-a906-86b8bb011ae9 req-db89cb86-7b70-4c36-a514-2b4316b62af8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1040 microversion: 2.1 time: 0.034050 Apr 19 14:55:59 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 80/241] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:55:59 2023] POST /compute/v2.1/os-server-external-events => generated 1040 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:56:00 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-389fe67f-da02-4a0f-aa4a-402aff9903d1 tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Flavor limits 0:0:0 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 14:56:00 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-389fe67f-da02-4a0f-aa4a-402aff9903d1 tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Image limits 0:0:0 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 14:56:00 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-389fe67f-da02-4a0f-aa4a-402aff9903d1 tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Flavor pref 0:0:0 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 14:56:00 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-389fe67f-da02-4a0f-aa4a-402aff9903d1 tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Image pref 0:0:0 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 14:56:00 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-389fe67f-da02-4a0f-aa4a-402aff9903d1 tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 14:56:00 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-389fe67f-da02-4a0f-aa4a-402aff9903d1 tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:00 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-389fe67f-da02-4a0f-aa4a-402aff9903d1 tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:00 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-389fe67f-da02-4a0f-aa4a-402aff9903d1 tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:00 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-389fe67f-da02-4a0f-aa4a-402aff9903d1 tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:00 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-389fe67f-da02-4a0f-aa4a-402aff9903d1 tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:00 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-389fe67f-da02-4a0f-aa4a-402aff9903d1 tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:00 user devstack@n-api.service[61254]: DEBUG nova.quota [None req-389fe67f-da02-4a0f-aa4a-402aff9903d1 tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Getting quotas for project adb7a6d6040c4475b034b1f33f97a491. Resources: {'ram', 'instances', 'cores'} {{(pid=61254) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:56:00 user devstack@n-api.service[61254]: DEBUG nova.quota [None req-389fe67f-da02-4a0f-aa4a-402aff9903d1 tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Getting quotas for user b2057a3280134a99bc9a97c66ad51220 and project adb7a6d6040c4475b034b1f33f97a491. Resources: {'ram', 'instances', 'cores'} {{(pid=61254) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:56:00 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-389fe67f-da02-4a0f-aa4a-402aff9903d1 tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Going to run 1 instances... {{(pid=61254) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 14:56:00 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-389fe67f-da02-4a0f-aa4a-402aff9903d1 tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] [instance: dbf728fc-fcd9-4819-8bae-3816c3fde252] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='283dcfe8-75fd-4917-902e-1b940387187c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61254) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 14:56:00 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-389fe67f-da02-4a0f-aa4a-402aff9903d1 tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.903996 Apr 19 14:56:00 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 80/242] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 14:55:59 2023] POST /compute/v2.1/servers => generated 404 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 14:56:00 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-265760ec-f746-4bd3-b335-cb3714b91ece tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:56:00 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-265760ec-f746-4bd3-b335-cb3714b91ece tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] [instance: dbf728fc-fcd9-4819-8bae-3816c3fde252] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:56:00 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-265760ec-f746-4bd3-b335-cb3714b91ece tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2057a3280134a99bc9a97c66ad51220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7a6d6040c4475b034b1f33f97a491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:56:00 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-265760ec-f746-4bd3-b335-cb3714b91ece tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dbf728fc-fcd9-4819-8bae-3816c3fde252" status: 200 len: 1255 microversion: 2.1 time: 0.077333 Apr 19 14:56:00 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 83/243] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:56:00 2023] GET /compute/v2.1/servers/dbf728fc-fcd9-4819-8bae-3816c3fde252 => generated 1255 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:56:01 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-7fb9d00d-c14d-42cc-8d2c-ceb4244800e2 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:56:01 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-7fb9d00d-c14d-42cc-8d2c-ceb4244800e2 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] [instance: 55679a8c-4cb6-4862-8ab8-ce2820166b07] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:56:01 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-7fb9d00d-c14d-42cc-8d2c-ceb4244800e2 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:01 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-7fb9d00d-c14d-42cc-8d2c-ceb4244800e2 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:01 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-7fb9d00d-c14d-42cc-8d2c-ceb4244800e2 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:01 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-7fb9d00d-c14d-42cc-8d2c-ceb4244800e2 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:01 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-7fb9d00d-c14d-42cc-8d2c-ceb4244800e2 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:01 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-7fb9d00d-c14d-42cc-8d2c-ceb4244800e2 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:02 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-7fb9d00d-c14d-42cc-8d2c-ceb4244800e2 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55679a8c-4cb6-4862-8ab8-ce2820166b07/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.182874 Apr 19 14:56:02 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 81/244] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 14:56:01 2023] GET /compute/v2.1/servers/55679a8c-4cb6-4862-8ab8-ce2820166b07/os-interface => generated 282 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:56:02 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [req-334f535e-09ba-40ed-bd4b-4af2818173d5 req-dec29e91-b778-48de-a3ac-d82733ba194b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbf728fc-fcd9-4819-8bae-3816c3fde252", "tag": "ecb65694-0a07-4e10-8848-1d03da8d683a"}]} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:56:02 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-334f535e-09ba-40ed-bd4b-4af2818173d5 req-dec29e91-b778-48de-a3ac-d82733ba194b service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:02 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-334f535e-09ba-40ed-bd4b-4af2818173d5 req-dec29e91-b778-48de-a3ac-d82733ba194b service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:02 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-334f535e-09ba-40ed-bd4b-4af2818173d5 req-dec29e91-b778-48de-a3ac-d82733ba194b service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:02 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-334f535e-09ba-40ed-bd4b-4af2818173d5 req-dec29e91-b778-48de-a3ac-d82733ba194b service nova] Creating event network-changed:ecb65694-0a07-4e10-8848-1d03da8d683a for instance dbf728fc-fcd9-4819-8bae-3816c3fde252 on user Apr 19 14:56:02 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [req-334f535e-09ba-40ed-bd4b-4af2818173d5 req-dec29e91-b778-48de-a3ac-d82733ba194b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032403 Apr 19 14:56:02 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 81/245] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:56:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:56:02 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-6f19016d-ed78-4ff3-9138-680b91f7912c req-84040f4d-3ed0-4781-ac17-420c9185907e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55679a8c-4cb6-4862-8ab8-ce2820166b07", "tag": "71edbaec-5b65-43f4-adbc-51fef2badb3b"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:56:02 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-6f19016d-ed78-4ff3-9138-680b91f7912c req-84040f4d-3ed0-4781-ac17-420c9185907e service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:02 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-6f19016d-ed78-4ff3-9138-680b91f7912c req-84040f4d-3ed0-4781-ac17-420c9185907e service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:02 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-6f19016d-ed78-4ff3-9138-680b91f7912c req-84040f4d-3ed0-4781-ac17-420c9185907e service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:02 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-6f19016d-ed78-4ff3-9138-680b91f7912c req-84040f4d-3ed0-4781-ac17-420c9185907e service nova] Creating event network-changed:71edbaec-5b65-43f4-adbc-51fef2badb3b for instance 55679a8c-4cb6-4862-8ab8-ce2820166b07 on user Apr 19 14:56:02 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [req-6f19016d-ed78-4ff3-9138-680b91f7912c req-84040f4d-3ed0-4781-ac17-420c9185907e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028836 Apr 19 14:56:02 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 84/246] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:56:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:56:02 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-c180b78a-c3a2-46f9-842d-a1b787db3fd9 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:56:02 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-c180b78a-c3a2-46f9-842d-a1b787db3fd9 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] [instance: 55679a8c-4cb6-4862-8ab8-ce2820166b07] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:56:02 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-c180b78a-c3a2-46f9-842d-a1b787db3fd9 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:02 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-c180b78a-c3a2-46f9-842d-a1b787db3fd9 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:02 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-c180b78a-c3a2-46f9-842d-a1b787db3fd9 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:02 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-c180b78a-c3a2-46f9-842d-a1b787db3fd9 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:02 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-c180b78a-c3a2-46f9-842d-a1b787db3fd9 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:02 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-c180b78a-c3a2-46f9-842d-a1b787db3fd9 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:02 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-c180b78a-c3a2-46f9-842d-a1b787db3fd9 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55679a8c-4cb6-4862-8ab8-ce2820166b07/ips" status: 200 len: 104 microversion: 2.1 time: 0.035955 Apr 19 14:56:02 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 82/247] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 19 14:56:02 2023] GET /compute/v2.1/servers/55679a8c-4cb6-4862-8ab8-ce2820166b07/ips => generated 104 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:56:04 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-953e96a3-7e54-41ab-9743-0d789084fd10 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:56:04 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-953e96a3-7e54-41ab-9743-0d789084fd10 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] [instance: 55679a8c-4cb6-4862-8ab8-ce2820166b07] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:56:04 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-953e96a3-7e54-41ab-9743-0d789084fd10 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:04 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-953e96a3-7e54-41ab-9743-0d789084fd10 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:04 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-953e96a3-7e54-41ab-9743-0d789084fd10 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:04 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-953e96a3-7e54-41ab-9743-0d789084fd10 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:04 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-953e96a3-7e54-41ab-9743-0d789084fd10 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:04 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-953e96a3-7e54-41ab-9743-0d789084fd10 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:04 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-953e96a3-7e54-41ab-9743-0d789084fd10 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] [instance: 55679a8c-4cb6-4862-8ab8-ce2820166b07] Going to try to terminate instance {{(pid=61254) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 14:56:04 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-953e96a3-7e54-41ab-9743-0d789084fd10 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/55679a8c-4cb6-4862-8ab8-ce2820166b07" status: 204 len: 0 microversion: 2.1 time: 0.123649 Apr 19 14:56:04 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 82/248] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 14:56:04 2023] DELETE /compute/v2.1/servers/55679a8c-4cb6-4862-8ab8-ce2820166b07 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 14:56:04 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-9bf6b9d6-6f33-454a-ac39-992c6fd0daf0 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:56:04 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-9bf6b9d6-6f33-454a-ac39-992c6fd0daf0 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] [instance: 55679a8c-4cb6-4862-8ab8-ce2820166b07] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:56:04 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-9bf6b9d6-6f33-454a-ac39-992c6fd0daf0 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:04 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-9bf6b9d6-6f33-454a-ac39-992c6fd0daf0 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:04 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-9bf6b9d6-6f33-454a-ac39-992c6fd0daf0 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:04 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-9bf6b9d6-6f33-454a-ac39-992c6fd0daf0 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:04 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-9bf6b9d6-6f33-454a-ac39-992c6fd0daf0 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:04 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-9bf6b9d6-6f33-454a-ac39-992c6fd0daf0 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:04 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-9bf6b9d6-6f33-454a-ac39-992c6fd0daf0 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab5193fb1ec41b8a19e8621843a54a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5383c493e2f049fc9dc06818cb00a6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:56:04 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-9bf6b9d6-6f33-454a-ac39-992c6fd0daf0 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55679a8c-4cb6-4862-8ab8-ce2820166b07" status: 200 len: 1662 microversion: 2.1 time: 0.268083 Apr 19 14:56:04 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 85/249] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:56:04 2023] GET /compute/v2.1/servers/55679a8c-4cb6-4862-8ab8-ce2820166b07 => generated 1662 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:56:04 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [req-a36d2436-79bf-4732-8259-953a53e9a048 req-322573c9-3487-44f4-9908-c7acfb028c3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55679a8c-4cb6-4862-8ab8-ce2820166b07", "name": "network-vif-unplugged", "status": "completed", "tag": "71edbaec-5b65-43f4-adbc-51fef2badb3b"}]} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:56:04 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-a36d2436-79bf-4732-8259-953a53e9a048 req-322573c9-3487-44f4-9908-c7acfb028c3f service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:04 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-a36d2436-79bf-4732-8259-953a53e9a048 req-322573c9-3487-44f4-9908-c7acfb028c3f service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:04 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-a36d2436-79bf-4732-8259-953a53e9a048 req-322573c9-3487-44f4-9908-c7acfb028c3f service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:04 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-a36d2436-79bf-4732-8259-953a53e9a048 req-322573c9-3487-44f4-9908-c7acfb028c3f service nova] Creating event network-vif-unplugged:71edbaec-5b65-43f4-adbc-51fef2badb3b for instance 55679a8c-4cb6-4862-8ab8-ce2820166b07 on user Apr 19 14:56:04 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [req-a36d2436-79bf-4732-8259-953a53e9a048 req-322573c9-3487-44f4-9908-c7acfb028c3f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086979 Apr 19 14:56:04 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 83/250] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:56:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:56:06 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [req-c460314b-4832-4aec-b018-9b9c5d19c948 req-8990f201-5b72-4235-af7c-f6a3eb2e3c78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55679a8c-4cb6-4862-8ab8-ce2820166b07", "name": "network-vif-deleted", "tag": "71edbaec-5b65-43f4-adbc-51fef2badb3b"}]} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:56:06 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-c460314b-4832-4aec-b018-9b9c5d19c948 req-8990f201-5b72-4235-af7c-f6a3eb2e3c78 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:06 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-c460314b-4832-4aec-b018-9b9c5d19c948 req-8990f201-5b72-4235-af7c-f6a3eb2e3c78 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:06 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-c460314b-4832-4aec-b018-9b9c5d19c948 req-8990f201-5b72-4235-af7c-f6a3eb2e3c78 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:06 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-c460314b-4832-4aec-b018-9b9c5d19c948 req-8990f201-5b72-4235-af7c-f6a3eb2e3c78 service nova] Creating event network-vif-deleted:71edbaec-5b65-43f4-adbc-51fef2badb3b for instance 55679a8c-4cb6-4862-8ab8-ce2820166b07 on user Apr 19 14:56:06 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [req-c460314b-4832-4aec-b018-9b9c5d19c948 req-8990f201-5b72-4235-af7c-f6a3eb2e3c78 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063758 Apr 19 14:56:06 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 83/251] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:56:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:56:06 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-67df212b-5afe-45cc-8cdb-3ae487cab768 req-011b4abc-9742-4b64-ac89-9bde1b991464 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55679a8c-4cb6-4862-8ab8-ce2820166b07", "name": "network-vif-plugged", "status": "completed", "tag": "71edbaec-5b65-43f4-adbc-51fef2badb3b"}, {"server_uuid": "dbf728fc-fcd9-4819-8bae-3816c3fde252", "name": "network-vif-plugged", "status": "completed", "tag": "ecb65694-0a07-4e10-8848-1d03da8d683a"}, {"server_uuid": "dbf728fc-fcd9-4819-8bae-3816c3fde252", "name": "network-vif-plugged", "status": "completed", "tag": "ecb65694-0a07-4e10-8848-1d03da8d683a"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:56:06 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-67df212b-5afe-45cc-8cdb-3ae487cab768 req-011b4abc-9742-4b64-ac89-9bde1b991464 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:06 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-67df212b-5afe-45cc-8cdb-3ae487cab768 req-011b4abc-9742-4b64-ac89-9bde1b991464 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:06 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-67df212b-5afe-45cc-8cdb-3ae487cab768 req-011b4abc-9742-4b64-ac89-9bde1b991464 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:06 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-67df212b-5afe-45cc-8cdb-3ae487cab768 req-011b4abc-9742-4b64-ac89-9bde1b991464 service nova] Creating event network-vif-plugged:71edbaec-5b65-43f4-adbc-51fef2badb3b for instance 55679a8c-4cb6-4862-8ab8-ce2820166b07 on user Apr 19 14:56:06 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-67df212b-5afe-45cc-8cdb-3ae487cab768 req-011b4abc-9742-4b64-ac89-9bde1b991464 service nova] Creating event network-vif-plugged:ecb65694-0a07-4e10-8848-1d03da8d683a for instance dbf728fc-fcd9-4819-8bae-3816c3fde252 on user Apr 19 14:56:06 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-67df212b-5afe-45cc-8cdb-3ae487cab768 req-011b4abc-9742-4b64-ac89-9bde1b991464 service nova] Creating event network-vif-plugged:ecb65694-0a07-4e10-8848-1d03da8d683a for instance dbf728fc-fcd9-4819-8bae-3816c3fde252 on user Apr 19 14:56:06 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [req-67df212b-5afe-45cc-8cdb-3ae487cab768 req-011b4abc-9742-4b64-ac89-9bde1b991464 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.053405 Apr 19 14:56:06 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 86/252] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:56:06 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:56:07 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-007e3321-61af-4366-84a3-441f1b0e6f31 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:56:07 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-007e3321-61af-4366-84a3-441f1b0e6f31 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] [instance: 6930db7c-e8e0-4d1d-ac99-952827ff1aa9] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:56:07 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-007e3321-61af-4366-84a3-441f1b0e6f31 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:07 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-007e3321-61af-4366-84a3-441f1b0e6f31 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:07 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-007e3321-61af-4366-84a3-441f1b0e6f31 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:07 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-007e3321-61af-4366-84a3-441f1b0e6f31 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:07 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-007e3321-61af-4366-84a3-441f1b0e6f31 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:07 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-007e3321-61af-4366-84a3-441f1b0e6f31 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:07 user devstack@n-api.service[61253]: DEBUG nova.policy [None req-007e3321-61af-4366-84a3-441f1b0e6f31 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8683d0564d7c475c9d26f897e0239640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94be4fa38d44fe84c03b02b09bab0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61253) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:56:07 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-007e3321-61af-4366-84a3-441f1b0e6f31 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6930db7c-e8e0-4d1d-ac99-952827ff1aa9" status: 200 len: 1489 microversion: 2.1 time: 0.280761 Apr 19 14:56:07 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 84/253] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:56:07 2023] GET /compute/v2.1/servers/6930db7c-e8e0-4d1d-ac99-952827ff1aa9 => generated 1489 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:56:09 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-619116b5-bcba-4259-9110-15c4c3c07123 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:56:09 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-619116b5-bcba-4259-9110-15c4c3c07123 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] [instance: 9fee43ad-330a-45d7-9374-07feefcf9e14] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:56:09 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-619116b5-bcba-4259-9110-15c4c3c07123 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:09 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-619116b5-bcba-4259-9110-15c4c3c07123 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:09 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-619116b5-bcba-4259-9110-15c4c3c07123 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:09 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-619116b5-bcba-4259-9110-15c4c3c07123 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:09 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-619116b5-bcba-4259-9110-15c4c3c07123 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:09 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-619116b5-bcba-4259-9110-15c4c3c07123 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:09 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-619116b5-bcba-4259-9110-15c4c3c07123 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aab0b2e3424d80852e588323f187bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dbf312f7154ce1ae7fc1403947d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:56:09 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-619116b5-bcba-4259-9110-15c4c3c07123 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9fee43ad-330a-45d7-9374-07feefcf9e14" status: 200 len: 1658 microversion: 2.1 time: 0.239718 Apr 19 14:56:09 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 84/254] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:56:09 2023] GET /compute/v2.1/servers/9fee43ad-330a-45d7-9374-07feefcf9e14 => generated 1658 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:56:09 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-800bab80-9e92-4871-a091-6442953e1753 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:56:09 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-800bab80-9e92-4871-a091-6442953e1753 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] [instance: 9fee43ad-330a-45d7-9374-07feefcf9e14] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:56:09 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-800bab80-9e92-4871-a091-6442953e1753 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:09 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-800bab80-9e92-4871-a091-6442953e1753 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:09 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-800bab80-9e92-4871-a091-6442953e1753 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:09 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-800bab80-9e92-4871-a091-6442953e1753 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:09 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-800bab80-9e92-4871-a091-6442953e1753 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:09 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-800bab80-9e92-4871-a091-6442953e1753 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:10 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-800bab80-9e92-4871-a091-6442953e1753 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aab0b2e3424d80852e588323f187bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dbf312f7154ce1ae7fc1403947d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:56:10 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-800bab80-9e92-4871-a091-6442953e1753 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9fee43ad-330a-45d7-9374-07feefcf9e14" status: 200 len: 1658 microversion: 2.1 time: 0.224378 Apr 19 14:56:10 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 87/255] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:56:09 2023] GET /compute/v2.1/servers/9fee43ad-330a-45d7-9374-07feefcf9e14 => generated 1658 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:56:10 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-841613f9-b323-4c59-a85d-9f0ba41fc139 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:56:10 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-841613f9-b323-4c59-a85d-9f0ba41fc139 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] [instance: 9fee43ad-330a-45d7-9374-07feefcf9e14] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:56:10 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell0:SELECT=4 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:56:10 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-841613f9-b323-4c59-a85d-9f0ba41fc139 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:10 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-841613f9-b323-4c59-a85d-9f0ba41fc139 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:10 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-841613f9-b323-4c59-a85d-9f0ba41fc139 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:10 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-841613f9-b323-4c59-a85d-9f0ba41fc139 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:10 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-841613f9-b323-4c59-a85d-9f0ba41fc139 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:10 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-841613f9-b323-4c59-a85d-9f0ba41fc139 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:10 user devstack@n-api.service[61253]: DEBUG nova.policy [None req-841613f9-b323-4c59-a85d-9f0ba41fc139 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aab0b2e3424d80852e588323f187bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dbf312f7154ce1ae7fc1403947d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61253) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:56:10 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-841613f9-b323-4c59-a85d-9f0ba41fc139 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9fee43ad-330a-45d7-9374-07feefcf9e14" status: 200 len: 1658 microversion: 2.1 time: 0.263682 Apr 19 14:56:10 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 85/256] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:56:10 2023] GET /compute/v2.1/servers/9fee43ad-330a-45d7-9374-07feefcf9e14 => generated 1658 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:56:15 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell0:SELECT=2 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:56:15 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell0:SELECT=6 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:56:15 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-e8645691-0bc4-4891-854e-ed49161e2f4c tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-948833069"}} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:56:15 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-e8645691-0bc4-4891-854e-ed49161e2f4c tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] [instance: 2a5ed5bc-23a0-42f5-8b38-167d24e822b7] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:56:15 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-e8645691-0bc4-4891-854e-ed49161e2f4c tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:15 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-e8645691-0bc4-4891-854e-ed49161e2f4c tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:15 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-e8645691-0bc4-4891-854e-ed49161e2f4c tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:15 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-e8645691-0bc4-4891-854e-ed49161e2f4c tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:15 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-e8645691-0bc4-4891-854e-ed49161e2f4c tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:15 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-e8645691-0bc4-4891-854e-ed49161e2f4c tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:16 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-e8645691-0bc4-4891-854e-ed49161e2f4c tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2a5ed5bc-23a0-42f5-8b38-167d24e822b7/action" status: 202 len: 52 microversion: 2.87 time: 0.884434 Apr 19 14:56:16 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 85/257] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 19 14:56:15 2023] POST /compute/v2.1/servers/2a5ed5bc-23a0-42f5-8b38-167d24e822b7/action => generated 52 bytes in 886 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 19 14:56:21 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-6867a82b-d91b-4525-a26b-808f3c31da08 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:56:21 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-6867a82b-d91b-4525-a26b-808f3c31da08 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] [instance: 2a5ed5bc-23a0-42f5-8b38-167d24e822b7] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:56:21 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell0:SELECT=2 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:56:21 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:56:21 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:56:21 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-6867a82b-d91b-4525-a26b-808f3c31da08 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:21 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-6867a82b-d91b-4525-a26b-808f3c31da08 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:21 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-6867a82b-d91b-4525-a26b-808f3c31da08 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:21 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-6867a82b-d91b-4525-a26b-808f3c31da08 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:21 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-6867a82b-d91b-4525-a26b-808f3c31da08 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:21 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-6867a82b-d91b-4525-a26b-808f3c31da08 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:21 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-6867a82b-d91b-4525-a26b-808f3c31da08 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33dd700a9314ab9a70428a3455a571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bc7474b840449da88a8f420316ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:56:21 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-6867a82b-d91b-4525-a26b-808f3c31da08 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b33dd700a9314ab9a70428a3455a571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bc7474b840449da88a8f420316ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:56:21 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-6867a82b-d91b-4525-a26b-808f3c31da08 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b33dd700a9314ab9a70428a3455a571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bc7474b840449da88a8f420316ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:56:21 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-6867a82b-d91b-4525-a26b-808f3c31da08 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2a5ed5bc-23a0-42f5-8b38-167d24e822b7" status: 200 len: 1690 microversion: 2.87 time: 0.240597 Apr 19 14:56:21 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 88/258] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 14:56:21 2023] GET /compute/v2.1/servers/2a5ed5bc-23a0-42f5-8b38-167d24e822b7 => generated 1690 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 14:56:33 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:56:33 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell1:SELECT=26 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:56:33 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-07527009-01f0-412e-8d8a-fb1ea6e75f1e tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:56:33 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-07527009-01f0-412e-8d8a-fb1ea6e75f1e tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] [instance: a499484d-dfca-44f4-9ab0-ecabbf88f06d] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:56:33 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-07527009-01f0-412e-8d8a-fb1ea6e75f1e tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:33 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-07527009-01f0-412e-8d8a-fb1ea6e75f1e tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:33 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-07527009-01f0-412e-8d8a-fb1ea6e75f1e tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:33 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-07527009-01f0-412e-8d8a-fb1ea6e75f1e tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:33 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-07527009-01f0-412e-8d8a-fb1ea6e75f1e tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:33 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-07527009-01f0-412e-8d8a-fb1ea6e75f1e tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:33 user devstack@n-api.service[61253]: INFO nova.api.openstack.wsgi [None req-07527009-01f0-412e-8d8a-fb1ea6e75f1e tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] HTTP exception thrown: Instance a499484d-dfca-44f4-9ab0-ecabbf88f06d could not be found. Apr 19 14:56:33 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-07527009-01f0-412e-8d8a-fb1ea6e75f1e tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Request method failure captured: Apr 19 14:56:33 user devstack@n-api.service[61253]: request: GET /compute/v2.1/servers/a499484d-dfca-44f4-9ab0-ecabbf88f06d HTTP/1.1 Apr 19 14:56:33 user devstack@n-api.service[61253]: Accept: application/json Apr 19 14:56:33 user devstack@n-api.service[61253]: Accept-Encoding: identity Apr 19 14:56:33 user devstack@n-api.service[61253]: Connection: close Apr 19 14:56:33 user devstack@n-api.service[61253]: Content-Length: 0 Apr 19 14:56:33 user devstack@n-api.service[61253]: Content-Type: application/json Apr 19 14:56:33 user devstack@n-api.service[61253]: Host: 10.0.0.210 Apr 19 14:56:33 user devstack@n-api.service[61253]: Openstack-System-Scope: None Apr 19 14:56:33 user devstack@n-api.service[61253]: User-Agent: python-urllib3/1.26.15 Apr 19 14:56:33 user devstack@n-api.service[61253]: X-Auth-Token: gAAAAABkP_-7uQ4onjKbLKosvPMLyf_P-W_7RI6oGGymarzIji4ujzAdtGn3WT5cVdNh2qQAgjy4-ZyamhJcHbxPnJ40DXzRRyDs8wA60kgR8W5zr3io8r3buMz2k6RJRKQ4urLrM-GzHTnH1hwTbTaaLo1UvGUalteNyC_yGJiXenA-H0GWRgw Apr 19 14:56:33 user devstack@n-api.service[61253]: X-Domain-Id: None Apr 19 14:56:33 user devstack@n-api.service[61253]: X-Domain-Name: None Apr 19 14:56:33 user devstack@n-api.service[61253]: X-Identity-Status: Confirmed Apr 19 14:56:33 user devstack@n-api.service[61253]: X-Is-Admin-Project: True Apr 19 14:56:33 user devstack@n-api.service[61253]: X-Project-Domain-Id: default Apr 19 14:56:33 user devstack@n-api.service[61253]: X-Project-Domain-Name: Default Apr 19 14:56:33 user devstack@n-api.service[61253]: X-Project-Id: da86be1a28254582b530973fbf7f724c Apr 19 14:56:33 user devstack@n-api.service[61253]: X-Project-Name: tempest-VolumesAdminNegativeTest-1054877387 Apr 19 14:56:33 user devstack@n-api.service[61253]: X-Role: member,reader Apr 19 14:56:33 user devstack@n-api.service[61253]: X-Roles: member,reader Apr 19 14:56:33 user devstack@n-api.service[61253]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/da86be1a28254582b530973fbf7f724c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/da86be1a28254582b530973fbf7f724c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/da86be1a28254582b530973fbf7f724c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 14:56:33 user devstack@n-api.service[61253]: X-Tenant: tempest-VolumesAdminNegativeTest-1054877387 Apr 19 14:56:33 user devstack@n-api.service[61253]: X-Tenant-Id: da86be1a28254582b530973fbf7f724c Apr 19 14:56:33 user devstack@n-api.service[61253]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1054877387 Apr 19 14:56:33 user devstack@n-api.service[61253]: X-User: tempest-VolumesAdminNegativeTest-1054877387-project-member Apr 19 14:56:33 user devstack@n-api.service[61253]: X-User-Domain-Id: default Apr 19 14:56:33 user devstack@n-api.service[61253]: X-User-Domain-Name: Default Apr 19 14:56:33 user devstack@n-api.service[61253]: X-User-Id: 708068c5f6f5451fbcd6c24235a185d2 Apr 19 14:56:33 user devstack@n-api.service[61253]: X-User-Name: tempest-VolumesAdminNegativeTest-1054877387-project-member Apr 19 14:56:33 user devstack@n-api.service[61253]: method: > Apr 19 14:56:33 user devstack@n-api.service[61253]: exception: Instance a499484d-dfca-44f4-9ab0-ecabbf88f06d could not be found. Apr 19 14:56:33 user devstack@n-api.service[61253]: action_args: {'id': 'a499484d-dfca-44f4-9ab0-ecabbf88f06d'} Apr 19 14:56:33 user devstack@n-api.service[61253]: {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:56:33 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:56:33 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:56:33 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:56:33 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:56:33 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:56:33 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:56:33 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:56:33 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:56:33 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:56:33 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a499484d-dfca-44f4-9ab0-ecabbf88f06d could not be found. Apr 19 14:56:33 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 14:56:33 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:56:33 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 14:56:33 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:56:33 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:56:33 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:56:33 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:56:33 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:56:33 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:56:33 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:56:33 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:56:33 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:56:33 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:56:33 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:56:33 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:56:33 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:56:33 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a499484d-dfca-44f4-9ab0-ecabbf88f06d could not be found. Apr 19 14:56:33 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 14:56:33 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:56:33 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 14:56:33 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:56:33 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:56:33 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:56:33 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:56:33 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:56:33 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a499484d-dfca-44f4-9ab0-ecabbf88f06d could not be found. Apr 19 14:56:33 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 14:56:33 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-07527009-01f0-412e-8d8a-fb1ea6e75f1e tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Returning 404 to user: Instance a499484d-dfca-44f4-9ab0-ecabbf88f06d could not be found. {{(pid=61253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:56:33 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-07527009-01f0-412e-8d8a-fb1ea6e75f1e tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a499484d-dfca-44f4-9ab0-ecabbf88f06d" status: 404 len: 111 microversion: 2.1 time: 0.154367 Apr 19 14:56:33 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 86/259] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:56:33 2023] GET /compute/v2.1/servers/a499484d-dfca-44f4-9ab0-ecabbf88f06d => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:56:33 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:56:33 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:56:33 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-638ffc20-a7da-4794-89aa-00431bac411d tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] Calling method '.version_select at 0x7f3cfa98d480>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:56:33 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-638ffc20-a7da-4794-89aa-00431bac411d tempest-VolumesAdminNegativeTest-1054877387 tempest-VolumesAdminNegativeTest-1054877387-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-979545121" status: 202 len: 0 microversion: 2.1 time: 0.031668 Apr 19 14:56:33 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 86/260] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 19 14:56:33 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-979545121 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 14:56:40 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-eee56811-d9aa-4780-a75b-163d41093cf4 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:56:40 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-eee56811-d9aa-4780-a75b-163d41093cf4 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] [instance: 3478c35c-c27b-4480-ad89-4b9cd7ebeb40] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:56:40 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell1:SELECT=6 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:56:40 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_api:SELECT=4 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:56:40 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-eee56811-d9aa-4780-a75b-163d41093cf4 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:40 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-eee56811-d9aa-4780-a75b-163d41093cf4 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:40 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-eee56811-d9aa-4780-a75b-163d41093cf4 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:40 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-eee56811-d9aa-4780-a75b-163d41093cf4 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:40 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-eee56811-d9aa-4780-a75b-163d41093cf4 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:40 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-eee56811-d9aa-4780-a75b-163d41093cf4 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:40 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-eee56811-d9aa-4780-a75b-163d41093cf4 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2985fabe974b80a37af599e28c8fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c121e3e3fa440d8a2e1c3e42975a9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:56:40 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-eee56811-d9aa-4780-a75b-163d41093cf4 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3478c35c-c27b-4480-ad89-4b9cd7ebeb40" status: 200 len: 1537 microversion: 2.1 time: 0.241218 Apr 19 14:56:40 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 89/261] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:56:40 2023] GET /compute/v2.1/servers/3478c35c-c27b-4480-ad89-4b9cd7ebeb40 => generated 1537 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:56:40 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-e4c3c5e1-a1cc-4699-9492-86b79385ac57 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:56:40 user devstack@n-api.service[61253]: DEBUG nova.policy [None req-e4c3c5e1-a1cc-4699-9492-86b79385ac57 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7e2985fabe974b80a37af599e28c8fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c121e3e3fa440d8a2e1c3e42975a9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61253) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:56:40 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-e4c3c5e1-a1cc-4699-9492-86b79385ac57 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Searching by: {'deleted': False, 'project_id': '3c121e3e3fa440d8a2e1c3e42975a9a1'} {{(pid=61253) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 19 14:56:40 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-e4c3c5e1-a1cc-4699-9492-86b79385ac57 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:40 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-e4c3c5e1-a1cc-4699-9492-86b79385ac57 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:40 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-e4c3c5e1-a1cc-4699-9492-86b79385ac57 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:40 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-e4c3c5e1-a1cc-4699-9492-86b79385ac57 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:40 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-e4c3c5e1-a1cc-4699-9492-86b79385ac57 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:40 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-e4c3c5e1-a1cc-4699-9492-86b79385ac57 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:41 user devstack@n-api.service[61253]: DEBUG nova.compute.multi_cell_list [None req-e4c3c5e1-a1cc-4699-9492-86b79385ac57 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61253) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 19 14:56:41 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-e4c3c5e1-a1cc-4699-9492-86b79385ac57 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.216656 Apr 19 14:56:41 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 87/262] 10.0.0.210 () {62 vars in 1202 bytes} [Wed Apr 19 14:56:40 2023] GET /compute/v2.1/servers => generated 341 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:56:41 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-a499e97c-1f5b-4332-aaa1-b653a232535d tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:56:41 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-a499e97c-1f5b-4332-aaa1-b653a232535d tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] [instance: 3478c35c-c27b-4480-ad89-4b9cd7ebeb40] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:56:41 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-a499e97c-1f5b-4332-aaa1-b653a232535d tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:41 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-a499e97c-1f5b-4332-aaa1-b653a232535d tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:41 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-a499e97c-1f5b-4332-aaa1-b653a232535d tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:41 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-a499e97c-1f5b-4332-aaa1-b653a232535d tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:41 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-a499e97c-1f5b-4332-aaa1-b653a232535d tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:41 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-a499e97c-1f5b-4332-aaa1-b653a232535d tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:41 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-a499e97c-1f5b-4332-aaa1-b653a232535d tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2985fabe974b80a37af599e28c8fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c121e3e3fa440d8a2e1c3e42975a9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:56:41 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-a499e97c-1f5b-4332-aaa1-b653a232535d tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3478c35c-c27b-4480-ad89-4b9cd7ebeb40" status: 200 len: 1537 microversion: 2.1 time: 0.259826 Apr 19 14:56:41 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 87/263] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:56:41 2023] GET /compute/v2.1/servers/3478c35c-c27b-4480-ad89-4b9cd7ebeb40 => generated 1537 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 14:56:43 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-15ddb739-9b34-4cd9-8bd8-6a0e316eb3f2 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:56:43 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-15ddb739-9b34-4cd9-8bd8-6a0e316eb3f2 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] [instance: 3478c35c-c27b-4480-ad89-4b9cd7ebeb40] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:56:43 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-15ddb739-9b34-4cd9-8bd8-6a0e316eb3f2 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:43 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-15ddb739-9b34-4cd9-8bd8-6a0e316eb3f2 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:43 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-15ddb739-9b34-4cd9-8bd8-6a0e316eb3f2 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:43 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-15ddb739-9b34-4cd9-8bd8-6a0e316eb3f2 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:43 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-15ddb739-9b34-4cd9-8bd8-6a0e316eb3f2 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:43 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-15ddb739-9b34-4cd9-8bd8-6a0e316eb3f2 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:43 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-15ddb739-9b34-4cd9-8bd8-6a0e316eb3f2 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] [instance: 3478c35c-c27b-4480-ad89-4b9cd7ebeb40] Going to try to terminate instance {{(pid=61255) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 14:56:43 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-15ddb739-9b34-4cd9-8bd8-6a0e316eb3f2 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3478c35c-c27b-4480-ad89-4b9cd7ebeb40" status: 204 len: 0 microversion: 2.1 time: 0.115712 Apr 19 14:56:43 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 90/264] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 14:56:43 2023] DELETE /compute/v2.1/servers/3478c35c-c27b-4480-ad89-4b9cd7ebeb40 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 14:56:43 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-fecb7efc-cad6-432b-9d30-54459f64756f tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:56:43 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-fecb7efc-cad6-432b-9d30-54459f64756f tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] [instance: 3478c35c-c27b-4480-ad89-4b9cd7ebeb40] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:56:43 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-fecb7efc-cad6-432b-9d30-54459f64756f tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:43 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-fecb7efc-cad6-432b-9d30-54459f64756f tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:43 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-fecb7efc-cad6-432b-9d30-54459f64756f tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:43 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-fecb7efc-cad6-432b-9d30-54459f64756f tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:43 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-fecb7efc-cad6-432b-9d30-54459f64756f tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:43 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-fecb7efc-cad6-432b-9d30-54459f64756f tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:43 user devstack@n-api.service[61253]: DEBUG nova.policy [None req-fecb7efc-cad6-432b-9d30-54459f64756f tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2985fabe974b80a37af599e28c8fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c121e3e3fa440d8a2e1c3e42975a9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61253) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:56:43 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-fecb7efc-cad6-432b-9d30-54459f64756f tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3478c35c-c27b-4480-ad89-4b9cd7ebeb40" status: 200 len: 1543 microversion: 2.1 time: 0.288271 Apr 19 14:56:43 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 88/265] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:56:43 2023] GET /compute/v2.1/servers/3478c35c-c27b-4480-ad89-4b9cd7ebeb40 => generated 1543 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:56:43 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [req-a8aa047b-f9b7-4e58-93c1-680ae76246ef req-64452429-3507-4b00-9974-156a9fcf0fbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3478c35c-c27b-4480-ad89-4b9cd7ebeb40", "name": "network-vif-unplugged", "status": "completed", "tag": "999d1646-6f9f-4f3b-84cb-61953c2e3097"}]} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:56:43 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-a8aa047b-f9b7-4e58-93c1-680ae76246ef req-64452429-3507-4b00-9974-156a9fcf0fbc service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:43 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-a8aa047b-f9b7-4e58-93c1-680ae76246ef req-64452429-3507-4b00-9974-156a9fcf0fbc service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:43 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-a8aa047b-f9b7-4e58-93c1-680ae76246ef req-64452429-3507-4b00-9974-156a9fcf0fbc service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:43 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-a8aa047b-f9b7-4e58-93c1-680ae76246ef req-64452429-3507-4b00-9974-156a9fcf0fbc service nova] Creating event network-vif-unplugged:999d1646-6f9f-4f3b-84cb-61953c2e3097 for instance 3478c35c-c27b-4480-ad89-4b9cd7ebeb40 on user Apr 19 14:56:43 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [req-a8aa047b-f9b7-4e58-93c1-680ae76246ef req-64452429-3507-4b00-9974-156a9fcf0fbc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.169266 Apr 19 14:56:43 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 88/266] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:56:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:56:44 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-35722dcc-1d22-4752-8630-a79a6c531d94 req-c4f89c1f-e9bb-44cb-81bc-2189e6bf7e9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3478c35c-c27b-4480-ad89-4b9cd7ebeb40", "name": "network-vif-deleted", "tag": "999d1646-6f9f-4f3b-84cb-61953c2e3097"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:56:44 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-35722dcc-1d22-4752-8630-a79a6c531d94 req-c4f89c1f-e9bb-44cb-81bc-2189e6bf7e9f service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:44 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-35722dcc-1d22-4752-8630-a79a6c531d94 req-c4f89c1f-e9bb-44cb-81bc-2189e6bf7e9f service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:44 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-35722dcc-1d22-4752-8630-a79a6c531d94 req-c4f89c1f-e9bb-44cb-81bc-2189e6bf7e9f service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:44 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-35722dcc-1d22-4752-8630-a79a6c531d94 req-c4f89c1f-e9bb-44cb-81bc-2189e6bf7e9f service nova] Creating event network-vif-deleted:999d1646-6f9f-4f3b-84cb-61953c2e3097 for instance 3478c35c-c27b-4480-ad89-4b9cd7ebeb40 on user Apr 19 14:56:44 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [req-35722dcc-1d22-4752-8630-a79a6c531d94 req-c4f89c1f-e9bb-44cb-81bc-2189e6bf7e9f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038467 Apr 19 14:56:44 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 91/267] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:56:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:56:45 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [req-7592384d-1a61-49e5-87e1-2d8396d8e52c req-cc1b104c-6e14-4555-95ed-29f13588cfc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3478c35c-c27b-4480-ad89-4b9cd7ebeb40", "name": "network-vif-plugged", "status": "completed", "tag": "999d1646-6f9f-4f3b-84cb-61953c2e3097"}]} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:56:45 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-7592384d-1a61-49e5-87e1-2d8396d8e52c req-cc1b104c-6e14-4555-95ed-29f13588cfc5 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:45 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-7592384d-1a61-49e5-87e1-2d8396d8e52c req-cc1b104c-6e14-4555-95ed-29f13588cfc5 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:45 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-7592384d-1a61-49e5-87e1-2d8396d8e52c req-cc1b104c-6e14-4555-95ed-29f13588cfc5 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:45 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-7592384d-1a61-49e5-87e1-2d8396d8e52c req-cc1b104c-6e14-4555-95ed-29f13588cfc5 service nova] Creating event network-vif-plugged:999d1646-6f9f-4f3b-84cb-61953c2e3097 for instance 3478c35c-c27b-4480-ad89-4b9cd7ebeb40 on user Apr 19 14:56:45 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [req-7592384d-1a61-49e5-87e1-2d8396d8e52c req-cc1b104c-6e14-4555-95ed-29f13588cfc5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032557 Apr 19 14:56:45 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 89/268] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:56:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:56:47 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-1f17630e-1190-4a9b-96d4-7f0c034f777b tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:56:47 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-1f17630e-1190-4a9b-96d4-7f0c034f777b tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] [instance: ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:56:47 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-1f17630e-1190-4a9b-96d4-7f0c034f777b tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:47 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-1f17630e-1190-4a9b-96d4-7f0c034f777b tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:47 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-1f17630e-1190-4a9b-96d4-7f0c034f777b tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:47 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-1f17630e-1190-4a9b-96d4-7f0c034f777b tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:47 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-1f17630e-1190-4a9b-96d4-7f0c034f777b tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:47 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-1f17630e-1190-4a9b-96d4-7f0c034f777b tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:47 user devstack@n-api.service[61254]: INFO nova.api.openstack.wsgi [None req-1f17630e-1190-4a9b-96d4-7f0c034f777b tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] HTTP exception thrown: Instance ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084 could not be found. Apr 19 14:56:47 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-1f17630e-1190-4a9b-96d4-7f0c034f777b tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Request method failure captured: Apr 19 14:56:47 user devstack@n-api.service[61254]: request: GET /compute/v2.1/servers/ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084 HTTP/1.1 Apr 19 14:56:47 user devstack@n-api.service[61254]: Accept: application/json Apr 19 14:56:47 user devstack@n-api.service[61254]: Accept-Encoding: identity Apr 19 14:56:47 user devstack@n-api.service[61254]: Connection: close Apr 19 14:56:47 user devstack@n-api.service[61254]: Content-Length: 0 Apr 19 14:56:47 user devstack@n-api.service[61254]: Content-Type: application/json Apr 19 14:56:47 user devstack@n-api.service[61254]: Host: 10.0.0.210 Apr 19 14:56:47 user devstack@n-api.service[61254]: Openstack-System-Scope: None Apr 19 14:56:47 user devstack@n-api.service[61254]: User-Agent: python-urllib3/1.26.15 Apr 19 14:56:47 user devstack@n-api.service[61254]: X-Auth-Token: gAAAAABkQACJPl0P3yXKrMRibG79Hqp658in8va3b56MSx-w2zVdHzowg8aIK2QJzNaAu2nYCKOP0EC45n1JzRmkaqYpH8h-BaJQguDeBnVkMVS-0kmTwe8oxShNFbvWV7tvu9Eck7mAYMIZN8Q8WAD_N1YEUOjIIrn9-SU9eVgT8lsH3ldOGl4 Apr 19 14:56:47 user devstack@n-api.service[61254]: X-Domain-Id: None Apr 19 14:56:47 user devstack@n-api.service[61254]: X-Domain-Name: None Apr 19 14:56:47 user devstack@n-api.service[61254]: X-Identity-Status: Confirmed Apr 19 14:56:47 user devstack@n-api.service[61254]: X-Is-Admin-Project: True Apr 19 14:56:47 user devstack@n-api.service[61254]: X-Project-Domain-Id: default Apr 19 14:56:47 user devstack@n-api.service[61254]: X-Project-Domain-Name: Default Apr 19 14:56:47 user devstack@n-api.service[61254]: X-Project-Id: 9a5079ce8a52417fb2b8b8122bfeaa5e Apr 19 14:56:47 user devstack@n-api.service[61254]: X-Project-Name: tempest-AttachVolumeNegativeTest-68783932 Apr 19 14:56:47 user devstack@n-api.service[61254]: X-Role: member,reader Apr 19 14:56:47 user devstack@n-api.service[61254]: X-Roles: member,reader Apr 19 14:56:47 user devstack@n-api.service[61254]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9a5079ce8a52417fb2b8b8122bfeaa5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9a5079ce8a52417fb2b8b8122bfeaa5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9a5079ce8a52417fb2b8b8122bfeaa5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 14:56:47 user devstack@n-api.service[61254]: X-Tenant: tempest-AttachVolumeNegativeTest-68783932 Apr 19 14:56:47 user devstack@n-api.service[61254]: X-Tenant-Id: 9a5079ce8a52417fb2b8b8122bfeaa5e Apr 19 14:56:47 user devstack@n-api.service[61254]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-68783932 Apr 19 14:56:47 user devstack@n-api.service[61254]: X-User: tempest-AttachVolumeNegativeTest-68783932-project-member Apr 19 14:56:47 user devstack@n-api.service[61254]: X-User-Domain-Id: default Apr 19 14:56:47 user devstack@n-api.service[61254]: X-User-Domain-Name: Default Apr 19 14:56:47 user devstack@n-api.service[61254]: X-User-Id: 35b23f0d7300496990e74b2fb4945c15 Apr 19 14:56:47 user devstack@n-api.service[61254]: X-User-Name: tempest-AttachVolumeNegativeTest-68783932-project-member Apr 19 14:56:47 user devstack@n-api.service[61254]: method: > Apr 19 14:56:47 user devstack@n-api.service[61254]: exception: Instance ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084 could not be found. Apr 19 14:56:47 user devstack@n-api.service[61254]: action_args: {'id': 'ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084'} Apr 19 14:56:47 user devstack@n-api.service[61254]: {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:56:47 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:56:47 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:56:47 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:56:47 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:56:47 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:56:47 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:56:47 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:56:47 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:56:47 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:56:47 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084 could not be found. Apr 19 14:56:47 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:56:47 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:56:47 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:56:47 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:56:47 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:56:47 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:56:47 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:56:47 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:56:47 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:56:47 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:56:47 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:56:47 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:56:47 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:56:47 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:56:47 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:56:47 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:56:47 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084 could not be found. Apr 19 14:56:47 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:56:47 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:56:47 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:56:47 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:56:47 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:56:47 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:56:47 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:56:47 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:56:47 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084 could not be found. Apr 19 14:56:47 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:56:47 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-1f17630e-1190-4a9b-96d4-7f0c034f777b tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Returning 404 to user: Instance ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084 could not be found. {{(pid=61254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:56:47 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-1f17630e-1190-4a9b-96d4-7f0c034f777b tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084" status: 404 len: 111 microversion: 2.1 time: 0.028266 Apr 19 14:56:47 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 89/269] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:56:47 2023] GET /compute/v2.1/servers/ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:56:47 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-38318a51-6ccf-4a3b-8f14-14e6e25ed99f tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Calling method '.version_select at 0x7f3cfa9c0b80>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:56:47 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-38318a51-6ccf-4a3b-8f14-14e6e25ed99f tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-786936530" status: 202 len: 0 microversion: 2.1 time: 0.025938 Apr 19 14:56:47 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 92/270] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 19 14:56:47 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-786936530 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 14:56:48 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-21838d02-2e9c-4d2e-8842-b10b6fd89ba3 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Action: 'create', calling method: .version_select at 0x7f3cfa8449d0>, body: {"keypair": {"name": "tempest-keypair-2088268776", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBr9QFtp5nfq7zHOvaljLuDLQ+/5qNQ7D5JnCHzJabffxtskpQhNglt9dJlCrZHMzTmoefe19GgJPzC1ivjZj0/RmeemcHuhycd1VlU8ul3s3zHRwDGvSVdpOkuVbx73MA=="}} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:56:48 user devstack@n-api.service[61253]: DEBUG nova.quota [None req-21838d02-2e9c-4d2e-8842-b10b6fd89ba3 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Getting quotas for project 9a5079ce8a52417fb2b8b8122bfeaa5e. Resources: {'key_pairs'} {{(pid=61253) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:56:48 user devstack@n-api.service[61253]: DEBUG nova.quota [None req-21838d02-2e9c-4d2e-8842-b10b6fd89ba3 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Getting quotas for user 35b23f0d7300496990e74b2fb4945c15 and project 9a5079ce8a52417fb2b8b8122bfeaa5e. Resources: {'key_pairs'} {{(pid=61253) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:56:48 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-21838d02-2e9c-4d2e-8842-b10b6fd89ba3 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047609 Apr 19 14:56:48 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 90/271] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 14:56:48 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:56:50 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-51697503-6639-4f6a-8270-926b65bcd97b tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:56:50 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-51697503-6639-4f6a-8270-926b65bcd97b tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] [instance: dbf728fc-fcd9-4819-8bae-3816c3fde252] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:56:50 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-51697503-6639-4f6a-8270-926b65bcd97b tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:50 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-51697503-6639-4f6a-8270-926b65bcd97b tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:50 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-51697503-6639-4f6a-8270-926b65bcd97b tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:50 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-51697503-6639-4f6a-8270-926b65bcd97b tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:50 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-51697503-6639-4f6a-8270-926b65bcd97b tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:50 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-51697503-6639-4f6a-8270-926b65bcd97b tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:50 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-03154e92-3418-4872-a020-118788803050 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1409358157", "imageRef": "283dcfe8-75fd-4917-902e-1b940387187c", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "c9614385-ce43-416a-aeee-94db7fe5338e"}], "security_groups": [{"name": "tempest-securitygroup--1202147171"}], "key_name": "tempest-keypair-2088268776", "user_data": "}} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:56:50 user devstack@n-api.service[61255]: DEBUG nova.network.neutron [None req-03154e92-3418-4872-a020-118788803050 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] validate_networks() for [('c9614385-ce43-416a-aeee-94db7fe5338e', None, None, None, None, None)] {{(pid=61255) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 14:56:50 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-51697503-6639-4f6a-8270-926b65bcd97b tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2057a3280134a99bc9a97c66ad51220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7a6d6040c4475b034b1f33f97a491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:56:50 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-51697503-6639-4f6a-8270-926b65bcd97b tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dbf728fc-fcd9-4819-8bae-3816c3fde252" status: 200 len: 1567 microversion: 2.1 time: 0.216926 Apr 19 14:56:50 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 90/272] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:56:50 2023] GET /compute/v2.1/servers/dbf728fc-fcd9-4819-8bae-3816c3fde252 => generated 1567 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:56:50 user devstack@n-api.service[61255]: DEBUG nova.virt.hardware [None req-03154e92-3418-4872-a020-118788803050 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Flavor limits 0:0:0 {{(pid=61255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 14:56:50 user devstack@n-api.service[61255]: DEBUG nova.virt.hardware [None req-03154e92-3418-4872-a020-118788803050 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Image limits 0:0:0 {{(pid=61255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 14:56:50 user devstack@n-api.service[61255]: DEBUG nova.virt.hardware [None req-03154e92-3418-4872-a020-118788803050 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Flavor pref 0:0:0 {{(pid=61255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 14:56:50 user devstack@n-api.service[61255]: DEBUG nova.virt.hardware [None req-03154e92-3418-4872-a020-118788803050 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Image pref 0:0:0 {{(pid=61255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 14:56:50 user devstack@n-api.service[61255]: DEBUG nova.virt.hardware [None req-03154e92-3418-4872-a020-118788803050 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 14:56:50 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-03154e92-3418-4872-a020-118788803050 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:50 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-03154e92-3418-4872-a020-118788803050 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:50 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-03154e92-3418-4872-a020-118788803050 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:50 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-03154e92-3418-4872-a020-118788803050 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:50 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-03154e92-3418-4872-a020-118788803050 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:50 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-03154e92-3418-4872-a020-118788803050 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:51 user devstack@n-api.service[61255]: DEBUG nova.quota [None req-03154e92-3418-4872-a020-118788803050 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Getting quotas for project 9a5079ce8a52417fb2b8b8122bfeaa5e. Resources: {'ram', 'instances', 'cores'} {{(pid=61255) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:56:51 user devstack@n-api.service[61255]: DEBUG nova.quota [None req-03154e92-3418-4872-a020-118788803050 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Getting quotas for user 35b23f0d7300496990e74b2fb4945c15 and project 9a5079ce8a52417fb2b8b8122bfeaa5e. Resources: {'ram', 'instances', 'cores'} {{(pid=61255) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:56:51 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-03154e92-3418-4872-a020-118788803050 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Going to run 1 instances... {{(pid=61255) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 14:56:51 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-03154e92-3418-4872-a020-118788803050 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] [instance: 25a11d52-4c81-46e5-925d-ba88df6dfdff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='283dcfe8-75fd-4917-902e-1b940387187c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61255) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 14:56:51 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-03154e92-3418-4872-a020-118788803050 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.802807 Apr 19 14:56:51 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 93/273] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 14:56:50 2023] POST /compute/v2.1/servers => generated 400 bytes in 804 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 14:56:51 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell0:SELECT=2 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:56:51 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-a82aa0c9-6139-4ed7-b32c-9e336d74f381 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:56:51 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-a82aa0c9-6139-4ed7-b32c-9e336d74f381 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] [instance: 25a11d52-4c81-46e5-925d-ba88df6dfdff] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:56:51 user devstack@n-api.service[61253]: DEBUG nova.policy [None req-a82aa0c9-6139-4ed7-b32c-9e336d74f381 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b23f0d7300496990e74b2fb4945c15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5079ce8a52417fb2b8b8122bfeaa5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61253) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:56:51 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-a82aa0c9-6139-4ed7-b32c-9e336d74f381 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25a11d52-4c81-46e5-925d-ba88df6dfdff" status: 200 len: 1236 microversion: 2.1 time: 0.099463 Apr 19 14:56:51 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 91/274] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:56:51 2023] GET /compute/v2.1/servers/25a11d52-4c81-46e5-925d-ba88df6dfdff => generated 1236 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:56:53 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [req-57e563b9-9aaf-4010-a0c4-ced26f8892fb req-d5a8406b-3d63-4f7e-b531-2bd2880e2544 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25a11d52-4c81-46e5-925d-ba88df6dfdff", "tag": "d996ceed-0431-4551-ac4d-83403e9344cd"}]} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:56:53 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-57e563b9-9aaf-4010-a0c4-ced26f8892fb req-d5a8406b-3d63-4f7e-b531-2bd2880e2544 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:53 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-57e563b9-9aaf-4010-a0c4-ced26f8892fb req-d5a8406b-3d63-4f7e-b531-2bd2880e2544 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:53 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-57e563b9-9aaf-4010-a0c4-ced26f8892fb req-d5a8406b-3d63-4f7e-b531-2bd2880e2544 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:53 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-57e563b9-9aaf-4010-a0c4-ced26f8892fb req-d5a8406b-3d63-4f7e-b531-2bd2880e2544 service nova] Creating event network-changed:d996ceed-0431-4551-ac4d-83403e9344cd for instance 25a11d52-4c81-46e5-925d-ba88df6dfdff on user Apr 19 14:56:53 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [req-57e563b9-9aaf-4010-a0c4-ced26f8892fb req-d5a8406b-3d63-4f7e-b531-2bd2880e2544 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028886 Apr 19 14:56:53 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 91/275] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:56:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:56:54 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-522f55ca-1325-49f6-9897-327c4f6483c9 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:56:54 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-522f55ca-1325-49f6-9897-327c4f6483c9 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] [instance: 55679a8c-4cb6-4862-8ab8-ce2820166b07] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:56:54 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-522f55ca-1325-49f6-9897-327c4f6483c9 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:54 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-522f55ca-1325-49f6-9897-327c4f6483c9 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:54 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-522f55ca-1325-49f6-9897-327c4f6483c9 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:54 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-522f55ca-1325-49f6-9897-327c4f6483c9 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:54 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-522f55ca-1325-49f6-9897-327c4f6483c9 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:54 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-522f55ca-1325-49f6-9897-327c4f6483c9 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:54 user devstack@n-api.service[61255]: INFO nova.api.openstack.wsgi [None req-522f55ca-1325-49f6-9897-327c4f6483c9 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] HTTP exception thrown: Instance 55679a8c-4cb6-4862-8ab8-ce2820166b07 could not be found. Apr 19 14:56:54 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-522f55ca-1325-49f6-9897-327c4f6483c9 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Request method failure captured: Apr 19 14:56:54 user devstack@n-api.service[61255]: request: GET /compute/v2.1/servers/55679a8c-4cb6-4862-8ab8-ce2820166b07 HTTP/1.1 Apr 19 14:56:54 user devstack@n-api.service[61255]: Accept: application/json Apr 19 14:56:54 user devstack@n-api.service[61255]: Accept-Encoding: identity Apr 19 14:56:54 user devstack@n-api.service[61255]: Connection: close Apr 19 14:56:54 user devstack@n-api.service[61255]: Content-Length: 0 Apr 19 14:56:54 user devstack@n-api.service[61255]: Content-Type: application/json Apr 19 14:56:54 user devstack@n-api.service[61255]: Host: 10.0.0.210 Apr 19 14:56:54 user devstack@n-api.service[61255]: Openstack-System-Scope: None Apr 19 14:56:54 user devstack@n-api.service[61255]: User-Agent: python-urllib3/1.26.15 Apr 19 14:56:54 user devstack@n-api.service[61255]: X-Auth-Token: gAAAAABkP__nBc-ul2ufoIQ-8a_Y4r9ASP1GRxqxQT3qVrql0XilsRYx4mIkZNYlsOoIwBwsX-ssFI74wD4GjeHqArwF2sBQ688xnYvSvWU9BDPO0yM1Q2bDGkmbK6UbCvuk3t44otfV4zsHNr3E5-JFvwI1Ati_9EKl_KmECWXEf0mzig4GctY Apr 19 14:56:54 user devstack@n-api.service[61255]: X-Domain-Id: None Apr 19 14:56:54 user devstack@n-api.service[61255]: X-Domain-Name: None Apr 19 14:56:54 user devstack@n-api.service[61255]: X-Identity-Status: Confirmed Apr 19 14:56:54 user devstack@n-api.service[61255]: X-Is-Admin-Project: True Apr 19 14:56:54 user devstack@n-api.service[61255]: X-Project-Domain-Id: default Apr 19 14:56:54 user devstack@n-api.service[61255]: X-Project-Domain-Name: Default Apr 19 14:56:54 user devstack@n-api.service[61255]: X-Project-Id: 5383c493e2f049fc9dc06818cb00a6f2 Apr 19 14:56:54 user devstack@n-api.service[61255]: X-Project-Name: tempest-AttachVolumeTestJSON-605670681 Apr 19 14:56:54 user devstack@n-api.service[61255]: X-Role: member,reader Apr 19 14:56:54 user devstack@n-api.service[61255]: X-Roles: member,reader Apr 19 14:56:54 user devstack@n-api.service[61255]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5383c493e2f049fc9dc06818cb00a6f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5383c493e2f049fc9dc06818cb00a6f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5383c493e2f049fc9dc06818cb00a6f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 14:56:54 user devstack@n-api.service[61255]: X-Tenant: tempest-AttachVolumeTestJSON-605670681 Apr 19 14:56:54 user devstack@n-api.service[61255]: X-Tenant-Id: 5383c493e2f049fc9dc06818cb00a6f2 Apr 19 14:56:54 user devstack@n-api.service[61255]: X-Tenant-Name: tempest-AttachVolumeTestJSON-605670681 Apr 19 14:56:54 user devstack@n-api.service[61255]: X-User: tempest-AttachVolumeTestJSON-605670681-project-member Apr 19 14:56:54 user devstack@n-api.service[61255]: X-User-Domain-Id: default Apr 19 14:56:54 user devstack@n-api.service[61255]: X-User-Domain-Name: Default Apr 19 14:56:54 user devstack@n-api.service[61255]: X-User-Id: fab5193fb1ec41b8a19e8621843a54a7 Apr 19 14:56:54 user devstack@n-api.service[61255]: X-User-Name: tempest-AttachVolumeTestJSON-605670681-project-member Apr 19 14:56:54 user devstack@n-api.service[61255]: method: > Apr 19 14:56:54 user devstack@n-api.service[61255]: exception: Instance 55679a8c-4cb6-4862-8ab8-ce2820166b07 could not be found. Apr 19 14:56:54 user devstack@n-api.service[61255]: action_args: {'id': '55679a8c-4cb6-4862-8ab8-ce2820166b07'} Apr 19 14:56:54 user devstack@n-api.service[61255]: {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:56:54 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:56:54 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:56:54 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:56:54 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:56:54 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:56:54 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:56:54 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:56:54 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:56:54 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:56:54 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55679a8c-4cb6-4862-8ab8-ce2820166b07 could not be found. Apr 19 14:56:54 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:56:54 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:56:54 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:56:54 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:56:54 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:56:54 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:56:54 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:56:54 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:56:54 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:56:54 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:56:54 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:56:54 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:56:54 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:56:54 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:56:54 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:56:54 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:56:54 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55679a8c-4cb6-4862-8ab8-ce2820166b07 could not be found. Apr 19 14:56:54 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:56:54 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:56:54 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:56:54 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:56:54 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:56:54 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:56:54 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:56:54 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:56:54 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55679a8c-4cb6-4862-8ab8-ce2820166b07 could not be found. Apr 19 14:56:54 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:56:54 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-522f55ca-1325-49f6-9897-327c4f6483c9 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Returning 404 to user: Instance 55679a8c-4cb6-4862-8ab8-ce2820166b07 could not be found. {{(pid=61255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:56:54 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-522f55ca-1325-49f6-9897-327c4f6483c9 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55679a8c-4cb6-4862-8ab8-ce2820166b07" status: 404 len: 111 microversion: 2.1 time: 0.201571 Apr 19 14:56:54 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 94/276] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:56:54 2023] GET /compute/v2.1/servers/55679a8c-4cb6-4862-8ab8-ce2820166b07 => generated 111 bytes in 203 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:56:54 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-ee550e40-e502-4ced-a612-6e6620e026f7 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Calling method '.version_select at 0x7f3cfa8445e0>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:56:54 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-ee550e40-e502-4ced-a612-6e6620e026f7 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-144624132" status: 202 len: 0 microversion: 2.1 time: 0.022773 Apr 19 14:56:54 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 92/277] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 19 14:56:54 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-144624132 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 14:56:55 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-f516c225-e299-4646-bbb0-4fe4afc315ec tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:56:55 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-f516c225-e299-4646-bbb0-4fe4afc315ec tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] [instance: 55679a8c-4cb6-4862-8ab8-ce2820166b07] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:56:55 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-f516c225-e299-4646-bbb0-4fe4afc315ec tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:55 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-f516c225-e299-4646-bbb0-4fe4afc315ec tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:55 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-f516c225-e299-4646-bbb0-4fe4afc315ec tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:55 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-f516c225-e299-4646-bbb0-4fe4afc315ec tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:55 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-f516c225-e299-4646-bbb0-4fe4afc315ec tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:55 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-f516c225-e299-4646-bbb0-4fe4afc315ec tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:55 user devstack@n-api.service[61254]: INFO nova.api.openstack.wsgi [None req-f516c225-e299-4646-bbb0-4fe4afc315ec tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] HTTP exception thrown: Instance 55679a8c-4cb6-4862-8ab8-ce2820166b07 could not be found. Apr 19 14:56:55 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-f516c225-e299-4646-bbb0-4fe4afc315ec tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Request method failure captured: Apr 19 14:56:55 user devstack@n-api.service[61254]: request: DELETE /compute/v2.1/servers/55679a8c-4cb6-4862-8ab8-ce2820166b07 HTTP/1.1 Apr 19 14:56:55 user devstack@n-api.service[61254]: Accept: application/json Apr 19 14:56:55 user devstack@n-api.service[61254]: Accept-Encoding: identity Apr 19 14:56:55 user devstack@n-api.service[61254]: Connection: close Apr 19 14:56:55 user devstack@n-api.service[61254]: Content-Length: 0 Apr 19 14:56:55 user devstack@n-api.service[61254]: Content-Type: application/json Apr 19 14:56:55 user devstack@n-api.service[61254]: Host: 10.0.0.210 Apr 19 14:56:55 user devstack@n-api.service[61254]: Openstack-System-Scope: None Apr 19 14:56:55 user devstack@n-api.service[61254]: User-Agent: python-urllib3/1.26.15 Apr 19 14:56:55 user devstack@n-api.service[61254]: X-Auth-Token: gAAAAABkP__nBc-ul2ufoIQ-8a_Y4r9ASP1GRxqxQT3qVrql0XilsRYx4mIkZNYlsOoIwBwsX-ssFI74wD4GjeHqArwF2sBQ688xnYvSvWU9BDPO0yM1Q2bDGkmbK6UbCvuk3t44otfV4zsHNr3E5-JFvwI1Ati_9EKl_KmECWXEf0mzig4GctY Apr 19 14:56:55 user devstack@n-api.service[61254]: X-Domain-Id: None Apr 19 14:56:55 user devstack@n-api.service[61254]: X-Domain-Name: None Apr 19 14:56:55 user devstack@n-api.service[61254]: X-Identity-Status: Confirmed Apr 19 14:56:55 user devstack@n-api.service[61254]: X-Is-Admin-Project: True Apr 19 14:56:55 user devstack@n-api.service[61254]: X-Project-Domain-Id: default Apr 19 14:56:55 user devstack@n-api.service[61254]: X-Project-Domain-Name: Default Apr 19 14:56:55 user devstack@n-api.service[61254]: X-Project-Id: 5383c493e2f049fc9dc06818cb00a6f2 Apr 19 14:56:55 user devstack@n-api.service[61254]: X-Project-Name: tempest-AttachVolumeTestJSON-605670681 Apr 19 14:56:55 user devstack@n-api.service[61254]: X-Role: member,reader Apr 19 14:56:55 user devstack@n-api.service[61254]: X-Roles: member,reader Apr 19 14:56:55 user devstack@n-api.service[61254]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5383c493e2f049fc9dc06818cb00a6f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5383c493e2f049fc9dc06818cb00a6f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5383c493e2f049fc9dc06818cb00a6f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 14:56:55 user devstack@n-api.service[61254]: X-Tenant: tempest-AttachVolumeTestJSON-605670681 Apr 19 14:56:55 user devstack@n-api.service[61254]: X-Tenant-Id: 5383c493e2f049fc9dc06818cb00a6f2 Apr 19 14:56:55 user devstack@n-api.service[61254]: X-Tenant-Name: tempest-AttachVolumeTestJSON-605670681 Apr 19 14:56:55 user devstack@n-api.service[61254]: X-User: tempest-AttachVolumeTestJSON-605670681-project-member Apr 19 14:56:55 user devstack@n-api.service[61254]: X-User-Domain-Id: default Apr 19 14:56:55 user devstack@n-api.service[61254]: X-User-Domain-Name: Default Apr 19 14:56:55 user devstack@n-api.service[61254]: X-User-Id: fab5193fb1ec41b8a19e8621843a54a7 Apr 19 14:56:55 user devstack@n-api.service[61254]: X-User-Name: tempest-AttachVolumeTestJSON-605670681-project-member Apr 19 14:56:55 user devstack@n-api.service[61254]: method: > Apr 19 14:56:55 user devstack@n-api.service[61254]: exception: Instance 55679a8c-4cb6-4862-8ab8-ce2820166b07 could not be found. Apr 19 14:56:55 user devstack@n-api.service[61254]: action_args: {'id': '55679a8c-4cb6-4862-8ab8-ce2820166b07'} Apr 19 14:56:55 user devstack@n-api.service[61254]: {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:56:55 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:56:55 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:56:55 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:56:55 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:56:55 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:56:55 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:56:55 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:56:55 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:56:55 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:56:55 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55679a8c-4cb6-4862-8ab8-ce2820166b07 could not be found. Apr 19 14:56:55 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:56:55 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:56:55 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:56:55 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:56:55 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:56:55 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:56:55 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:56:55 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:56:55 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:56:55 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:56:55 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 19 14:56:55 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 19 14:56:55 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 19 14:56:55 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 19 14:56:55 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:56:55 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:56:55 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:56:55 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:56:55 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55679a8c-4cb6-4862-8ab8-ce2820166b07 could not be found. Apr 19 14:56:55 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:56:55 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:56:55 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:56:55 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:56:55 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:56:55 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:56:55 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:56:55 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:56:55 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55679a8c-4cb6-4862-8ab8-ce2820166b07 could not be found. Apr 19 14:56:55 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:56:55 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-f516c225-e299-4646-bbb0-4fe4afc315ec tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Returning 404 to user: Instance 55679a8c-4cb6-4862-8ab8-ce2820166b07 could not be found. {{(pid=61254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:56:55 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-f516c225-e299-4646-bbb0-4fe4afc315ec tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/55679a8c-4cb6-4862-8ab8-ce2820166b07" status: 404 len: 111 microversion: 2.1 time: 0.036689 Apr 19 14:56:55 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 92/278] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 14:56:55 2023] DELETE /compute/v2.1/servers/55679a8c-4cb6-4862-8ab8-ce2820166b07 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:56:55 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-01e054a0-05d2-4e72-b537-82d17e34a3f8 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:56:55 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-01e054a0-05d2-4e72-b537-82d17e34a3f8 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] [instance: 55679a8c-4cb6-4862-8ab8-ce2820166b07] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:56:55 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-01e054a0-05d2-4e72-b537-82d17e34a3f8 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:55 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-01e054a0-05d2-4e72-b537-82d17e34a3f8 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:55 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-01e054a0-05d2-4e72-b537-82d17e34a3f8 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:55 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-01e054a0-05d2-4e72-b537-82d17e34a3f8 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:55 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-01e054a0-05d2-4e72-b537-82d17e34a3f8 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:55 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-01e054a0-05d2-4e72-b537-82d17e34a3f8 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:55 user devstack@n-api.service[61255]: INFO nova.api.openstack.wsgi [None req-01e054a0-05d2-4e72-b537-82d17e34a3f8 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] HTTP exception thrown: Instance 55679a8c-4cb6-4862-8ab8-ce2820166b07 could not be found. Apr 19 14:56:55 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-01e054a0-05d2-4e72-b537-82d17e34a3f8 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Request method failure captured: Apr 19 14:56:55 user devstack@n-api.service[61255]: request: GET /compute/v2.1/servers/55679a8c-4cb6-4862-8ab8-ce2820166b07 HTTP/1.1 Apr 19 14:56:55 user devstack@n-api.service[61255]: Accept: application/json Apr 19 14:56:55 user devstack@n-api.service[61255]: Accept-Encoding: identity Apr 19 14:56:55 user devstack@n-api.service[61255]: Connection: close Apr 19 14:56:55 user devstack@n-api.service[61255]: Content-Length: 0 Apr 19 14:56:55 user devstack@n-api.service[61255]: Content-Type: application/json Apr 19 14:56:55 user devstack@n-api.service[61255]: Host: 10.0.0.210 Apr 19 14:56:55 user devstack@n-api.service[61255]: Openstack-System-Scope: None Apr 19 14:56:55 user devstack@n-api.service[61255]: User-Agent: python-urllib3/1.26.15 Apr 19 14:56:55 user devstack@n-api.service[61255]: X-Auth-Token: gAAAAABkP__nBc-ul2ufoIQ-8a_Y4r9ASP1GRxqxQT3qVrql0XilsRYx4mIkZNYlsOoIwBwsX-ssFI74wD4GjeHqArwF2sBQ688xnYvSvWU9BDPO0yM1Q2bDGkmbK6UbCvuk3t44otfV4zsHNr3E5-JFvwI1Ati_9EKl_KmECWXEf0mzig4GctY Apr 19 14:56:55 user devstack@n-api.service[61255]: X-Domain-Id: None Apr 19 14:56:55 user devstack@n-api.service[61255]: X-Domain-Name: None Apr 19 14:56:55 user devstack@n-api.service[61255]: X-Identity-Status: Confirmed Apr 19 14:56:55 user devstack@n-api.service[61255]: X-Is-Admin-Project: True Apr 19 14:56:55 user devstack@n-api.service[61255]: X-Project-Domain-Id: default Apr 19 14:56:55 user devstack@n-api.service[61255]: X-Project-Domain-Name: Default Apr 19 14:56:55 user devstack@n-api.service[61255]: X-Project-Id: 5383c493e2f049fc9dc06818cb00a6f2 Apr 19 14:56:55 user devstack@n-api.service[61255]: X-Project-Name: tempest-AttachVolumeTestJSON-605670681 Apr 19 14:56:55 user devstack@n-api.service[61255]: X-Role: member,reader Apr 19 14:56:55 user devstack@n-api.service[61255]: X-Roles: member,reader Apr 19 14:56:55 user devstack@n-api.service[61255]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5383c493e2f049fc9dc06818cb00a6f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5383c493e2f049fc9dc06818cb00a6f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5383c493e2f049fc9dc06818cb00a6f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 14:56:55 user devstack@n-api.service[61255]: X-Tenant: tempest-AttachVolumeTestJSON-605670681 Apr 19 14:56:55 user devstack@n-api.service[61255]: X-Tenant-Id: 5383c493e2f049fc9dc06818cb00a6f2 Apr 19 14:56:55 user devstack@n-api.service[61255]: X-Tenant-Name: tempest-AttachVolumeTestJSON-605670681 Apr 19 14:56:55 user devstack@n-api.service[61255]: X-User: tempest-AttachVolumeTestJSON-605670681-project-member Apr 19 14:56:55 user devstack@n-api.service[61255]: X-User-Domain-Id: default Apr 19 14:56:55 user devstack@n-api.service[61255]: X-User-Domain-Name: Default Apr 19 14:56:55 user devstack@n-api.service[61255]: X-User-Id: fab5193fb1ec41b8a19e8621843a54a7 Apr 19 14:56:55 user devstack@n-api.service[61255]: X-User-Name: tempest-AttachVolumeTestJSON-605670681-project-member Apr 19 14:56:55 user devstack@n-api.service[61255]: method: > Apr 19 14:56:55 user devstack@n-api.service[61255]: exception: Instance 55679a8c-4cb6-4862-8ab8-ce2820166b07 could not be found. Apr 19 14:56:55 user devstack@n-api.service[61255]: action_args: {'id': '55679a8c-4cb6-4862-8ab8-ce2820166b07'} Apr 19 14:56:55 user devstack@n-api.service[61255]: {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:56:55 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:56:55 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:56:55 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:56:55 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:56:55 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:56:55 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:56:55 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:56:55 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:56:55 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:56:55 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55679a8c-4cb6-4862-8ab8-ce2820166b07 could not be found. Apr 19 14:56:55 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:56:55 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:56:55 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:56:55 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:56:55 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:56:55 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:56:55 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:56:55 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:56:55 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:56:55 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:56:55 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:56:55 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:56:55 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:56:55 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:56:55 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:56:55 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:56:55 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55679a8c-4cb6-4862-8ab8-ce2820166b07 could not be found. Apr 19 14:56:55 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:56:55 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:56:55 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:56:55 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:56:55 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:56:55 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:56:55 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:56:55 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:56:55 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55679a8c-4cb6-4862-8ab8-ce2820166b07 could not be found. Apr 19 14:56:55 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:56:55 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-01e054a0-05d2-4e72-b537-82d17e34a3f8 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Returning 404 to user: Instance 55679a8c-4cb6-4862-8ab8-ce2820166b07 could not be found. {{(pid=61255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:56:55 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-01e054a0-05d2-4e72-b537-82d17e34a3f8 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55679a8c-4cb6-4862-8ab8-ce2820166b07" status: 404 len: 111 microversion: 2.1 time: 0.034472 Apr 19 14:56:55 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 95/279] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:56:55 2023] GET /compute/v2.1/servers/55679a8c-4cb6-4862-8ab8-ce2820166b07 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 19 14:56:55 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell1:SELECT=18 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:56:55 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [req-acf63a54-f35e-4d47-9a54-1e923d68e22d req-880c24f0-0933-4ccd-b071-ed8d24f02b23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25a11d52-4c81-46e5-925d-ba88df6dfdff", "name": "network-vif-plugged", "status": "completed", "tag": "d996ceed-0431-4551-ac4d-83403e9344cd"}]} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:56:55 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-acf63a54-f35e-4d47-9a54-1e923d68e22d req-880c24f0-0933-4ccd-b071-ed8d24f02b23 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:55 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-acf63a54-f35e-4d47-9a54-1e923d68e22d req-880c24f0-0933-4ccd-b071-ed8d24f02b23 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:55 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-acf63a54-f35e-4d47-9a54-1e923d68e22d req-880c24f0-0933-4ccd-b071-ed8d24f02b23 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:55 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-acf63a54-f35e-4d47-9a54-1e923d68e22d req-880c24f0-0933-4ccd-b071-ed8d24f02b23 service nova] Creating event network-vif-plugged:d996ceed-0431-4551-ac4d-83403e9344cd for instance 25a11d52-4c81-46e5-925d-ba88df6dfdff on user Apr 19 14:56:55 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [req-acf63a54-f35e-4d47-9a54-1e923d68e22d req-880c24f0-0933-4ccd-b071-ed8d24f02b23 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044525 Apr 19 14:56:55 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 93/280] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:56:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:56:55 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-354503a1-8fbb-4f1c-a846-24b155add4c3 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:56:55 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-354503a1-8fbb-4f1c-a846-24b155add4c3 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] [instance: 22962ccc-a7a7-410e-9042-7f01424d38a6] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:56:55 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-354503a1-8fbb-4f1c-a846-24b155add4c3 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:55 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-354503a1-8fbb-4f1c-a846-24b155add4c3 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:55 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-354503a1-8fbb-4f1c-a846-24b155add4c3 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:55 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-354503a1-8fbb-4f1c-a846-24b155add4c3 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:55 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-354503a1-8fbb-4f1c-a846-24b155add4c3 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:55 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-354503a1-8fbb-4f1c-a846-24b155add4c3 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:56 user devstack@n-api.service[61254]: INFO nova.api.openstack.wsgi [None req-354503a1-8fbb-4f1c-a846-24b155add4c3 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] HTTP exception thrown: Instance 22962ccc-a7a7-410e-9042-7f01424d38a6 could not be found. Apr 19 14:56:56 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-354503a1-8fbb-4f1c-a846-24b155add4c3 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Request method failure captured: Apr 19 14:56:56 user devstack@n-api.service[61254]: request: DELETE /compute/v2.1/servers/22962ccc-a7a7-410e-9042-7f01424d38a6 HTTP/1.1 Apr 19 14:56:56 user devstack@n-api.service[61254]: Accept: application/json Apr 19 14:56:56 user devstack@n-api.service[61254]: Accept-Encoding: identity Apr 19 14:56:56 user devstack@n-api.service[61254]: Connection: close Apr 19 14:56:56 user devstack@n-api.service[61254]: Content-Length: 0 Apr 19 14:56:56 user devstack@n-api.service[61254]: Content-Type: application/json Apr 19 14:56:56 user devstack@n-api.service[61254]: Host: 10.0.0.210 Apr 19 14:56:56 user devstack@n-api.service[61254]: Openstack-System-Scope: None Apr 19 14:56:56 user devstack@n-api.service[61254]: User-Agent: python-urllib3/1.26.15 Apr 19 14:56:56 user devstack@n-api.service[61254]: X-Auth-Token: gAAAAABkP__nBc-ul2ufoIQ-8a_Y4r9ASP1GRxqxQT3qVrql0XilsRYx4mIkZNYlsOoIwBwsX-ssFI74wD4GjeHqArwF2sBQ688xnYvSvWU9BDPO0yM1Q2bDGkmbK6UbCvuk3t44otfV4zsHNr3E5-JFvwI1Ati_9EKl_KmECWXEf0mzig4GctY Apr 19 14:56:56 user devstack@n-api.service[61254]: X-Domain-Id: None Apr 19 14:56:56 user devstack@n-api.service[61254]: X-Domain-Name: None Apr 19 14:56:56 user devstack@n-api.service[61254]: X-Identity-Status: Confirmed Apr 19 14:56:56 user devstack@n-api.service[61254]: X-Is-Admin-Project: True Apr 19 14:56:56 user devstack@n-api.service[61254]: X-Project-Domain-Id: default Apr 19 14:56:56 user devstack@n-api.service[61254]: X-Project-Domain-Name: Default Apr 19 14:56:56 user devstack@n-api.service[61254]: X-Project-Id: 5383c493e2f049fc9dc06818cb00a6f2 Apr 19 14:56:56 user devstack@n-api.service[61254]: X-Project-Name: tempest-AttachVolumeTestJSON-605670681 Apr 19 14:56:56 user devstack@n-api.service[61254]: X-Role: member,reader Apr 19 14:56:56 user devstack@n-api.service[61254]: X-Roles: member,reader Apr 19 14:56:56 user devstack@n-api.service[61254]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5383c493e2f049fc9dc06818cb00a6f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5383c493e2f049fc9dc06818cb00a6f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5383c493e2f049fc9dc06818cb00a6f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 14:56:56 user devstack@n-api.service[61254]: X-Tenant: tempest-AttachVolumeTestJSON-605670681 Apr 19 14:56:56 user devstack@n-api.service[61254]: X-Tenant-Id: 5383c493e2f049fc9dc06818cb00a6f2 Apr 19 14:56:56 user devstack@n-api.service[61254]: X-Tenant-Name: tempest-AttachVolumeTestJSON-605670681 Apr 19 14:56:56 user devstack@n-api.service[61254]: X-User: tempest-AttachVolumeTestJSON-605670681-project-member Apr 19 14:56:56 user devstack@n-api.service[61254]: X-User-Domain-Id: default Apr 19 14:56:56 user devstack@n-api.service[61254]: X-User-Domain-Name: Default Apr 19 14:56:56 user devstack@n-api.service[61254]: X-User-Id: fab5193fb1ec41b8a19e8621843a54a7 Apr 19 14:56:56 user devstack@n-api.service[61254]: X-User-Name: tempest-AttachVolumeTestJSON-605670681-project-member Apr 19 14:56:56 user devstack@n-api.service[61254]: method: > Apr 19 14:56:56 user devstack@n-api.service[61254]: exception: Instance 22962ccc-a7a7-410e-9042-7f01424d38a6 could not be found. Apr 19 14:56:56 user devstack@n-api.service[61254]: action_args: {'id': '22962ccc-a7a7-410e-9042-7f01424d38a6'} Apr 19 14:56:56 user devstack@n-api.service[61254]: {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:56:56 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:56:56 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:56:56 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:56:56 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:56:56 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:56:56 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:56:56 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:56:56 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:56:56 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:56:56 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22962ccc-a7a7-410e-9042-7f01424d38a6 could not be found. Apr 19 14:56:56 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:56:56 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:56:56 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:56:56 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:56:56 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:56:56 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:56:56 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:56:56 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:56:56 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:56:56 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:56:56 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 19 14:56:56 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 19 14:56:56 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 19 14:56:56 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 19 14:56:56 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:56:56 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:56:56 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:56:56 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:56:56 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22962ccc-a7a7-410e-9042-7f01424d38a6 could not be found. Apr 19 14:56:56 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:56:56 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:56:56 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:56:56 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:56:56 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:56:56 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:56:56 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:56:56 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:56:56 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22962ccc-a7a7-410e-9042-7f01424d38a6 could not be found. Apr 19 14:56:56 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:56:56 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-354503a1-8fbb-4f1c-a846-24b155add4c3 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Returning 404 to user: Instance 22962ccc-a7a7-410e-9042-7f01424d38a6 could not be found. {{(pid=61254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:56:56 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-354503a1-8fbb-4f1c-a846-24b155add4c3 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/22962ccc-a7a7-410e-9042-7f01424d38a6" status: 404 len: 111 microversion: 2.1 time: 0.029015 Apr 19 14:56:56 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 93/281] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 14:56:55 2023] DELETE /compute/v2.1/servers/22962ccc-a7a7-410e-9042-7f01424d38a6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:56:56 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-13def6e0-d711-4d7e-8147-6b9dfd4926f5 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:56:56 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-13def6e0-d711-4d7e-8147-6b9dfd4926f5 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] [instance: 22962ccc-a7a7-410e-9042-7f01424d38a6] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:56:56 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-13def6e0-d711-4d7e-8147-6b9dfd4926f5 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:56 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-13def6e0-d711-4d7e-8147-6b9dfd4926f5 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:56 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-13def6e0-d711-4d7e-8147-6b9dfd4926f5 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:56 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-13def6e0-d711-4d7e-8147-6b9dfd4926f5 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:56 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-13def6e0-d711-4d7e-8147-6b9dfd4926f5 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:56 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-13def6e0-d711-4d7e-8147-6b9dfd4926f5 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:56 user devstack@n-api.service[61255]: INFO nova.api.openstack.wsgi [None req-13def6e0-d711-4d7e-8147-6b9dfd4926f5 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] HTTP exception thrown: Instance 22962ccc-a7a7-410e-9042-7f01424d38a6 could not be found. Apr 19 14:56:56 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-13def6e0-d711-4d7e-8147-6b9dfd4926f5 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Request method failure captured: Apr 19 14:56:56 user devstack@n-api.service[61255]: request: GET /compute/v2.1/servers/22962ccc-a7a7-410e-9042-7f01424d38a6 HTTP/1.1 Apr 19 14:56:56 user devstack@n-api.service[61255]: Accept: application/json Apr 19 14:56:56 user devstack@n-api.service[61255]: Accept-Encoding: identity Apr 19 14:56:56 user devstack@n-api.service[61255]: Connection: close Apr 19 14:56:56 user devstack@n-api.service[61255]: Content-Length: 0 Apr 19 14:56:56 user devstack@n-api.service[61255]: Content-Type: application/json Apr 19 14:56:56 user devstack@n-api.service[61255]: Host: 10.0.0.210 Apr 19 14:56:56 user devstack@n-api.service[61255]: Openstack-System-Scope: None Apr 19 14:56:56 user devstack@n-api.service[61255]: User-Agent: python-urllib3/1.26.15 Apr 19 14:56:56 user devstack@n-api.service[61255]: X-Auth-Token: gAAAAABkP__nBc-ul2ufoIQ-8a_Y4r9ASP1GRxqxQT3qVrql0XilsRYx4mIkZNYlsOoIwBwsX-ssFI74wD4GjeHqArwF2sBQ688xnYvSvWU9BDPO0yM1Q2bDGkmbK6UbCvuk3t44otfV4zsHNr3E5-JFvwI1Ati_9EKl_KmECWXEf0mzig4GctY Apr 19 14:56:56 user devstack@n-api.service[61255]: X-Domain-Id: None Apr 19 14:56:56 user devstack@n-api.service[61255]: X-Domain-Name: None Apr 19 14:56:56 user devstack@n-api.service[61255]: X-Identity-Status: Confirmed Apr 19 14:56:56 user devstack@n-api.service[61255]: X-Is-Admin-Project: True Apr 19 14:56:56 user devstack@n-api.service[61255]: X-Project-Domain-Id: default Apr 19 14:56:56 user devstack@n-api.service[61255]: X-Project-Domain-Name: Default Apr 19 14:56:56 user devstack@n-api.service[61255]: X-Project-Id: 5383c493e2f049fc9dc06818cb00a6f2 Apr 19 14:56:56 user devstack@n-api.service[61255]: X-Project-Name: tempest-AttachVolumeTestJSON-605670681 Apr 19 14:56:56 user devstack@n-api.service[61255]: X-Role: member,reader Apr 19 14:56:56 user devstack@n-api.service[61255]: X-Roles: member,reader Apr 19 14:56:56 user devstack@n-api.service[61255]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5383c493e2f049fc9dc06818cb00a6f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5383c493e2f049fc9dc06818cb00a6f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5383c493e2f049fc9dc06818cb00a6f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 14:56:56 user devstack@n-api.service[61255]: X-Tenant: tempest-AttachVolumeTestJSON-605670681 Apr 19 14:56:56 user devstack@n-api.service[61255]: X-Tenant-Id: 5383c493e2f049fc9dc06818cb00a6f2 Apr 19 14:56:56 user devstack@n-api.service[61255]: X-Tenant-Name: tempest-AttachVolumeTestJSON-605670681 Apr 19 14:56:56 user devstack@n-api.service[61255]: X-User: tempest-AttachVolumeTestJSON-605670681-project-member Apr 19 14:56:56 user devstack@n-api.service[61255]: X-User-Domain-Id: default Apr 19 14:56:56 user devstack@n-api.service[61255]: X-User-Domain-Name: Default Apr 19 14:56:56 user devstack@n-api.service[61255]: X-User-Id: fab5193fb1ec41b8a19e8621843a54a7 Apr 19 14:56:56 user devstack@n-api.service[61255]: X-User-Name: tempest-AttachVolumeTestJSON-605670681-project-member Apr 19 14:56:56 user devstack@n-api.service[61255]: method: > Apr 19 14:56:56 user devstack@n-api.service[61255]: exception: Instance 22962ccc-a7a7-410e-9042-7f01424d38a6 could not be found. Apr 19 14:56:56 user devstack@n-api.service[61255]: action_args: {'id': '22962ccc-a7a7-410e-9042-7f01424d38a6'} Apr 19 14:56:56 user devstack@n-api.service[61255]: {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:56:56 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:56:56 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:56:56 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:56:56 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:56:56 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:56:56 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:56:56 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:56:56 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:56:56 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:56:56 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22962ccc-a7a7-410e-9042-7f01424d38a6 could not be found. Apr 19 14:56:56 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:56:56 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:56:56 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:56:56 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:56:56 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:56:56 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:56:56 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:56:56 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:56:56 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:56:56 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:56:56 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:56:56 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:56:56 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:56:56 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:56:56 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:56:56 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:56:56 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22962ccc-a7a7-410e-9042-7f01424d38a6 could not be found. Apr 19 14:56:56 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:56:56 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:56:56 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:56:56 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:56:56 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:56:56 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:56:56 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:56:56 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:56:56 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22962ccc-a7a7-410e-9042-7f01424d38a6 could not be found. Apr 19 14:56:56 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:56:56 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-13def6e0-d711-4d7e-8147-6b9dfd4926f5 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] Returning 404 to user: Instance 22962ccc-a7a7-410e-9042-7f01424d38a6 could not be found. {{(pid=61255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:56:56 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-13def6e0-d711-4d7e-8147-6b9dfd4926f5 tempest-AttachVolumeTestJSON-605670681 tempest-AttachVolumeTestJSON-605670681-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22962ccc-a7a7-410e-9042-7f01424d38a6" status: 404 len: 111 microversion: 2.1 time: 0.027910 Apr 19 14:56:56 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 96/282] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:56:56 2023] GET /compute/v2.1/servers/22962ccc-a7a7-410e-9042-7f01424d38a6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:56:57 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [req-1e7142f9-b740-4afe-a626-526f2d663727 req-bddd9e91-5a73-46c7-8bb0-1ea46156435a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25a11d52-4c81-46e5-925d-ba88df6dfdff", "name": "network-vif-plugged", "status": "completed", "tag": "d996ceed-0431-4551-ac4d-83403e9344cd"}]} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:56:57 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-1e7142f9-b740-4afe-a626-526f2d663727 req-bddd9e91-5a73-46c7-8bb0-1ea46156435a service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:56:57 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-1e7142f9-b740-4afe-a626-526f2d663727 req-bddd9e91-5a73-46c7-8bb0-1ea46156435a service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:56:57 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-1e7142f9-b740-4afe-a626-526f2d663727 req-bddd9e91-5a73-46c7-8bb0-1ea46156435a service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:56:57 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-1e7142f9-b740-4afe-a626-526f2d663727 req-bddd9e91-5a73-46c7-8bb0-1ea46156435a service nova] Creating event network-vif-plugged:d996ceed-0431-4551-ac4d-83403e9344cd for instance 25a11d52-4c81-46e5-925d-ba88df6dfdff on user Apr 19 14:56:57 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [req-1e7142f9-b740-4afe-a626-526f2d663727 req-bddd9e91-5a73-46c7-8bb0-1ea46156435a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035213 Apr 19 14:56:57 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 94/283] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:56:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:57:07 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-8e2534e6-ce85-4131-85ad-a052f1d825b6 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:57:07 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-8e2534e6-ce85-4131-85ad-a052f1d825b6 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] [instance: 9c330e74-9939-422b-88f6-1958857b6c41] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:57:07 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:57:07 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell1:SELECT=22 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:57:07 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-8e2534e6-ce85-4131-85ad-a052f1d825b6 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:57:07 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-8e2534e6-ce85-4131-85ad-a052f1d825b6 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:57:07 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-8e2534e6-ce85-4131-85ad-a052f1d825b6 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:57:07 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-8e2534e6-ce85-4131-85ad-a052f1d825b6 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:57:07 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-8e2534e6-ce85-4131-85ad-a052f1d825b6 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:57:07 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-8e2534e6-ce85-4131-85ad-a052f1d825b6 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:57:08 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-8e2534e6-ce85-4131-85ad-a052f1d825b6 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8683d0564d7c475c9d26f897e0239640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94be4fa38d44fe84c03b02b09bab0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:57:08 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-8e2534e6-ce85-4131-85ad-a052f1d825b6 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c330e74-9939-422b-88f6-1958857b6c41" status: 200 len: 1501 microversion: 2.1 time: 0.377297 Apr 19 14:57:08 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 94/284] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:57:07 2023] GET /compute/v2.1/servers/9c330e74-9939-422b-88f6-1958857b6c41 => generated 1501 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:57:12 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-1ac73b5e-b68c-42c4-909a-097da2e7f3c9 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:57:12 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-1ac73b5e-b68c-42c4-909a-097da2e7f3c9 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] [instance: 9fee43ad-330a-45d7-9374-07feefcf9e14] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:57:12 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell0:SELECT=2 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:57:12 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell0:SELECT=6 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:57:12 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:57:12 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:57:12 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-1ac73b5e-b68c-42c4-909a-097da2e7f3c9 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:57:12 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-1ac73b5e-b68c-42c4-909a-097da2e7f3c9 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:57:12 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-1ac73b5e-b68c-42c4-909a-097da2e7f3c9 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:57:12 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-1ac73b5e-b68c-42c4-909a-097da2e7f3c9 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:57:12 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-1ac73b5e-b68c-42c4-909a-097da2e7f3c9 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:57:12 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-1ac73b5e-b68c-42c4-909a-097da2e7f3c9 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:57:12 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-1ac73b5e-b68c-42c4-909a-097da2e7f3c9 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aab0b2e3424d80852e588323f187bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dbf312f7154ce1ae7fc1403947d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:57:12 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-1ac73b5e-b68c-42c4-909a-097da2e7f3c9 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9fee43ad-330a-45d7-9374-07feefcf9e14" status: 200 len: 1658 microversion: 2.1 time: 0.274268 Apr 19 14:57:12 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 97/285] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:57:12 2023] GET /compute/v2.1/servers/9fee43ad-330a-45d7-9374-07feefcf9e14 => generated 1658 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:57:21 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-4fa33079-b635-484f-8583-0e523e6fdf5f tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1895860187", "imageRef": "283dcfe8-75fd-4917-902e-1b940387187c", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "283dcfe8-75fd-4917-902e-1b940387187c", "destination_type": "volume"}], "networks": [{"uuid": "773ad771-04cd-4587-bc7e-10971f78fa84"}]}} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:57:21 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell0:SELECT=6 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:57:21 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:57:21 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell1:SELECT=4 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:57:21 user devstack@n-api.service[61253]: DEBUG nova.network.neutron [None req-4fa33079-b635-484f-8583-0e523e6fdf5f tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] validate_networks() for [('773ad771-04cd-4587-bc7e-10971f78fa84', None, None, None, None, None)] {{(pid=61253) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 14:57:22 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-4fa33079-b635-484f-8583-0e523e6fdf5f tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Flavor limits 0:0:0 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 14:57:22 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-4fa33079-b635-484f-8583-0e523e6fdf5f tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Image limits 0:0:0 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 14:57:22 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-4fa33079-b635-484f-8583-0e523e6fdf5f tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Flavor pref 0:0:0 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 14:57:22 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-4fa33079-b635-484f-8583-0e523e6fdf5f tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Image pref 0:0:0 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 14:57:22 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-4fa33079-b635-484f-8583-0e523e6fdf5f tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 14:57:22 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-4fa33079-b635-484f-8583-0e523e6fdf5f tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:57:22 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-4fa33079-b635-484f-8583-0e523e6fdf5f tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:57:22 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-4fa33079-b635-484f-8583-0e523e6fdf5f tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:57:22 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-4fa33079-b635-484f-8583-0e523e6fdf5f tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:57:22 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-4fa33079-b635-484f-8583-0e523e6fdf5f tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:57:22 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-4fa33079-b635-484f-8583-0e523e6fdf5f tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:57:22 user devstack@n-api.service[61253]: DEBUG nova.quota [None req-4fa33079-b635-484f-8583-0e523e6fdf5f tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Getting quotas for project b1bc7474b840449da88a8f420316ecfb. Resources: {'ram', 'instances', 'cores'} {{(pid=61253) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:57:22 user devstack@n-api.service[61253]: DEBUG nova.quota [None req-4fa33079-b635-484f-8583-0e523e6fdf5f tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Getting quotas for user b33dd700a9314ab9a70428a3455a571c and project b1bc7474b840449da88a8f420316ecfb. Resources: {'ram', 'instances', 'cores'} {{(pid=61253) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:57:22 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-4fa33079-b635-484f-8583-0e523e6fdf5f tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Going to run 1 instances... {{(pid=61253) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 14:57:22 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-4fa33079-b635-484f-8583-0e523e6fdf5f tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] [instance: eb4336f9-1d61-4fee-83ac-1c6e70640ad7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='283dcfe8-75fd-4917-902e-1b940387187c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61253) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 14:57:22 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-4fa33079-b635-484f-8583-0e523e6fdf5f tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.819204 Apr 19 14:57:22 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 95/286] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 19 14:57:21 2023] POST /compute/v2.1/servers => generated 378 bytes in 821 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 19 14:57:22 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-8a5282b7-6830-4a55-8122-79ed2561aece tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:57:22 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-8a5282b7-6830-4a55-8122-79ed2561aece tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] [instance: eb4336f9-1d61-4fee-83ac-1c6e70640ad7] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:57:22 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_api:SELECT=2 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:57:22 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell1:SELECT=6 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:57:22 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-8a5282b7-6830-4a55-8122-79ed2561aece tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33dd700a9314ab9a70428a3455a571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bc7474b840449da88a8f420316ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:57:22 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-8a5282b7-6830-4a55-8122-79ed2561aece tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b33dd700a9314ab9a70428a3455a571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bc7474b840449da88a8f420316ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:57:22 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-8a5282b7-6830-4a55-8122-79ed2561aece tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b33dd700a9314ab9a70428a3455a571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bc7474b840449da88a8f420316ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:57:22 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-8a5282b7-6830-4a55-8122-79ed2561aece tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb4336f9-1d61-4fee-83ac-1c6e70640ad7" status: 200 len: 1395 microversion: 2.87 time: 0.089385 Apr 19 14:57:22 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 95/287] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 14:57:22 2023] GET /compute/v2.1/servers/eb4336f9-1d61-4fee-83ac-1c6e70640ad7 => generated 1395 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 14:57:25 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-f570c6f7-0f65-4767-924b-26a46b2aff5f req-2c1ccf56-1621-4e87-a75b-0a1784f95f56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb4336f9-1d61-4fee-83ac-1c6e70640ad7", "tag": "902e6ab2-6889-4023-bb87-15e8968f209a"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:57:25 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_api:SELECT=2 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:57:25 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell1:SELECT=6 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:57:25 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-f570c6f7-0f65-4767-924b-26a46b2aff5f req-2c1ccf56-1621-4e87-a75b-0a1784f95f56 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:57:25 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-f570c6f7-0f65-4767-924b-26a46b2aff5f req-2c1ccf56-1621-4e87-a75b-0a1784f95f56 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:57:25 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-f570c6f7-0f65-4767-924b-26a46b2aff5f req-2c1ccf56-1621-4e87-a75b-0a1784f95f56 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:57:25 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-f570c6f7-0f65-4767-924b-26a46b2aff5f req-2c1ccf56-1621-4e87-a75b-0a1784f95f56 service nova] Creating event network-changed:902e6ab2-6889-4023-bb87-15e8968f209a for instance eb4336f9-1d61-4fee-83ac-1c6e70640ad7 on user Apr 19 14:57:25 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [req-f570c6f7-0f65-4767-924b-26a46b2aff5f req-2c1ccf56-1621-4e87-a75b-0a1784f95f56 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034029 Apr 19 14:57:25 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 98/288] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:57:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:57:30 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [req-23015c9f-b438-405d-afa3-e76a3b6df00f req-802128c5-9cbb-40c3-81e5-97cae544ae12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb4336f9-1d61-4fee-83ac-1c6e70640ad7", "name": "network-vif-deleted", "tag": "902e6ab2-6889-4023-bb87-15e8968f209a"}]} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:57:30 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-23015c9f-b438-405d-afa3-e76a3b6df00f req-802128c5-9cbb-40c3-81e5-97cae544ae12 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:57:30 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-23015c9f-b438-405d-afa3-e76a3b6df00f req-802128c5-9cbb-40c3-81e5-97cae544ae12 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:57:30 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-23015c9f-b438-405d-afa3-e76a3b6df00f req-802128c5-9cbb-40c3-81e5-97cae544ae12 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:57:30 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.compute.server_external_events [req-23015c9f-b438-405d-afa3-e76a3b6df00f req-802128c5-9cbb-40c3-81e5-97cae544ae12 service nova] Unable to find a host for instance eb4336f9-1d61-4fee-83ac-1c6e70640ad7. Dropping event network-vif-deleted {{(pid=61253) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 19 14:57:30 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [req-23015c9f-b438-405d-afa3-e76a3b6df00f req-802128c5-9cbb-40c3-81e5-97cae544ae12 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.027212 Apr 19 14:57:30 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 96/289] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:57:30 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 19 14:57:33 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-2e7b019f-49e0-492d-8bed-52e680ea8982 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:57:33 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-2e7b019f-49e0-492d-8bed-52e680ea8982 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] [instance: 3478c35c-c27b-4480-ad89-4b9cd7ebeb40] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:57:33 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell0:SELECT=2 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:57:33 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_api:SELECT=6 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:57:33 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-2e7b019f-49e0-492d-8bed-52e680ea8982 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:57:33 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-2e7b019f-49e0-492d-8bed-52e680ea8982 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:57:33 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-2e7b019f-49e0-492d-8bed-52e680ea8982 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:57:33 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-2e7b019f-49e0-492d-8bed-52e680ea8982 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:57:33 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-2e7b019f-49e0-492d-8bed-52e680ea8982 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:57:33 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-2e7b019f-49e0-492d-8bed-52e680ea8982 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:57:33 user devstack@n-api.service[61254]: INFO nova.api.openstack.wsgi [None req-2e7b019f-49e0-492d-8bed-52e680ea8982 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] HTTP exception thrown: Instance 3478c35c-c27b-4480-ad89-4b9cd7ebeb40 could not be found. Apr 19 14:57:33 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-2e7b019f-49e0-492d-8bed-52e680ea8982 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Request method failure captured: Apr 19 14:57:33 user devstack@n-api.service[61254]: request: GET /compute/v2.1/servers/3478c35c-c27b-4480-ad89-4b9cd7ebeb40 HTTP/1.1 Apr 19 14:57:33 user devstack@n-api.service[61254]: Accept: application/json Apr 19 14:57:33 user devstack@n-api.service[61254]: Accept-Encoding: identity Apr 19 14:57:33 user devstack@n-api.service[61254]: Connection: close Apr 19 14:57:33 user devstack@n-api.service[61254]: Content-Length: 0 Apr 19 14:57:33 user devstack@n-api.service[61254]: Content-Type: application/json Apr 19 14:57:33 user devstack@n-api.service[61254]: Host: 10.0.0.210 Apr 19 14:57:33 user devstack@n-api.service[61254]: Openstack-System-Scope: None Apr 19 14:57:33 user devstack@n-api.service[61254]: User-Agent: python-urllib3/1.26.15 Apr 19 14:57:33 user devstack@n-api.service[61254]: X-Auth-Token: gAAAAABkQACxmegrNJiWVT35GxEagPyQ4xQ5EFPOgXNstcz_xzkPFhG6oC7nb9e4tGtZSpXZ1UiQE2brJZKAQpDrcU0fggbuRHwlOEcX_G8j8BHmJp3x6QE68GgMLQZt_XfokputrzZTNm9jjXtzXSq0NU3dlpaqf-KMdGGF2XBoFAFMeKZfDKM Apr 19 14:57:33 user devstack@n-api.service[61254]: X-Domain-Id: None Apr 19 14:57:33 user devstack@n-api.service[61254]: X-Domain-Name: None Apr 19 14:57:33 user devstack@n-api.service[61254]: X-Identity-Status: Confirmed Apr 19 14:57:33 user devstack@n-api.service[61254]: X-Is-Admin-Project: True Apr 19 14:57:33 user devstack@n-api.service[61254]: X-Project-Domain-Id: default Apr 19 14:57:33 user devstack@n-api.service[61254]: X-Project-Domain-Name: Default Apr 19 14:57:33 user devstack@n-api.service[61254]: X-Project-Id: 3c121e3e3fa440d8a2e1c3e42975a9a1 Apr 19 14:57:33 user devstack@n-api.service[61254]: X-Project-Name: tempest-TestMinimumBasicScenario-107520977 Apr 19 14:57:33 user devstack@n-api.service[61254]: X-Role: member,reader Apr 19 14:57:33 user devstack@n-api.service[61254]: X-Roles: member,reader Apr 19 14:57:33 user devstack@n-api.service[61254]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3c121e3e3fa440d8a2e1c3e42975a9a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3c121e3e3fa440d8a2e1c3e42975a9a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3c121e3e3fa440d8a2e1c3e42975a9a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 14:57:33 user devstack@n-api.service[61254]: X-Tenant: tempest-TestMinimumBasicScenario-107520977 Apr 19 14:57:33 user devstack@n-api.service[61254]: X-Tenant-Id: 3c121e3e3fa440d8a2e1c3e42975a9a1 Apr 19 14:57:33 user devstack@n-api.service[61254]: X-Tenant-Name: tempest-TestMinimumBasicScenario-107520977 Apr 19 14:57:33 user devstack@n-api.service[61254]: X-User: tempest-TestMinimumBasicScenario-107520977-project-member Apr 19 14:57:33 user devstack@n-api.service[61254]: X-User-Domain-Id: default Apr 19 14:57:33 user devstack@n-api.service[61254]: X-User-Domain-Name: Default Apr 19 14:57:33 user devstack@n-api.service[61254]: X-User-Id: 7e2985fabe974b80a37af599e28c8fbb Apr 19 14:57:33 user devstack@n-api.service[61254]: X-User-Name: tempest-TestMinimumBasicScenario-107520977-project-member Apr 19 14:57:33 user devstack@n-api.service[61254]: method: > Apr 19 14:57:33 user devstack@n-api.service[61254]: exception: Instance 3478c35c-c27b-4480-ad89-4b9cd7ebeb40 could not be found. Apr 19 14:57:33 user devstack@n-api.service[61254]: action_args: {'id': '3478c35c-c27b-4480-ad89-4b9cd7ebeb40'} Apr 19 14:57:33 user devstack@n-api.service[61254]: {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:57:33 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:57:33 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:57:33 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:57:33 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:57:33 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:57:33 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:57:33 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:57:33 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:57:33 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:57:33 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3478c35c-c27b-4480-ad89-4b9cd7ebeb40 could not be found. Apr 19 14:57:33 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:57:33 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:57:33 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:57:33 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:57:33 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:57:33 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:57:33 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:57:33 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:57:33 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:57:33 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:57:33 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:57:33 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:57:33 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:57:33 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:57:33 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:57:33 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:57:33 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3478c35c-c27b-4480-ad89-4b9cd7ebeb40 could not be found. Apr 19 14:57:33 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:57:33 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:57:33 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:57:33 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:57:33 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:57:33 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:57:33 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:57:33 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:57:33 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3478c35c-c27b-4480-ad89-4b9cd7ebeb40 could not be found. Apr 19 14:57:33 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:57:33 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-2e7b019f-49e0-492d-8bed-52e680ea8982 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Returning 404 to user: Instance 3478c35c-c27b-4480-ad89-4b9cd7ebeb40 could not be found. {{(pid=61254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:57:33 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-2e7b019f-49e0-492d-8bed-52e680ea8982 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3478c35c-c27b-4480-ad89-4b9cd7ebeb40" status: 404 len: 111 microversion: 2.1 time: 0.030367 Apr 19 14:57:33 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 96/290] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:57:33 2023] GET /compute/v2.1/servers/3478c35c-c27b-4480-ad89-4b9cd7ebeb40 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:57:33 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-4eca0b9f-1c93-4959-8120-e25af2adbcc0 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Calling method '.version_select at 0x7f3cfa9c2830>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:57:33 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-4eca0b9f-1c93-4959-8120-e25af2adbcc0 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1461142894" status: 202 len: 0 microversion: 2.1 time: 0.022594 Apr 19 14:57:33 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 99/291] 10.0.0.210 () {62 vars in 1349 bytes} [Wed Apr 19 14:57:33 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1461142894 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 19 14:57:35 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell0:SELECT=2 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:57:35 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell0:SELECT=6 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:57:35 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-c01c56d2-2ae7-427d-af23-4e6571ec7e6c tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Action: 'create', calling method: .version_select at 0x7f3cfa8463b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1582209514", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhYCkeF9sQtXUq2oZUUX+UkiGCj/iJYQvjCC4y5JrTjMy4s6dI6EDqERvWfvBVTFCrVwfV4Ij23vI4fWcW9ioAugAYlI2W/cQzxvAUARlZr6ySYT45Pdnt4NieCUhEfxQ=="}} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:57:35 user devstack@n-api.service[61253]: DEBUG nova.quota [None req-c01c56d2-2ae7-427d-af23-4e6571ec7e6c tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Getting quotas for project 3c121e3e3fa440d8a2e1c3e42975a9a1. Resources: {'key_pairs'} {{(pid=61253) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:57:35 user devstack@n-api.service[61253]: DEBUG nova.quota [None req-c01c56d2-2ae7-427d-af23-4e6571ec7e6c tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Getting quotas for user 7e2985fabe974b80a37af599e28c8fbb and project 3c121e3e3fa440d8a2e1c3e42975a9a1. Resources: {'key_pairs'} {{(pid=61253) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:57:35 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-c01c56d2-2ae7-427d-af23-4e6571ec7e6c tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.058532 Apr 19 14:57:35 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 97/292] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 14:57:35 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:57:35 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-f73ad6b7-ce4d-4404-b757-e0519f9f175b tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-113121699", "imageRef": "84ac9939-2c50-401b-858b-622d89ec6172", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1582209514", "networks": [{"uuid": "e3b4815b-7cb5-4343-9337-5dde5a6c5fc1"}]}} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:57:35 user devstack@n-api.service[61254]: DEBUG nova.network.neutron [None req-f73ad6b7-ce4d-4404-b757-e0519f9f175b tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] validate_networks() for [('e3b4815b-7cb5-4343-9337-5dde5a6c5fc1', None, None, None, None, None)] {{(pid=61254) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 14:57:36 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-f73ad6b7-ce4d-4404-b757-e0519f9f175b tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Flavor limits 0:0:0 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 14:57:36 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-f73ad6b7-ce4d-4404-b757-e0519f9f175b tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Image limits 0:0:0 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 14:57:36 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-f73ad6b7-ce4d-4404-b757-e0519f9f175b tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Flavor pref 0:0:0 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 14:57:36 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-f73ad6b7-ce4d-4404-b757-e0519f9f175b tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Image pref 0:0:0 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 14:57:36 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-f73ad6b7-ce4d-4404-b757-e0519f9f175b tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 14:57:36 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-f73ad6b7-ce4d-4404-b757-e0519f9f175b tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:57:36 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-f73ad6b7-ce4d-4404-b757-e0519f9f175b tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:57:36 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-f73ad6b7-ce4d-4404-b757-e0519f9f175b tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:57:36 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-f73ad6b7-ce4d-4404-b757-e0519f9f175b tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:57:36 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-f73ad6b7-ce4d-4404-b757-e0519f9f175b tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:57:36 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-f73ad6b7-ce4d-4404-b757-e0519f9f175b tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:57:36 user devstack@n-api.service[61254]: DEBUG nova.quota [None req-f73ad6b7-ce4d-4404-b757-e0519f9f175b tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Getting quotas for project 3c121e3e3fa440d8a2e1c3e42975a9a1. Resources: {'ram', 'instances', 'cores'} {{(pid=61254) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:57:36 user devstack@n-api.service[61254]: DEBUG nova.quota [None req-f73ad6b7-ce4d-4404-b757-e0519f9f175b tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Getting quotas for user 7e2985fabe974b80a37af599e28c8fbb and project 3c121e3e3fa440d8a2e1c3e42975a9a1. Resources: {'ram', 'instances', 'cores'} {{(pid=61254) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:57:36 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-f73ad6b7-ce4d-4404-b757-e0519f9f175b tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Going to run 1 instances... {{(pid=61254) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 14:57:36 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-f73ad6b7-ce4d-4404-b757-e0519f9f175b tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] [instance: 4dee286e-96ba-4b45-a572-d1e098807b8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='84ac9939-2c50-401b-858b-622d89ec6172',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61254) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 14:57:36 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-f73ad6b7-ce4d-4404-b757-e0519f9f175b tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.179448 Apr 19 14:57:36 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 97/293] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 14:57:35 2023] POST /compute/v2.1/servers => generated 378 bytes in 1183 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 14:57:36 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell1:SELECT=2 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:57:36 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-0a634bc0-58c6-4d7c-83c4-15129cc35dca tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:57:36 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-0a634bc0-58c6-4d7c-83c4-15129cc35dca tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] [instance: 4dee286e-96ba-4b45-a572-d1e098807b8a] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:57:37 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-0a634bc0-58c6-4d7c-83c4-15129cc35dca tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2985fabe974b80a37af599e28c8fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c121e3e3fa440d8a2e1c3e42975a9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:57:37 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-0a634bc0-58c6-4d7c-83c4-15129cc35dca tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4dee286e-96ba-4b45-a572-d1e098807b8a" status: 200 len: 1252 microversion: 2.1 time: 0.078187 Apr 19 14:57:37 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 100/294] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:57:36 2023] GET /compute/v2.1/servers/4dee286e-96ba-4b45-a572-d1e098807b8a => generated 1252 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:57:37 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-7d0e649c-1c5d-48c9-b5eb-1017bd62a763 tempest-TestStampPattern-759650686 tempest-TestStampPattern-759650686-project-member] Action: 'create', calling method: .version_select at 0x7f3cfa8b4310>, body: {"keypair": {"name": "tempest-TestStampPattern-1801292474", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaPKfi6Rkd86uygX9fafMYlfyikh8Ox7ar48M+iFJuSG5lgw136xjw10dx8pSLi+NvB0lLXQ2yeAP2CDUX7tlvGQXvZmkkdi9vLk1cTfPV34f7rczhySqMSe1xolwiOeA=="}} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:57:37 user devstack@n-api.service[61253]: DEBUG nova.quota [None req-7d0e649c-1c5d-48c9-b5eb-1017bd62a763 tempest-TestStampPattern-759650686 tempest-TestStampPattern-759650686-project-member] Getting quotas for project 5f4c37fb1cfb441bb45a025c748cd8e8. Resources: {'key_pairs'} {{(pid=61253) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:57:37 user devstack@n-api.service[61253]: DEBUG nova.quota [None req-7d0e649c-1c5d-48c9-b5eb-1017bd62a763 tempest-TestStampPattern-759650686 tempest-TestStampPattern-759650686-project-member] Getting quotas for user 9989d0ee711d4c1682fb1a2aa361740d and project 5f4c37fb1cfb441bb45a025c748cd8e8. Resources: {'key_pairs'} {{(pid=61253) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:57:37 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-7d0e649c-1c5d-48c9-b5eb-1017bd62a763 tempest-TestStampPattern-759650686 tempest-TestStampPattern-759650686-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.282700 Apr 19 14:57:37 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 98/295] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 14:57:37 2023] POST /compute/v2.1/os-keypairs => generated 395 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:57:39 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [req-fd3c90d5-9595-4684-83c6-9e7d15835055 req-efd1cd19-1e33-4976-ab97-343db6164f5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dee286e-96ba-4b45-a572-d1e098807b8a", "tag": "c6c7ca7c-65c4-41ba-825e-34e20fa420b8"}]} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:57:39 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-fd3c90d5-9595-4684-83c6-9e7d15835055 req-efd1cd19-1e33-4976-ab97-343db6164f5d service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:57:39 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-fd3c90d5-9595-4684-83c6-9e7d15835055 req-efd1cd19-1e33-4976-ab97-343db6164f5d service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:57:39 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-fd3c90d5-9595-4684-83c6-9e7d15835055 req-efd1cd19-1e33-4976-ab97-343db6164f5d service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:57:39 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-fd3c90d5-9595-4684-83c6-9e7d15835055 req-efd1cd19-1e33-4976-ab97-343db6164f5d service nova] Creating event network-changed:c6c7ca7c-65c4-41ba-825e-34e20fa420b8 for instance 4dee286e-96ba-4b45-a572-d1e098807b8a on user Apr 19 14:57:39 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [req-fd3c90d5-9595-4684-83c6-9e7d15835055 req-efd1cd19-1e33-4976-ab97-343db6164f5d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036711 Apr 19 14:57:39 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 98/296] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:57:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:57:40 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-477e8668-96f8-44d5-948f-a423bbb77730 tempest-TestStampPattern-759650686 tempest-TestStampPattern-759650686-project-member] Calling method '.version_select at 0x7f3cfa9c0e50>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:57:40 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-477e8668-96f8-44d5-948f-a423bbb77730 tempest-TestStampPattern-759650686 tempest-TestStampPattern-759650686-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1801292474" status: 202 len: 0 microversion: 2.1 time: 0.027647 Apr 19 14:57:40 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 101/297] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 19 14:57:40 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1801292474 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 14:57:41 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell1:SELECT=4 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:57:41 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-33e44ebf-ab4c-47b3-8749-83c5dcd42960 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:57:41 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-33e44ebf-ab4c-47b3-8749-83c5dcd42960 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] [instance: 25a11d52-4c81-46e5-925d-ba88df6dfdff] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:57:41 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-33e44ebf-ab4c-47b3-8749-83c5dcd42960 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:57:41 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-33e44ebf-ab4c-47b3-8749-83c5dcd42960 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:57:41 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-33e44ebf-ab4c-47b3-8749-83c5dcd42960 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:57:41 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-33e44ebf-ab4c-47b3-8749-83c5dcd42960 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:57:41 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-33e44ebf-ab4c-47b3-8749-83c5dcd42960 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:57:41 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-33e44ebf-ab4c-47b3-8749-83c5dcd42960 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:57:41 user devstack@n-api.service[61253]: DEBUG nova.policy [None req-33e44ebf-ab4c-47b3-8749-83c5dcd42960 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b23f0d7300496990e74b2fb4945c15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5079ce8a52417fb2b8b8122bfeaa5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61253) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:57:41 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-33e44ebf-ab4c-47b3-8749-83c5dcd42960 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25a11d52-4c81-46e5-925d-ba88df6dfdff" status: 200 len: 1545 microversion: 2.1 time: 0.369560 Apr 19 14:57:41 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 99/298] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:57:41 2023] GET /compute/v2.1/servers/25a11d52-4c81-46e5-925d-ba88df6dfdff => generated 1545 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:57:41 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [req-d0011a63-950c-49c4-8022-1f6fd915d407 req-3ad670d0-dcbd-4460-91e9-92fc25323afa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dee286e-96ba-4b45-a572-d1e098807b8a", "name": "network-vif-plugged", "status": "completed", "tag": "c6c7ca7c-65c4-41ba-825e-34e20fa420b8"}]} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:57:41 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-d0011a63-950c-49c4-8022-1f6fd915d407 req-3ad670d0-dcbd-4460-91e9-92fc25323afa service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:57:41 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-d0011a63-950c-49c4-8022-1f6fd915d407 req-3ad670d0-dcbd-4460-91e9-92fc25323afa service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:57:41 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-d0011a63-950c-49c4-8022-1f6fd915d407 req-3ad670d0-dcbd-4460-91e9-92fc25323afa service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:57:41 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-d0011a63-950c-49c4-8022-1f6fd915d407 req-3ad670d0-dcbd-4460-91e9-92fc25323afa service nova] Creating event network-vif-plugged:c6c7ca7c-65c4-41ba-825e-34e20fa420b8 for instance 4dee286e-96ba-4b45-a572-d1e098807b8a on user Apr 19 14:57:41 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [req-d0011a63-950c-49c4-8022-1f6fd915d407 req-3ad670d0-dcbd-4460-91e9-92fc25323afa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041046 Apr 19 14:57:41 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 99/299] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:57:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:57:43 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-24f22dce-1bb4-4423-9d7c-8e3e62f8e6ea req-e48a107a-bca9-4f52-a01c-6cf20a31c392 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dee286e-96ba-4b45-a572-d1e098807b8a", "name": "network-vif-plugged", "status": "completed", "tag": "c6c7ca7c-65c4-41ba-825e-34e20fa420b8"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:57:43 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-24f22dce-1bb4-4423-9d7c-8e3e62f8e6ea req-e48a107a-bca9-4f52-a01c-6cf20a31c392 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:57:43 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-24f22dce-1bb4-4423-9d7c-8e3e62f8e6ea req-e48a107a-bca9-4f52-a01c-6cf20a31c392 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:57:43 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-24f22dce-1bb4-4423-9d7c-8e3e62f8e6ea req-e48a107a-bca9-4f52-a01c-6cf20a31c392 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:57:43 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-24f22dce-1bb4-4423-9d7c-8e3e62f8e6ea req-e48a107a-bca9-4f52-a01c-6cf20a31c392 service nova] Creating event network-vif-plugged:c6c7ca7c-65c4-41ba-825e-34e20fa420b8 for instance 4dee286e-96ba-4b45-a572-d1e098807b8a on user Apr 19 14:57:43 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [req-24f22dce-1bb4-4423-9d7c-8e3e62f8e6ea req-e48a107a-bca9-4f52-a01c-6cf20a31c392 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032089 Apr 19 14:57:43 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 102/300] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:57:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:57:50 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-2eb8883d-262f-4aaf-9c75-f02ef918039e tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:57:50 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-2eb8883d-262f-4aaf-9c75-f02ef918039e tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] [instance: dbf728fc-fcd9-4819-8bae-3816c3fde252] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:57:50 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell0:SELECT=8 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:57:50 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-2eb8883d-262f-4aaf-9c75-f02ef918039e tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:57:50 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-2eb8883d-262f-4aaf-9c75-f02ef918039e tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:57:50 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-2eb8883d-262f-4aaf-9c75-f02ef918039e tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:57:50 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-2eb8883d-262f-4aaf-9c75-f02ef918039e tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:57:50 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-2eb8883d-262f-4aaf-9c75-f02ef918039e tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:57:50 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-2eb8883d-262f-4aaf-9c75-f02ef918039e tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:57:51 user devstack@n-api.service[61253]: DEBUG nova.policy [None req-2eb8883d-262f-4aaf-9c75-f02ef918039e tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2057a3280134a99bc9a97c66ad51220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7a6d6040c4475b034b1f33f97a491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61253) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:57:51 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-2eb8883d-262f-4aaf-9c75-f02ef918039e tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dbf728fc-fcd9-4819-8bae-3816c3fde252" status: 200 len: 1567 microversion: 2.1 time: 0.622010 Apr 19 14:57:51 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 100/301] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:57:50 2023] GET /compute/v2.1/servers/dbf728fc-fcd9-4819-8bae-3816c3fde252 => generated 1567 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:57:52 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-1dfdd859-e21d-4524-b30e-a3d350ee57a0 tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:57:52 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-1dfdd859-e21d-4524-b30e-a3d350ee57a0 tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] [instance: dbf728fc-fcd9-4819-8bae-3816c3fde252] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:57:52 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell0:SELECT=2 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:57:52 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell0:SELECT=6 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:57:52 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:57:52 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell1:SELECT=8 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:57:52 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-1dfdd859-e21d-4524-b30e-a3d350ee57a0 tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:57:52 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-1dfdd859-e21d-4524-b30e-a3d350ee57a0 tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:57:52 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-1dfdd859-e21d-4524-b30e-a3d350ee57a0 tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:57:52 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-1dfdd859-e21d-4524-b30e-a3d350ee57a0 tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:57:52 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-1dfdd859-e21d-4524-b30e-a3d350ee57a0 tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:57:52 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-1dfdd859-e21d-4524-b30e-a3d350ee57a0 tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:57:52 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-1dfdd859-e21d-4524-b30e-a3d350ee57a0 tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] [instance: dbf728fc-fcd9-4819-8bae-3816c3fde252] Going to try to terminate instance {{(pid=61254) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 14:57:52 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-1dfdd859-e21d-4524-b30e-a3d350ee57a0 tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dbf728fc-fcd9-4819-8bae-3816c3fde252" status: 204 len: 0 microversion: 2.1 time: 0.117078 Apr 19 14:57:52 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 100/302] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 14:57:52 2023] DELETE /compute/v2.1/servers/dbf728fc-fcd9-4819-8bae-3816c3fde252 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 14:57:52 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell0:SELECT=2 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:57:52 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-d446c5eb-4341-4575-9b7e-9744096abe5a tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:57:52 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-d446c5eb-4341-4575-9b7e-9744096abe5a tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] [instance: dbf728fc-fcd9-4819-8bae-3816c3fde252] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:57:52 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-d446c5eb-4341-4575-9b7e-9744096abe5a tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:57:52 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-d446c5eb-4341-4575-9b7e-9744096abe5a tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:57:52 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-d446c5eb-4341-4575-9b7e-9744096abe5a tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:57:52 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-d446c5eb-4341-4575-9b7e-9744096abe5a tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:57:52 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-d446c5eb-4341-4575-9b7e-9744096abe5a tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:57:52 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-d446c5eb-4341-4575-9b7e-9744096abe5a tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:57:53 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [req-6731e3d6-4f5d-41c2-bd7d-9d66e0c1596e req-a614c6a7-3bf9-4c2d-a6a2-4c4356664a0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbf728fc-fcd9-4819-8bae-3816c3fde252", "name": "network-vif-unplugged", "status": "completed", "tag": "ecb65694-0a07-4e10-8848-1d03da8d683a"}]} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:57:53 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=5 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:57:53 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-6731e3d6-4f5d-41c2-bd7d-9d66e0c1596e req-a614c6a7-3bf9-4c2d-a6a2-4c4356664a0d service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:57:53 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-6731e3d6-4f5d-41c2-bd7d-9d66e0c1596e req-a614c6a7-3bf9-4c2d-a6a2-4c4356664a0d service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:57:53 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-6731e3d6-4f5d-41c2-bd7d-9d66e0c1596e req-a614c6a7-3bf9-4c2d-a6a2-4c4356664a0d service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:57:53 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-6731e3d6-4f5d-41c2-bd7d-9d66e0c1596e req-a614c6a7-3bf9-4c2d-a6a2-4c4356664a0d service nova] Creating event network-vif-unplugged:ecb65694-0a07-4e10-8848-1d03da8d683a for instance dbf728fc-fcd9-4819-8bae-3816c3fde252 on user Apr 19 14:57:53 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-d446c5eb-4341-4575-9b7e-9744096abe5a tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2057a3280134a99bc9a97c66ad51220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7a6d6040c4475b034b1f33f97a491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:57:53 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [req-6731e3d6-4f5d-41c2-bd7d-9d66e0c1596e req-a614c6a7-3bf9-4c2d-a6a2-4c4356664a0d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035035 Apr 19 14:57:53 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 101/303] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:57:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:57:53 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-d446c5eb-4341-4575-9b7e-9744096abe5a tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dbf728fc-fcd9-4819-8bae-3816c3fde252" status: 200 len: 1573 microversion: 2.1 time: 0.354944 Apr 19 14:57:53 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 103/304] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:57:52 2023] GET /compute/v2.1/servers/dbf728fc-fcd9-4819-8bae-3816c3fde252 => generated 1573 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 14:57:54 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [req-52eaf32b-ffad-48eb-b0b4-99d7a185011e req-92008276-7ae9-4403-b4da-a22e3c687d11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbf728fc-fcd9-4819-8bae-3816c3fde252", "name": "network-vif-deleted", "tag": "ecb65694-0a07-4e10-8848-1d03da8d683a"}]} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:57:54 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-52eaf32b-ffad-48eb-b0b4-99d7a185011e req-92008276-7ae9-4403-b4da-a22e3c687d11 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:57:54 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-52eaf32b-ffad-48eb-b0b4-99d7a185011e req-92008276-7ae9-4403-b4da-a22e3c687d11 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:57:54 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-52eaf32b-ffad-48eb-b0b4-99d7a185011e req-92008276-7ae9-4403-b4da-a22e3c687d11 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:57:54 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-52eaf32b-ffad-48eb-b0b4-99d7a185011e req-92008276-7ae9-4403-b4da-a22e3c687d11 service nova] Creating event network-vif-deleted:ecb65694-0a07-4e10-8848-1d03da8d683a for instance dbf728fc-fcd9-4819-8bae-3816c3fde252 on user Apr 19 14:57:54 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [req-52eaf32b-ffad-48eb-b0b4-99d7a185011e req-92008276-7ae9-4403-b4da-a22e3c687d11 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032886 Apr 19 14:57:54 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 101/305] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:57:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 14:57:55 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [req-ed7c0c36-9955-4f7a-b8ff-ced522e6f733 req-7a142f05-076b-4940-825b-9d81feefd44f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbf728fc-fcd9-4819-8bae-3816c3fde252", "name": "network-vif-plugged", "status": "completed", "tag": "ecb65694-0a07-4e10-8848-1d03da8d683a"}]} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:57:55 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-ed7c0c36-9955-4f7a-b8ff-ced522e6f733 req-7a142f05-076b-4940-825b-9d81feefd44f service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:57:55 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-ed7c0c36-9955-4f7a-b8ff-ced522e6f733 req-7a142f05-076b-4940-825b-9d81feefd44f service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:57:55 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-ed7c0c36-9955-4f7a-b8ff-ced522e6f733 req-7a142f05-076b-4940-825b-9d81feefd44f service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:57:55 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-ed7c0c36-9955-4f7a-b8ff-ced522e6f733 req-7a142f05-076b-4940-825b-9d81feefd44f service nova] Creating event network-vif-plugged:ecb65694-0a07-4e10-8848-1d03da8d683a for instance dbf728fc-fcd9-4819-8bae-3816c3fde252 on user Apr 19 14:57:55 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [req-ed7c0c36-9955-4f7a-b8ff-ced522e6f733 req-7a142f05-076b-4940-825b-9d81feefd44f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029577 Apr 19 14:57:55 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 102/306] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:57:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:58:11 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=2 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:58:11 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell1:SELECT=8 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:58:11 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-faa8642e-6066-41a4-81c2-ca5bb9566683 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:58:11 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-faa8642e-6066-41a4-81c2-ca5bb9566683 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] [instance: 6930db7c-e8e0-4d1d-ac99-952827ff1aa9] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:58:11 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-faa8642e-6066-41a4-81c2-ca5bb9566683 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:58:11 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-faa8642e-6066-41a4-81c2-ca5bb9566683 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:58:11 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-faa8642e-6066-41a4-81c2-ca5bb9566683 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:58:11 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-faa8642e-6066-41a4-81c2-ca5bb9566683 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:58:11 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-faa8642e-6066-41a4-81c2-ca5bb9566683 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:58:11 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-faa8642e-6066-41a4-81c2-ca5bb9566683 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:58:11 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-faa8642e-6066-41a4-81c2-ca5bb9566683 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] [instance: 6930db7c-e8e0-4d1d-ac99-952827ff1aa9] Going to try to terminate instance {{(pid=61255) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 14:58:11 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-faa8642e-6066-41a4-81c2-ca5bb9566683 tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6930db7c-e8e0-4d1d-ac99-952827ff1aa9" status: 204 len: 0 microversion: 2.1 time: 0.109977 Apr 19 14:58:11 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 104/307] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 14:58:11 2023] DELETE /compute/v2.1/servers/6930db7c-e8e0-4d1d-ac99-952827ff1aa9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 14:58:11 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:58:11 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:58:11 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-85f5b2e1-de89-4fc4-aced-20986195febd tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:58:11 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-85f5b2e1-de89-4fc4-aced-20986195febd tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] [instance: 6930db7c-e8e0-4d1d-ac99-952827ff1aa9] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:58:11 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-85f5b2e1-de89-4fc4-aced-20986195febd tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:58:11 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-85f5b2e1-de89-4fc4-aced-20986195febd tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:58:11 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-85f5b2e1-de89-4fc4-aced-20986195febd tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:58:11 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-85f5b2e1-de89-4fc4-aced-20986195febd tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:58:11 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-85f5b2e1-de89-4fc4-aced-20986195febd tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:58:11 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-85f5b2e1-de89-4fc4-aced-20986195febd tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:58:11 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [req-53670702-25c6-4633-bb67-8f070666b636 req-5c60bcf6-c4b1-4bfe-a935-29cf80b36c51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6930db7c-e8e0-4d1d-ac99-952827ff1aa9", "name": "network-vif-unplugged", "status": "completed", "tag": "a9320570-bc89-45b1-a97c-3da53f2e4b70"}]} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:58:11 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_api:SELECT=3 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:58:11 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell1:SELECT=16 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:58:11 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-85f5b2e1-de89-4fc4-aced-20986195febd tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8683d0564d7c475c9d26f897e0239640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94be4fa38d44fe84c03b02b09bab0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:58:11 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-53670702-25c6-4633-bb67-8f070666b636 req-5c60bcf6-c4b1-4bfe-a935-29cf80b36c51 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:58:11 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-53670702-25c6-4633-bb67-8f070666b636 req-5c60bcf6-c4b1-4bfe-a935-29cf80b36c51 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:58:11 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-53670702-25c6-4633-bb67-8f070666b636 req-5c60bcf6-c4b1-4bfe-a935-29cf80b36c51 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:58:11 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-85f5b2e1-de89-4fc4-aced-20986195febd tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6930db7c-e8e0-4d1d-ac99-952827ff1aa9" status: 200 len: 1495 microversion: 2.1 time: 0.253271 Apr 19 14:58:11 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 102/308] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:58:11 2023] GET /compute/v2.1/servers/6930db7c-e8e0-4d1d-ac99-952827ff1aa9 => generated 1495 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:58:11 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-53670702-25c6-4633-bb67-8f070666b636 req-5c60bcf6-c4b1-4bfe-a935-29cf80b36c51 service nova] Creating event network-vif-unplugged:a9320570-bc89-45b1-a97c-3da53f2e4b70 for instance 6930db7c-e8e0-4d1d-ac99-952827ff1aa9 on user Apr 19 14:58:11 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [req-53670702-25c6-4633-bb67-8f070666b636 req-5c60bcf6-c4b1-4bfe-a935-29cf80b36c51 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049144 Apr 19 14:58:11 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 103/309] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:58:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:58:12 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-dd1f5fcf-8a64-44f8-8436-92cd15ff240d tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:58:12 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-dd1f5fcf-8a64-44f8-8436-92cd15ff240d tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] [instance: 9fee43ad-330a-45d7-9374-07feefcf9e14] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:58:12 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-dd1f5fcf-8a64-44f8-8436-92cd15ff240d tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:58:12 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-dd1f5fcf-8a64-44f8-8436-92cd15ff240d tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:58:12 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-dd1f5fcf-8a64-44f8-8436-92cd15ff240d tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:58:12 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-dd1f5fcf-8a64-44f8-8436-92cd15ff240d tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:58:12 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-dd1f5fcf-8a64-44f8-8436-92cd15ff240d tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:58:12 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-dd1f5fcf-8a64-44f8-8436-92cd15ff240d tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:58:12 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-dd1f5fcf-8a64-44f8-8436-92cd15ff240d tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aab0b2e3424d80852e588323f187bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dbf312f7154ce1ae7fc1403947d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:58:12 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-dd1f5fcf-8a64-44f8-8436-92cd15ff240d tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9fee43ad-330a-45d7-9374-07feefcf9e14" status: 200 len: 1658 microversion: 2.1 time: 0.302012 Apr 19 14:58:12 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 105/310] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:58:12 2023] GET /compute/v2.1/servers/9fee43ad-330a-45d7-9374-07feefcf9e14 => generated 1658 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:58:12 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-acd9b736-cb24-482b-9f08-d4d80b59d862 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:58:12 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-acd9b736-cb24-482b-9f08-d4d80b59d862 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] [instance: 9fee43ad-330a-45d7-9374-07feefcf9e14] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:58:12 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-acd9b736-cb24-482b-9f08-d4d80b59d862 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:58:12 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-acd9b736-cb24-482b-9f08-d4d80b59d862 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:58:12 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-acd9b736-cb24-482b-9f08-d4d80b59d862 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:58:12 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-acd9b736-cb24-482b-9f08-d4d80b59d862 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:58:12 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [req-caf8f062-d10c-4766-874e-36faf8c17783 req-01c89f73-0340-4651-b028-cdadbdce2b19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6930db7c-e8e0-4d1d-ac99-952827ff1aa9", "name": "network-vif-deleted", "tag": "a9320570-bc89-45b1-a97c-3da53f2e4b70"}]} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:58:12 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-acd9b736-cb24-482b-9f08-d4d80b59d862 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:58:12 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-acd9b736-cb24-482b-9f08-d4d80b59d862 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:58:12 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-caf8f062-d10c-4766-874e-36faf8c17783 req-01c89f73-0340-4651-b028-cdadbdce2b19 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:58:12 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-caf8f062-d10c-4766-874e-36faf8c17783 req-01c89f73-0340-4651-b028-cdadbdce2b19 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:58:12 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-caf8f062-d10c-4766-874e-36faf8c17783 req-01c89f73-0340-4651-b028-cdadbdce2b19 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:58:12 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-caf8f062-d10c-4766-874e-36faf8c17783 req-01c89f73-0340-4651-b028-cdadbdce2b19 service nova] Creating event network-vif-deleted:a9320570-bc89-45b1-a97c-3da53f2e4b70 for instance 6930db7c-e8e0-4d1d-ac99-952827ff1aa9 on user Apr 19 14:58:12 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [req-caf8f062-d10c-4766-874e-36faf8c17783 req-01c89f73-0340-4651-b028-cdadbdce2b19 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031161 Apr 19 14:58:12 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 104/311] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:58:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:58:12 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-298da549-be86-4a02-abf3-9c7d19978187 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:58:12 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-298da549-be86-4a02-abf3-9c7d19978187 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] [instance: eb4336f9-1d61-4fee-83ac-1c6e70640ad7] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:58:12 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-298da549-be86-4a02-abf3-9c7d19978187 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:58:12 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-298da549-be86-4a02-abf3-9c7d19978187 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:58:12 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-298da549-be86-4a02-abf3-9c7d19978187 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:58:12 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-298da549-be86-4a02-abf3-9c7d19978187 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:58:12 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-298da549-be86-4a02-abf3-9c7d19978187 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:58:12 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-298da549-be86-4a02-abf3-9c7d19978187 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:58:12 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-acd9b736-cb24-482b-9f08-d4d80b59d862 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aab0b2e3424d80852e588323f187bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dbf312f7154ce1ae7fc1403947d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:58:12 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-acd9b736-cb24-482b-9f08-d4d80b59d862 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9fee43ad-330a-45d7-9374-07feefcf9e14" status: 200 len: 1658 microversion: 2.1 time: 0.213714 Apr 19 14:58:12 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 103/312] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:58:12 2023] GET /compute/v2.1/servers/9fee43ad-330a-45d7-9374-07feefcf9e14 => generated 1658 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:58:12 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-298da549-be86-4a02-abf3-9c7d19978187 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:58:12 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-298da549-be86-4a02-abf3-9c7d19978187 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:58:12 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-298da549-be86-4a02-abf3-9c7d19978187 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:58:12 user devstack@n-api.service[61255]: DEBUG nova.objects.instance [None req-298da549-be86-4a02-abf3-9c7d19978187 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lazy-loading 'fault' on Instance uuid eb4336f9-1d61-4fee-83ac-1c6e70640ad7 {{(pid=61255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 19 14:58:12 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-c459089a-39d9-405b-b457-264fc3850294 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:58:12 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-c459089a-39d9-405b-b457-264fc3850294 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] [instance: 9fee43ad-330a-45d7-9374-07feefcf9e14] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:58:12 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-c459089a-39d9-405b-b457-264fc3850294 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:58:12 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-c459089a-39d9-405b-b457-264fc3850294 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:58:12 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-c459089a-39d9-405b-b457-264fc3850294 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:58:12 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-c459089a-39d9-405b-b457-264fc3850294 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:58:12 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-c459089a-39d9-405b-b457-264fc3850294 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:58:12 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-c459089a-39d9-405b-b457-264fc3850294 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:58:12 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-298da549-be86-4a02-abf3-9c7d19978187 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33dd700a9314ab9a70428a3455a571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bc7474b840449da88a8f420316ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:58:13 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-298da549-be86-4a02-abf3-9c7d19978187 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b33dd700a9314ab9a70428a3455a571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bc7474b840449da88a8f420316ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:58:13 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-298da549-be86-4a02-abf3-9c7d19978187 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b33dd700a9314ab9a70428a3455a571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bc7474b840449da88a8f420316ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:58:13 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-298da549-be86-4a02-abf3-9c7d19978187 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb4336f9-1d61-4fee-83ac-1c6e70640ad7" status: 200 len: 1650 microversion: 2.87 time: 0.109105 Apr 19 14:58:13 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 106/313] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 14:58:12 2023] GET /compute/v2.1/servers/eb4336f9-1d61-4fee-83ac-1c6e70640ad7 => generated 1650 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 14:58:13 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-b9bba1ab-a7ef-4825-bf00-cf11fdf449f4 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:58:13 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-b9bba1ab-a7ef-4825-bf00-cf11fdf449f4 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] [instance: eb4336f9-1d61-4fee-83ac-1c6e70640ad7] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:58:13 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-b9bba1ab-a7ef-4825-bf00-cf11fdf449f4 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:58:13 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-b9bba1ab-a7ef-4825-bf00-cf11fdf449f4 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:58:13 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-b9bba1ab-a7ef-4825-bf00-cf11fdf449f4 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:58:13 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-b9bba1ab-a7ef-4825-bf00-cf11fdf449f4 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:58:13 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-b9bba1ab-a7ef-4825-bf00-cf11fdf449f4 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:58:13 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-b9bba1ab-a7ef-4825-bf00-cf11fdf449f4 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:58:13 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-b9bba1ab-a7ef-4825-bf00-cf11fdf449f4 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] [instance: eb4336f9-1d61-4fee-83ac-1c6e70640ad7] Going to try to terminate instance {{(pid=61254) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 14:58:13 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-b9bba1ab-a7ef-4825-bf00-cf11fdf449f4 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] [instance: eb4336f9-1d61-4fee-83ac-1c6e70640ad7] Doing local delete in cell 294c8cd7-7972-4e5f-a789-800b7d5aa37d(cell1) {{(pid=61254) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 19 14:58:13 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-b9bba1ab-a7ef-4825-bf00-cf11fdf449f4 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:58:13 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-b9bba1ab-a7ef-4825-bf00-cf11fdf449f4 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:58:13 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-b9bba1ab-a7ef-4825-bf00-cf11fdf449f4 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:58:13 user devstack@n-api.service[61254]: WARNING nova.compute.api [None req-b9bba1ab-a7ef-4825-bf00-cf11fdf449f4 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] [instance: eb4336f9-1d61-4fee-83ac-1c6e70640ad7] instance's host None is down, deleting from database Apr 19 14:58:13 user devstack@n-api.service[61254]: DEBUG nova.network.neutron [None req-b9bba1ab-a7ef-4825-bf00-cf11fdf449f4 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] [instance: eb4336f9-1d61-4fee-83ac-1c6e70640ad7] deallocate_for_instance() {{(pid=61254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 19 14:58:13 user devstack@n-api.service[61254]: DEBUG nova.network.neutron [None req-b9bba1ab-a7ef-4825-bf00-cf11fdf449f4 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] [instance: eb4336f9-1d61-4fee-83ac-1c6e70640ad7] Instance cache missing network info. {{(pid=61254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 19 14:58:13 user devstack@n-api.service[61254]: DEBUG nova.network.neutron [None req-b9bba1ab-a7ef-4825-bf00-cf11fdf449f4 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] [instance: eb4336f9-1d61-4fee-83ac-1c6e70640ad7] Updating instance_info_cache with network_info: [] {{(pid=61254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 19 14:58:13 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-b9bba1ab-a7ef-4825-bf00-cf11fdf449f4 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] [instance: eb4336f9-1d61-4fee-83ac-1c6e70640ad7] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61254) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 19 14:58:13 user devstack@n-api.service[61253]: DEBUG nova.policy [None req-c459089a-39d9-405b-b457-264fc3850294 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aab0b2e3424d80852e588323f187bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dbf312f7154ce1ae7fc1403947d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61253) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:58:13 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-c459089a-39d9-405b-b457-264fc3850294 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9fee43ad-330a-45d7-9374-07feefcf9e14" status: 200 len: 1658 microversion: 2.1 time: 0.235220 Apr 19 14:58:13 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 105/314] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:58:12 2023] GET /compute/v2.1/servers/9fee43ad-330a-45d7-9374-07feefcf9e14 => generated 1658 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:58:13 user devstack@n-api.service[61254]: WARNING nova.compute.api [None req-b9bba1ab-a7ef-4825-bf00-cf11fdf449f4 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] [instance: eb4336f9-1d61-4fee-83ac-1c6e70640ad7] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 19 14:58:13 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-6e3e62b2-9cc5-4608-ad34-b22db98e4c7a req-6dff0cac-7282-4103-8e04-45a75a5230b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6930db7c-e8e0-4d1d-ac99-952827ff1aa9", "name": "network-vif-plugged", "status": "completed", "tag": "a9320570-bc89-45b1-a97c-3da53f2e4b70"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:58:13 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-6e3e62b2-9cc5-4608-ad34-b22db98e4c7a req-6dff0cac-7282-4103-8e04-45a75a5230b5 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:58:13 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-6e3e62b2-9cc5-4608-ad34-b22db98e4c7a req-6dff0cac-7282-4103-8e04-45a75a5230b5 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:58:13 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-6e3e62b2-9cc5-4608-ad34-b22db98e4c7a req-6dff0cac-7282-4103-8e04-45a75a5230b5 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:58:13 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-6e3e62b2-9cc5-4608-ad34-b22db98e4c7a req-6dff0cac-7282-4103-8e04-45a75a5230b5 service nova] Creating event network-vif-plugged:a9320570-bc89-45b1-a97c-3da53f2e4b70 for instance 6930db7c-e8e0-4d1d-ac99-952827ff1aa9 on user Apr 19 14:58:13 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-b9bba1ab-a7ef-4825-bf00-cf11fdf449f4 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/eb4336f9-1d61-4fee-83ac-1c6e70640ad7" status: 204 len: 0 microversion: 2.87 time: 0.488894 Apr 19 14:58:13 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 104/315] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 19 14:58:13 2023] DELETE /compute/v2.1/servers/eb4336f9-1d61-4fee-83ac-1c6e70640ad7 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 19 14:58:13 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [req-6e3e62b2-9cc5-4608-ad34-b22db98e4c7a req-6dff0cac-7282-4103-8e04-45a75a5230b5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028560 Apr 19 14:58:13 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 107/316] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:58:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:58:13 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-97f71a45-8026-4163-9eb7-77c0c1c994d1 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:58:13 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-97f71a45-8026-4163-9eb7-77c0c1c994d1 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] [instance: eb4336f9-1d61-4fee-83ac-1c6e70640ad7] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:58:13 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-97f71a45-8026-4163-9eb7-77c0c1c994d1 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:58:13 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-97f71a45-8026-4163-9eb7-77c0c1c994d1 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:58:13 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-97f71a45-8026-4163-9eb7-77c0c1c994d1 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:58:13 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-97f71a45-8026-4163-9eb7-77c0c1c994d1 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:58:13 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-97f71a45-8026-4163-9eb7-77c0c1c994d1 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:58:13 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-97f71a45-8026-4163-9eb7-77c0c1c994d1 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:58:13 user devstack@n-api.service[61253]: INFO nova.api.openstack.wsgi [None req-97f71a45-8026-4163-9eb7-77c0c1c994d1 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] HTTP exception thrown: Instance eb4336f9-1d61-4fee-83ac-1c6e70640ad7 could not be found. Apr 19 14:58:13 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-97f71a45-8026-4163-9eb7-77c0c1c994d1 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Request method failure captured: Apr 19 14:58:13 user devstack@n-api.service[61253]: request: GET /compute/v2.1/servers/eb4336f9-1d61-4fee-83ac-1c6e70640ad7 HTTP/1.1 Apr 19 14:58:13 user devstack@n-api.service[61253]: Accept: application/json Apr 19 14:58:13 user devstack@n-api.service[61253]: Accept-Encoding: identity Apr 19 14:58:13 user devstack@n-api.service[61253]: Connection: close Apr 19 14:58:13 user devstack@n-api.service[61253]: Content-Length: 0 Apr 19 14:58:13 user devstack@n-api.service[61253]: Content-Type: application/json Apr 19 14:58:13 user devstack@n-api.service[61253]: Host: 10.0.0.210 Apr 19 14:58:13 user devstack@n-api.service[61253]: Openstack-System-Scope: None Apr 19 14:58:13 user devstack@n-api.service[61253]: User-Agent: python-urllib3/1.26.15 Apr 19 14:58:13 user devstack@n-api.service[61253]: X-Auth-Token: gAAAAABkP_-41ftQj_8wSAoFbkjOmwhZZoFbhh5figS3gy8Y-8Rr62DKw5pnfvwe3_ePsrBFzQDyXP0nE89w-ekmIB6jyLYgHp7dbA5RtqoBabtEuFUzFLm8IICf13TYAYTMmMrKMqZW2nq03-vXmmLdmC3MxGkuS1Zo6VWlf5dHBSwp9Fet2j8 Apr 19 14:58:13 user devstack@n-api.service[61253]: X-Domain-Id: None Apr 19 14:58:13 user devstack@n-api.service[61253]: X-Domain-Name: None Apr 19 14:58:13 user devstack@n-api.service[61253]: X-Identity-Status: Confirmed Apr 19 14:58:13 user devstack@n-api.service[61253]: X-Is-Admin-Project: True Apr 19 14:58:13 user devstack@n-api.service[61253]: X-Openstack-Nova-Api-Version: 2.87 Apr 19 14:58:13 user devstack@n-api.service[61253]: X-Project-Domain-Id: default Apr 19 14:58:13 user devstack@n-api.service[61253]: X-Project-Domain-Name: Default Apr 19 14:58:13 user devstack@n-api.service[61253]: X-Project-Id: b1bc7474b840449da88a8f420316ecfb Apr 19 14:58:13 user devstack@n-api.service[61253]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1484020474 Apr 19 14:58:13 user devstack@n-api.service[61253]: X-Role: member,reader Apr 19 14:58:13 user devstack@n-api.service[61253]: X-Roles: member,reader Apr 19 14:58:13 user devstack@n-api.service[61253]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b1bc7474b840449da88a8f420316ecfb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b1bc7474b840449da88a8f420316ecfb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b1bc7474b840449da88a8f420316ecfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 14:58:13 user devstack@n-api.service[61253]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1484020474 Apr 19 14:58:13 user devstack@n-api.service[61253]: X-Tenant-Id: b1bc7474b840449da88a8f420316ecfb Apr 19 14:58:13 user devstack@n-api.service[61253]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1484020474 Apr 19 14:58:13 user devstack@n-api.service[61253]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member Apr 19 14:58:13 user devstack@n-api.service[61253]: X-User-Domain-Id: default Apr 19 14:58:13 user devstack@n-api.service[61253]: X-User-Domain-Name: Default Apr 19 14:58:13 user devstack@n-api.service[61253]: X-User-Id: b33dd700a9314ab9a70428a3455a571c Apr 19 14:58:13 user devstack@n-api.service[61253]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member Apr 19 14:58:13 user devstack@n-api.service[61253]: method: > Apr 19 14:58:13 user devstack@n-api.service[61253]: exception: Instance eb4336f9-1d61-4fee-83ac-1c6e70640ad7 could not be found. Apr 19 14:58:13 user devstack@n-api.service[61253]: action_args: {'id': 'eb4336f9-1d61-4fee-83ac-1c6e70640ad7'} Apr 19 14:58:13 user devstack@n-api.service[61253]: {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:58:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:58:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:58:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:58:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:58:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:58:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:58:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:58:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:58:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:58:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb4336f9-1d61-4fee-83ac-1c6e70640ad7 could not be found. Apr 19 14:58:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 14:58:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:58:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 14:58:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:58:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:58:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:58:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:58:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:58:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:58:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:58:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:58:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:58:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:58:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:58:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:58:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:58:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb4336f9-1d61-4fee-83ac-1c6e70640ad7 could not be found. Apr 19 14:58:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 14:58:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:58:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 14:58:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:58:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:58:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:58:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:58:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:58:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb4336f9-1d61-4fee-83ac-1c6e70640ad7 could not be found. Apr 19 14:58:13 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 14:58:13 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-97f71a45-8026-4163-9eb7-77c0c1c994d1 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Returning 404 to user: Instance eb4336f9-1d61-4fee-83ac-1c6e70640ad7 could not be found. {{(pid=61253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:58:13 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-97f71a45-8026-4163-9eb7-77c0c1c994d1 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb4336f9-1d61-4fee-83ac-1c6e70640ad7" status: 404 len: 111 microversion: 2.87 time: 0.029941 Apr 19 14:58:13 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 106/317] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 14:58:13 2023] GET /compute/v2.1/servers/eb4336f9-1d61-4fee-83ac-1c6e70640ad7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 14:58:13 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-738bef39-86f8-4bea-9e7d-f1b6fb6befb3 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:58:13 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-738bef39-86f8-4bea-9e7d-f1b6fb6befb3 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] [instance: 2a5ed5bc-23a0-42f5-8b38-167d24e822b7] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:58:13 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-738bef39-86f8-4bea-9e7d-f1b6fb6befb3 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:58:13 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-738bef39-86f8-4bea-9e7d-f1b6fb6befb3 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:58:13 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-738bef39-86f8-4bea-9e7d-f1b6fb6befb3 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:58:13 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-738bef39-86f8-4bea-9e7d-f1b6fb6befb3 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:58:13 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-738bef39-86f8-4bea-9e7d-f1b6fb6befb3 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:58:13 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-738bef39-86f8-4bea-9e7d-f1b6fb6befb3 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:58:13 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-738bef39-86f8-4bea-9e7d-f1b6fb6befb3 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] [instance: 2a5ed5bc-23a0-42f5-8b38-167d24e822b7] Going to try to terminate instance {{(pid=61254) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 14:58:13 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-738bef39-86f8-4bea-9e7d-f1b6fb6befb3 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2a5ed5bc-23a0-42f5-8b38-167d24e822b7" status: 204 len: 0 microversion: 2.87 time: 0.116502 Apr 19 14:58:13 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 105/318] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 19 14:58:13 2023] DELETE /compute/v2.1/servers/2a5ed5bc-23a0-42f5-8b38-167d24e822b7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 19 14:58:13 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-8fa96fbd-f1c8-4cb7-8544-4af1e01488bb tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:58:13 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-8fa96fbd-f1c8-4cb7-8544-4af1e01488bb tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] [instance: 2a5ed5bc-23a0-42f5-8b38-167d24e822b7] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:58:13 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-8fa96fbd-f1c8-4cb7-8544-4af1e01488bb tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:58:13 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-8fa96fbd-f1c8-4cb7-8544-4af1e01488bb tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:58:13 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-8fa96fbd-f1c8-4cb7-8544-4af1e01488bb tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:58:13 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-8fa96fbd-f1c8-4cb7-8544-4af1e01488bb tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:58:13 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-8fa96fbd-f1c8-4cb7-8544-4af1e01488bb tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:58:13 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-8fa96fbd-f1c8-4cb7-8544-4af1e01488bb tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:58:14 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-8fa96fbd-f1c8-4cb7-8544-4af1e01488bb tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33dd700a9314ab9a70428a3455a571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bc7474b840449da88a8f420316ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:58:14 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-8fa96fbd-f1c8-4cb7-8544-4af1e01488bb tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b33dd700a9314ab9a70428a3455a571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bc7474b840449da88a8f420316ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:58:14 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-8fa96fbd-f1c8-4cb7-8544-4af1e01488bb tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b33dd700a9314ab9a70428a3455a571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bc7474b840449da88a8f420316ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:58:14 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-8fa96fbd-f1c8-4cb7-8544-4af1e01488bb tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2a5ed5bc-23a0-42f5-8b38-167d24e822b7" status: 200 len: 1696 microversion: 2.87 time: 0.273374 Apr 19 14:58:14 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 108/319] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 14:58:13 2023] GET /compute/v2.1/servers/2a5ed5bc-23a0-42f5-8b38-167d24e822b7 => generated 1696 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 14:58:14 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [req-47597b67-8dff-4433-bf24-8c927f4a057b req-ac80883c-f150-4261-a8ac-bef46432e805 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a5ed5bc-23a0-42f5-8b38-167d24e822b7", "name": "network-vif-unplugged", "status": "completed", "tag": "146691c0-5b82-412e-8a59-5b0e90496d92"}]} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:58:14 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-47597b67-8dff-4433-bf24-8c927f4a057b req-ac80883c-f150-4261-a8ac-bef46432e805 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:58:14 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-47597b67-8dff-4433-bf24-8c927f4a057b req-ac80883c-f150-4261-a8ac-bef46432e805 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:58:14 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-47597b67-8dff-4433-bf24-8c927f4a057b req-ac80883c-f150-4261-a8ac-bef46432e805 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:58:14 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-47597b67-8dff-4433-bf24-8c927f4a057b req-ac80883c-f150-4261-a8ac-bef46432e805 service nova] Creating event network-vif-unplugged:146691c0-5b82-412e-8a59-5b0e90496d92 for instance 2a5ed5bc-23a0-42f5-8b38-167d24e822b7 on user Apr 19 14:58:14 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [req-47597b67-8dff-4433-bf24-8c927f4a057b req-ac80883c-f150-4261-a8ac-bef46432e805 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032600 Apr 19 14:58:14 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 107/320] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:58:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:58:14 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [req-12696844-d0ad-4da8-b035-7632a01c417f req-599d4011-92c1-46a8-8d79-6b9e4e820da2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a5ed5bc-23a0-42f5-8b38-167d24e822b7", "name": "network-vif-deleted", "tag": "146691c0-5b82-412e-8a59-5b0e90496d92"}]} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:58:14 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-12696844-d0ad-4da8-b035-7632a01c417f req-599d4011-92c1-46a8-8d79-6b9e4e820da2 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:58:14 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-12696844-d0ad-4da8-b035-7632a01c417f req-599d4011-92c1-46a8-8d79-6b9e4e820da2 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:58:14 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-12696844-d0ad-4da8-b035-7632a01c417f req-599d4011-92c1-46a8-8d79-6b9e4e820da2 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:58:14 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-12696844-d0ad-4da8-b035-7632a01c417f req-599d4011-92c1-46a8-8d79-6b9e4e820da2 service nova] Creating event network-vif-deleted:146691c0-5b82-412e-8a59-5b0e90496d92 for instance 2a5ed5bc-23a0-42f5-8b38-167d24e822b7 on user Apr 19 14:58:14 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [req-12696844-d0ad-4da8-b035-7632a01c417f req-599d4011-92c1-46a8-8d79-6b9e4e820da2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030038 Apr 19 14:58:14 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 106/321] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:58:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:58:16 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-a90fcb6c-be42-4a1a-891e-f44ad7668f7f req-649c14a8-e0ec-4db6-8d65-9dd6e946ff2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a5ed5bc-23a0-42f5-8b38-167d24e822b7", "name": "network-vif-plugged", "status": "completed", "tag": "146691c0-5b82-412e-8a59-5b0e90496d92"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:58:16 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-a90fcb6c-be42-4a1a-891e-f44ad7668f7f req-649c14a8-e0ec-4db6-8d65-9dd6e946ff2b service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:58:16 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-a90fcb6c-be42-4a1a-891e-f44ad7668f7f req-649c14a8-e0ec-4db6-8d65-9dd6e946ff2b service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:58:16 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-a90fcb6c-be42-4a1a-891e-f44ad7668f7f req-649c14a8-e0ec-4db6-8d65-9dd6e946ff2b service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:58:16 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-a90fcb6c-be42-4a1a-891e-f44ad7668f7f req-649c14a8-e0ec-4db6-8d65-9dd6e946ff2b service nova] Creating event network-vif-plugged:146691c0-5b82-412e-8a59-5b0e90496d92 for instance 2a5ed5bc-23a0-42f5-8b38-167d24e822b7 on user Apr 19 14:58:16 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [req-a90fcb6c-be42-4a1a-891e-f44ad7668f7f req-649c14a8-e0ec-4db6-8d65-9dd6e946ff2b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031073 Apr 19 14:58:16 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 109/322] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:58:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:58:27 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_api:SELECT=10 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:58:27 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell1:SELECT=14 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:58:27 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-a1f53ed9-93b6-4c2b-8376-76f1186e005e tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:58:27 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-a1f53ed9-93b6-4c2b-8376-76f1186e005e tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] [instance: 4dee286e-96ba-4b45-a572-d1e098807b8a] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:58:27 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-a1f53ed9-93b6-4c2b-8376-76f1186e005e tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:58:27 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-a1f53ed9-93b6-4c2b-8376-76f1186e005e tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:58:27 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-a1f53ed9-93b6-4c2b-8376-76f1186e005e tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:58:27 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-a1f53ed9-93b6-4c2b-8376-76f1186e005e tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:58:27 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-a1f53ed9-93b6-4c2b-8376-76f1186e005e tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:58:27 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-a1f53ed9-93b6-4c2b-8376-76f1186e005e tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:58:27 user devstack@n-api.service[61253]: DEBUG nova.policy [None req-a1f53ed9-93b6-4c2b-8376-76f1186e005e tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2985fabe974b80a37af599e28c8fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c121e3e3fa440d8a2e1c3e42975a9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61253) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:58:27 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-a1f53ed9-93b6-4c2b-8376-76f1186e005e tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4dee286e-96ba-4b45-a572-d1e098807b8a" status: 200 len: 1536 microversion: 2.1 time: 0.361133 Apr 19 14:58:27 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 108/323] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:58:27 2023] GET /compute/v2.1/servers/4dee286e-96ba-4b45-a572-d1e098807b8a => generated 1536 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:58:41 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=2 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:58:41 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=19,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=2 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:58:41 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-3fd8a983-29a7-46f6-b00f-f60900959ef0 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:58:41 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-3fd8a983-29a7-46f6-b00f-f60900959ef0 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] [instance: 25a11d52-4c81-46e5-925d-ba88df6dfdff] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:58:41 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-3fd8a983-29a7-46f6-b00f-f60900959ef0 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:58:41 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-3fd8a983-29a7-46f6-b00f-f60900959ef0 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:58:41 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-3fd8a983-29a7-46f6-b00f-f60900959ef0 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:58:41 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-3fd8a983-29a7-46f6-b00f-f60900959ef0 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:58:41 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-3fd8a983-29a7-46f6-b00f-f60900959ef0 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:58:41 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-3fd8a983-29a7-46f6-b00f-f60900959ef0 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:58:41 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-3fd8a983-29a7-46f6-b00f-f60900959ef0 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25a11d52-4c81-46e5-925d-ba88df6dfdff/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.234518 Apr 19 14:58:41 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 107/324] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 14:58:41 2023] GET /compute/v2.1/servers/25a11d52-4c81-46e5-925d-ba88df6dfdff/os-interface => generated 282 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:58:42 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:58:42 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:58:42 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-e00302c4-d367-40f8-beef-ff82be2f030c req-e8530d75-1a8b-469e-ab98-78768398c056 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25a11d52-4c81-46e5-925d-ba88df6dfdff", "tag": "d996ceed-0431-4551-ac4d-83403e9344cd"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:58:42 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-e00302c4-d367-40f8-beef-ff82be2f030c req-e8530d75-1a8b-469e-ab98-78768398c056 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:58:42 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-e00302c4-d367-40f8-beef-ff82be2f030c req-e8530d75-1a8b-469e-ab98-78768398c056 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:58:42 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-e00302c4-d367-40f8-beef-ff82be2f030c req-e8530d75-1a8b-469e-ab98-78768398c056 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:58:42 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-e00302c4-d367-40f8-beef-ff82be2f030c req-e8530d75-1a8b-469e-ab98-78768398c056 service nova] Creating event network-changed:d996ceed-0431-4551-ac4d-83403e9344cd for instance 25a11d52-4c81-46e5-925d-ba88df6dfdff on user Apr 19 14:58:42 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [req-e00302c4-d367-40f8-beef-ff82be2f030c req-e8530d75-1a8b-469e-ab98-78768398c056 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037102 Apr 19 14:58:42 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 110/325] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:58:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:58:42 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-31f934e3-65ed-4ba3-b9ff-cb824bc55db5 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:58:42 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-31f934e3-65ed-4ba3-b9ff-cb824bc55db5 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] [instance: 25a11d52-4c81-46e5-925d-ba88df6dfdff] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:58:42 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_api:SELECT=2 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:58:42 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell1:SELECT=6 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:58:42 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-31f934e3-65ed-4ba3-b9ff-cb824bc55db5 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:58:42 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-31f934e3-65ed-4ba3-b9ff-cb824bc55db5 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:58:42 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-31f934e3-65ed-4ba3-b9ff-cb824bc55db5 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:58:42 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-31f934e3-65ed-4ba3-b9ff-cb824bc55db5 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:58:42 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-31f934e3-65ed-4ba3-b9ff-cb824bc55db5 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:58:42 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-31f934e3-65ed-4ba3-b9ff-cb824bc55db5 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:58:42 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-31f934e3-65ed-4ba3-b9ff-cb824bc55db5 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25a11d52-4c81-46e5-925d-ba88df6dfdff/ips" status: 200 len: 107 microversion: 2.1 time: 0.044453 Apr 19 14:58:42 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 109/326] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 19 14:58:42 2023] GET /compute/v2.1/servers/25a11d52-4c81-46e5-925d-ba88df6dfdff/ips => generated 107 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:58:43 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-bc80cba3-a41e-4241-9578-169fbeffc09c tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:58:43 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-bc80cba3-a41e-4241-9578-169fbeffc09c tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] [instance: dbf728fc-fcd9-4819-8bae-3816c3fde252] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:58:43 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-bc80cba3-a41e-4241-9578-169fbeffc09c tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:58:43 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-bc80cba3-a41e-4241-9578-169fbeffc09c tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:58:43 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-bc80cba3-a41e-4241-9578-169fbeffc09c tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:58:43 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-bc80cba3-a41e-4241-9578-169fbeffc09c tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:58:43 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-bc80cba3-a41e-4241-9578-169fbeffc09c tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:58:43 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-bc80cba3-a41e-4241-9578-169fbeffc09c tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:58:43 user devstack@n-api.service[61254]: INFO nova.api.openstack.wsgi [None req-bc80cba3-a41e-4241-9578-169fbeffc09c tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] HTTP exception thrown: Instance dbf728fc-fcd9-4819-8bae-3816c3fde252 could not be found. Apr 19 14:58:43 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-bc80cba3-a41e-4241-9578-169fbeffc09c tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Request method failure captured: Apr 19 14:58:43 user devstack@n-api.service[61254]: request: GET /compute/v2.1/servers/dbf728fc-fcd9-4819-8bae-3816c3fde252 HTTP/1.1 Apr 19 14:58:43 user devstack@n-api.service[61254]: Accept: application/json Apr 19 14:58:43 user devstack@n-api.service[61254]: Accept-Encoding: identity Apr 19 14:58:43 user devstack@n-api.service[61254]: Connection: close Apr 19 14:58:43 user devstack@n-api.service[61254]: Content-Length: 0 Apr 19 14:58:43 user devstack@n-api.service[61254]: Content-Type: application/json Apr 19 14:58:43 user devstack@n-api.service[61254]: Host: 10.0.0.210 Apr 19 14:58:43 user devstack@n-api.service[61254]: Openstack-System-Scope: None Apr 19 14:58:43 user devstack@n-api.service[61254]: User-Agent: python-urllib3/1.26.15 Apr 19 14:58:43 user devstack@n-api.service[61254]: X-Auth-Token: gAAAAABkQAD2B5cPLM0q-6Y7n-IkIVzMw4nonmzCfT6G70OP2VeE02RPwL5LhFFVBBlWUtw8PYhJK4Fwrs8iBxEg3UIrR56fmvRzJ-UnwQzySqRPxyq-Wy-bsA_FP3sKAWKoOJdNbP3bC3JEAfIuV09lIt6q5u29Anm26XgnsHlKAXb9WNKP2SU Apr 19 14:58:43 user devstack@n-api.service[61254]: X-Domain-Id: None Apr 19 14:58:43 user devstack@n-api.service[61254]: X-Domain-Name: None Apr 19 14:58:43 user devstack@n-api.service[61254]: X-Identity-Status: Confirmed Apr 19 14:58:43 user devstack@n-api.service[61254]: X-Is-Admin-Project: True Apr 19 14:58:43 user devstack@n-api.service[61254]: X-Project-Domain-Id: default Apr 19 14:58:43 user devstack@n-api.service[61254]: X-Project-Domain-Name: Default Apr 19 14:58:43 user devstack@n-api.service[61254]: X-Project-Id: adb7a6d6040c4475b034b1f33f97a491 Apr 19 14:58:43 user devstack@n-api.service[61254]: X-Project-Name: tempest-SnapshotDataIntegrityTests-1605781579 Apr 19 14:58:43 user devstack@n-api.service[61254]: X-Role: member,reader Apr 19 14:58:43 user devstack@n-api.service[61254]: X-Roles: member,reader Apr 19 14:58:43 user devstack@n-api.service[61254]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/adb7a6d6040c4475b034b1f33f97a491"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/adb7a6d6040c4475b034b1f33f97a491"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/adb7a6d6040c4475b034b1f33f97a491"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 14:58:43 user devstack@n-api.service[61254]: X-Tenant: tempest-SnapshotDataIntegrityTests-1605781579 Apr 19 14:58:43 user devstack@n-api.service[61254]: X-Tenant-Id: adb7a6d6040c4475b034b1f33f97a491 Apr 19 14:58:43 user devstack@n-api.service[61254]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-1605781579 Apr 19 14:58:43 user devstack@n-api.service[61254]: X-User: tempest-SnapshotDataIntegrityTests-1605781579-project-member Apr 19 14:58:43 user devstack@n-api.service[61254]: X-User-Domain-Id: default Apr 19 14:58:43 user devstack@n-api.service[61254]: X-User-Domain-Name: Default Apr 19 14:58:43 user devstack@n-api.service[61254]: X-User-Id: b2057a3280134a99bc9a97c66ad51220 Apr 19 14:58:43 user devstack@n-api.service[61254]: X-User-Name: tempest-SnapshotDataIntegrityTests-1605781579-project-member Apr 19 14:58:43 user devstack@n-api.service[61254]: method: > Apr 19 14:58:43 user devstack@n-api.service[61254]: exception: Instance dbf728fc-fcd9-4819-8bae-3816c3fde252 could not be found. Apr 19 14:58:43 user devstack@n-api.service[61254]: action_args: {'id': 'dbf728fc-fcd9-4819-8bae-3816c3fde252'} Apr 19 14:58:43 user devstack@n-api.service[61254]: {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:58:43 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:58:43 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:58:43 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:58:43 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:58:43 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:58:43 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:58:43 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:58:43 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:58:43 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:58:43 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbf728fc-fcd9-4819-8bae-3816c3fde252 could not be found. Apr 19 14:58:43 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:58:43 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:58:43 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:58:43 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:58:43 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:58:43 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:58:43 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:58:43 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:58:43 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:58:43 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:58:43 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:58:43 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:58:43 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:58:43 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:58:43 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:58:43 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:58:43 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbf728fc-fcd9-4819-8bae-3816c3fde252 could not be found. Apr 19 14:58:43 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:58:43 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:58:43 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:58:43 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:58:43 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:58:43 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:58:43 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:58:43 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:58:43 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbf728fc-fcd9-4819-8bae-3816c3fde252 could not be found. Apr 19 14:58:43 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 14:58:43 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-bc80cba3-a41e-4241-9578-169fbeffc09c tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Returning 404 to user: Instance dbf728fc-fcd9-4819-8bae-3816c3fde252 could not be found. {{(pid=61254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:58:43 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-bc80cba3-a41e-4241-9578-169fbeffc09c tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dbf728fc-fcd9-4819-8bae-3816c3fde252" status: 404 len: 111 microversion: 2.1 time: 0.030594 Apr 19 14:58:43 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 108/327] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:58:43 2023] GET /compute/v2.1/servers/dbf728fc-fcd9-4819-8bae-3816c3fde252 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:58:43 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-07a624d5-f88c-4bd7-bbba-93d31941f20a tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] Calling method '.version_select at 0x7f3cfa9c3250>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:58:43 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-07a624d5-f88c-4bd7-bbba-93d31941f20a tempest-SnapshotDataIntegrityTests-1605781579 tempest-SnapshotDataIntegrityTests-1605781579-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-265701621" status: 202 len: 0 microversion: 2.1 time: 0.023369 Apr 19 14:58:43 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 111/328] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 14:58:43 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-265701621 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 14:58:44 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-1d24810f-fcae-47a8-a308-a6223d77fefa tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:58:44 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-1d24810f-fcae-47a8-a308-a6223d77fefa tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] [instance: 25a11d52-4c81-46e5-925d-ba88df6dfdff] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:58:44 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-1d24810f-fcae-47a8-a308-a6223d77fefa tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:58:44 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-1d24810f-fcae-47a8-a308-a6223d77fefa tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:58:44 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-1d24810f-fcae-47a8-a308-a6223d77fefa tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:58:44 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-1d24810f-fcae-47a8-a308-a6223d77fefa tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:58:44 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-1d24810f-fcae-47a8-a308-a6223d77fefa tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:58:44 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-1d24810f-fcae-47a8-a308-a6223d77fefa tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:58:44 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-1d24810f-fcae-47a8-a308-a6223d77fefa tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] [instance: 25a11d52-4c81-46e5-925d-ba88df6dfdff] Going to try to terminate instance {{(pid=61253) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 14:58:44 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-1d24810f-fcae-47a8-a308-a6223d77fefa tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/25a11d52-4c81-46e5-925d-ba88df6dfdff" status: 204 len: 0 microversion: 2.1 time: 0.118528 Apr 19 14:58:44 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 110/329] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 14:58:44 2023] DELETE /compute/v2.1/servers/25a11d52-4c81-46e5-925d-ba88df6dfdff => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 14:58:44 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-01ab63de-d395-44b6-ab0a-552e2800297c tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:58:44 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-01ab63de-d395-44b6-ab0a-552e2800297c tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] [instance: 25a11d52-4c81-46e5-925d-ba88df6dfdff] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:58:44 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-01ab63de-d395-44b6-ab0a-552e2800297c tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:58:44 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-01ab63de-d395-44b6-ab0a-552e2800297c tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:58:44 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-01ab63de-d395-44b6-ab0a-552e2800297c tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:58:44 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-01ab63de-d395-44b6-ab0a-552e2800297c tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:58:44 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-01ab63de-d395-44b6-ab0a-552e2800297c tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:58:44 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-01ab63de-d395-44b6-ab0a-552e2800297c tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:58:44 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-01ab63de-d395-44b6-ab0a-552e2800297c tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b23f0d7300496990e74b2fb4945c15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5079ce8a52417fb2b8b8122bfeaa5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:58:44 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-01ab63de-d395-44b6-ab0a-552e2800297c tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25a11d52-4c81-46e5-925d-ba88df6dfdff" status: 200 len: 1669 microversion: 2.1 time: 0.270010 Apr 19 14:58:44 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 109/330] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:58:44 2023] GET /compute/v2.1/servers/25a11d52-4c81-46e5-925d-ba88df6dfdff => generated 1669 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:58:44 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-8e6ac7c8-9b2b-4a1e-8d5a-7eaea8267974 req-7698a63a-edc8-4d41-8250-a18a7e235735 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25a11d52-4c81-46e5-925d-ba88df6dfdff", "name": "network-vif-unplugged", "status": "completed", "tag": "d996ceed-0431-4551-ac4d-83403e9344cd"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:58:44 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-8e6ac7c8-9b2b-4a1e-8d5a-7eaea8267974 req-7698a63a-edc8-4d41-8250-a18a7e235735 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:58:44 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-8e6ac7c8-9b2b-4a1e-8d5a-7eaea8267974 req-7698a63a-edc8-4d41-8250-a18a7e235735 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:58:44 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-8e6ac7c8-9b2b-4a1e-8d5a-7eaea8267974 req-7698a63a-edc8-4d41-8250-a18a7e235735 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:58:44 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-8e6ac7c8-9b2b-4a1e-8d5a-7eaea8267974 req-7698a63a-edc8-4d41-8250-a18a7e235735 service nova] Creating event network-vif-unplugged:d996ceed-0431-4551-ac4d-83403e9344cd for instance 25a11d52-4c81-46e5-925d-ba88df6dfdff on user Apr 19 14:58:44 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [req-8e6ac7c8-9b2b-4a1e-8d5a-7eaea8267974 req-7698a63a-edc8-4d41-8250-a18a7e235735 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037523 Apr 19 14:58:44 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 112/331] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:58:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:58:45 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [req-022e9b98-25ee-4cf9-b9f0-478b84ba7021 req-f6a43739-083d-482f-ae25-56aea9ca0465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25a11d52-4c81-46e5-925d-ba88df6dfdff", "name": "network-vif-deleted", "tag": "d996ceed-0431-4551-ac4d-83403e9344cd"}]} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:58:45 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-022e9b98-25ee-4cf9-b9f0-478b84ba7021 req-f6a43739-083d-482f-ae25-56aea9ca0465 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:58:45 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-022e9b98-25ee-4cf9-b9f0-478b84ba7021 req-f6a43739-083d-482f-ae25-56aea9ca0465 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:58:45 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-022e9b98-25ee-4cf9-b9f0-478b84ba7021 req-f6a43739-083d-482f-ae25-56aea9ca0465 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:58:45 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-022e9b98-25ee-4cf9-b9f0-478b84ba7021 req-f6a43739-083d-482f-ae25-56aea9ca0465 service nova] Creating event network-vif-deleted:d996ceed-0431-4551-ac4d-83403e9344cd for instance 25a11d52-4c81-46e5-925d-ba88df6dfdff on user Apr 19 14:58:45 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [req-022e9b98-25ee-4cf9-b9f0-478b84ba7021 req-f6a43739-083d-482f-ae25-56aea9ca0465 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029678 Apr 19 14:58:45 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 111/332] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:58:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:58:46 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [req-577d288e-2afa-43d7-a966-d92bf7d0f07d req-74efd68d-11f2-4327-b607-7b252aa4936b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25a11d52-4c81-46e5-925d-ba88df6dfdff", "name": "network-vif-plugged", "status": "completed", "tag": "d996ceed-0431-4551-ac4d-83403e9344cd"}]} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:58:46 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-577d288e-2afa-43d7-a966-d92bf7d0f07d req-74efd68d-11f2-4327-b607-7b252aa4936b service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:58:46 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-577d288e-2afa-43d7-a966-d92bf7d0f07d req-74efd68d-11f2-4327-b607-7b252aa4936b service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:58:46 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-577d288e-2afa-43d7-a966-d92bf7d0f07d req-74efd68d-11f2-4327-b607-7b252aa4936b service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:58:46 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-577d288e-2afa-43d7-a966-d92bf7d0f07d req-74efd68d-11f2-4327-b607-7b252aa4936b service nova] Creating event network-vif-plugged:d996ceed-0431-4551-ac4d-83403e9344cd for instance 25a11d52-4c81-46e5-925d-ba88df6dfdff on user Apr 19 14:58:46 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [req-577d288e-2afa-43d7-a966-d92bf7d0f07d req-74efd68d-11f2-4327-b607-7b252aa4936b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030981 Apr 19 14:58:46 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 110/333] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:58:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:59:01 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:59:01 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell1:SELECT=4 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:59:01 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-1db9df96-2b74-4604-acfe-63158137869d tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:59:01 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-1db9df96-2b74-4604-acfe-63158137869d tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] [instance: 6930db7c-e8e0-4d1d-ac99-952827ff1aa9] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:59:01 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-1db9df96-2b74-4604-acfe-63158137869d tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:59:01 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-1db9df96-2b74-4604-acfe-63158137869d tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:59:01 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-1db9df96-2b74-4604-acfe-63158137869d tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:59:01 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-1db9df96-2b74-4604-acfe-63158137869d tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:59:01 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-1db9df96-2b74-4604-acfe-63158137869d tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:59:01 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-1db9df96-2b74-4604-acfe-63158137869d tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:59:01 user devstack@n-api.service[61255]: INFO nova.api.openstack.wsgi [None req-1db9df96-2b74-4604-acfe-63158137869d tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] HTTP exception thrown: Instance 6930db7c-e8e0-4d1d-ac99-952827ff1aa9 could not be found. Apr 19 14:59:01 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-1db9df96-2b74-4604-acfe-63158137869d tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Request method failure captured: Apr 19 14:59:01 user devstack@n-api.service[61255]: request: GET /compute/v2.1/servers/6930db7c-e8e0-4d1d-ac99-952827ff1aa9 HTTP/1.1 Apr 19 14:59:01 user devstack@n-api.service[61255]: Accept: application/json Apr 19 14:59:01 user devstack@n-api.service[61255]: Accept-Encoding: identity Apr 19 14:59:01 user devstack@n-api.service[61255]: Connection: close Apr 19 14:59:01 user devstack@n-api.service[61255]: Content-Length: 0 Apr 19 14:59:01 user devstack@n-api.service[61255]: Content-Type: application/json Apr 19 14:59:01 user devstack@n-api.service[61255]: Host: 10.0.0.210 Apr 19 14:59:01 user devstack@n-api.service[61255]: Openstack-System-Scope: None Apr 19 14:59:01 user devstack@n-api.service[61255]: User-Agent: python-urllib3/1.26.15 Apr 19 14:59:01 user devstack@n-api.service[61255]: X-Auth-Token: gAAAAABkQABkxMNS_OR07MiE4iEcjY7FZP_ARzM9mRs3rXIh5gejPSL97jmyRWR6bHsF4HQmtxCwY77thUVyVBT6B9jqWqeSVuQQI63qZM_3x5oIlRKDCfYZrzXheXCbXMW4F2ahBIYT2-doi6eU1GgwtuGuHlqCUMbWcsQ-mEhKOFYoCn-g0gE Apr 19 14:59:01 user devstack@n-api.service[61255]: X-Domain-Id: None Apr 19 14:59:01 user devstack@n-api.service[61255]: X-Domain-Name: None Apr 19 14:59:01 user devstack@n-api.service[61255]: X-Identity-Status: Confirmed Apr 19 14:59:01 user devstack@n-api.service[61255]: X-Is-Admin-Project: True Apr 19 14:59:01 user devstack@n-api.service[61255]: X-Project-Domain-Id: default Apr 19 14:59:01 user devstack@n-api.service[61255]: X-Project-Domain-Name: Default Apr 19 14:59:01 user devstack@n-api.service[61255]: X-Project-Id: 8f94be4fa38d44fe84c03b02b09bab0a Apr 19 14:59:01 user devstack@n-api.service[61255]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-343306122 Apr 19 14:59:01 user devstack@n-api.service[61255]: X-Role: member,reader Apr 19 14:59:01 user devstack@n-api.service[61255]: X-Roles: member,reader Apr 19 14:59:01 user devstack@n-api.service[61255]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8f94be4fa38d44fe84c03b02b09bab0a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8f94be4fa38d44fe84c03b02b09bab0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8f94be4fa38d44fe84c03b02b09bab0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 14:59:01 user devstack@n-api.service[61255]: X-Tenant: tempest-ServerRescueNegativeTestJSON-343306122 Apr 19 14:59:01 user devstack@n-api.service[61255]: X-Tenant-Id: 8f94be4fa38d44fe84c03b02b09bab0a Apr 19 14:59:01 user devstack@n-api.service[61255]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-343306122 Apr 19 14:59:01 user devstack@n-api.service[61255]: X-User: tempest-ServerRescueNegativeTestJSON-343306122-project-member Apr 19 14:59:01 user devstack@n-api.service[61255]: X-User-Domain-Id: default Apr 19 14:59:01 user devstack@n-api.service[61255]: X-User-Domain-Name: Default Apr 19 14:59:01 user devstack@n-api.service[61255]: X-User-Id: 8683d0564d7c475c9d26f897e0239640 Apr 19 14:59:01 user devstack@n-api.service[61255]: X-User-Name: tempest-ServerRescueNegativeTestJSON-343306122-project-member Apr 19 14:59:01 user devstack@n-api.service[61255]: method: > Apr 19 14:59:01 user devstack@n-api.service[61255]: exception: Instance 6930db7c-e8e0-4d1d-ac99-952827ff1aa9 could not be found. Apr 19 14:59:01 user devstack@n-api.service[61255]: action_args: {'id': '6930db7c-e8e0-4d1d-ac99-952827ff1aa9'} Apr 19 14:59:01 user devstack@n-api.service[61255]: {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:59:01 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:59:01 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:59:01 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:59:01 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:59:01 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:59:01 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:59:01 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:59:01 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:59:01 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:59:01 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6930db7c-e8e0-4d1d-ac99-952827ff1aa9 could not be found. Apr 19 14:59:01 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:59:01 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:59:01 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:59:01 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:59:01 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:59:01 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:59:01 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:59:01 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:59:01 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:59:01 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:59:01 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:59:01 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:59:01 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:59:01 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:59:01 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:59:01 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:59:01 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6930db7c-e8e0-4d1d-ac99-952827ff1aa9 could not be found. Apr 19 14:59:01 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:59:01 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:59:01 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:59:01 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:59:01 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:59:01 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:59:01 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:59:01 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:59:01 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6930db7c-e8e0-4d1d-ac99-952827ff1aa9 could not be found. Apr 19 14:59:01 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:59:01 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-1db9df96-2b74-4604-acfe-63158137869d tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Returning 404 to user: Instance 6930db7c-e8e0-4d1d-ac99-952827ff1aa9 could not be found. {{(pid=61255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:59:01 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-1db9df96-2b74-4604-acfe-63158137869d tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6930db7c-e8e0-4d1d-ac99-952827ff1aa9" status: 404 len: 111 microversion: 2.1 time: 0.301702 Apr 19 14:59:01 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 113/334] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:59:01 2023] GET /compute/v2.1/servers/6930db7c-e8e0-4d1d-ac99-952827ff1aa9 => generated 111 bytes in 303 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:59:01 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:59:01 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:59:01 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-d93e45d6-d541-4753-8f2e-3d409d1c4ddc tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:59:01 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-d93e45d6-d541-4753-8f2e-3d409d1c4ddc tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] [instance: 9c330e74-9939-422b-88f6-1958857b6c41] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:59:01 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-d93e45d6-d541-4753-8f2e-3d409d1c4ddc tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:59:01 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-d93e45d6-d541-4753-8f2e-3d409d1c4ddc tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:59:01 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-d93e45d6-d541-4753-8f2e-3d409d1c4ddc tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:59:01 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-d93e45d6-d541-4753-8f2e-3d409d1c4ddc tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:59:01 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-d93e45d6-d541-4753-8f2e-3d409d1c4ddc tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:59:01 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-d93e45d6-d541-4753-8f2e-3d409d1c4ddc tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:59:01 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-d93e45d6-d541-4753-8f2e-3d409d1c4ddc tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] [instance: 9c330e74-9939-422b-88f6-1958857b6c41] Going to try to terminate instance {{(pid=61253) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 14:59:01 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-d93e45d6-d541-4753-8f2e-3d409d1c4ddc tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9c330e74-9939-422b-88f6-1958857b6c41" status: 204 len: 0 microversion: 2.1 time: 0.113087 Apr 19 14:59:01 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 112/335] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 14:59:01 2023] DELETE /compute/v2.1/servers/9c330e74-9939-422b-88f6-1958857b6c41 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 14:59:01 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_api:SELECT=8 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:59:01 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell1:SELECT=14 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:59:01 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-590154d5-297a-4a2d-8041-867bdde9c6dc tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:59:01 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-590154d5-297a-4a2d-8041-867bdde9c6dc tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] [instance: 9c330e74-9939-422b-88f6-1958857b6c41] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:59:01 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-590154d5-297a-4a2d-8041-867bdde9c6dc tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:59:01 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-590154d5-297a-4a2d-8041-867bdde9c6dc tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:59:01 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-590154d5-297a-4a2d-8041-867bdde9c6dc tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:59:01 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-590154d5-297a-4a2d-8041-867bdde9c6dc tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:59:01 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-590154d5-297a-4a2d-8041-867bdde9c6dc tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:59:01 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-590154d5-297a-4a2d-8041-867bdde9c6dc tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:59:02 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-590154d5-297a-4a2d-8041-867bdde9c6dc tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8683d0564d7c475c9d26f897e0239640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94be4fa38d44fe84c03b02b09bab0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:59:02 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-590154d5-297a-4a2d-8041-867bdde9c6dc tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c330e74-9939-422b-88f6-1958857b6c41" status: 200 len: 1507 microversion: 2.1 time: 0.251498 Apr 19 14:59:02 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 111/336] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:59:01 2023] GET /compute/v2.1/servers/9c330e74-9939-422b-88f6-1958857b6c41 => generated 1507 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:59:02 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-09f57e11-730c-4f36-8d57-51978d1fe18f req-c601f67b-fa03-48f5-bd88-a1b382f44263 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c330e74-9939-422b-88f6-1958857b6c41", "name": "network-vif-unplugged", "status": "completed", "tag": "857c8812-0d5a-4ec9-b7a9-23592a1be890"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:59:02 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-09f57e11-730c-4f36-8d57-51978d1fe18f req-c601f67b-fa03-48f5-bd88-a1b382f44263 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:59:02 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-09f57e11-730c-4f36-8d57-51978d1fe18f req-c601f67b-fa03-48f5-bd88-a1b382f44263 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:59:02 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-09f57e11-730c-4f36-8d57-51978d1fe18f req-c601f67b-fa03-48f5-bd88-a1b382f44263 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:59:02 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-09f57e11-730c-4f36-8d57-51978d1fe18f req-c601f67b-fa03-48f5-bd88-a1b382f44263 service nova] Creating event network-vif-unplugged:857c8812-0d5a-4ec9-b7a9-23592a1be890 for instance 9c330e74-9939-422b-88f6-1958857b6c41 on user Apr 19 14:59:02 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [req-09f57e11-730c-4f36-8d57-51978d1fe18f req-c601f67b-fa03-48f5-bd88-a1b382f44263 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.026361 Apr 19 14:59:02 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 114/337] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:59:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:59:04 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-d0822bc3-6948-4d0c-a2a4-988f1612e1f5 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:59:04 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-d0822bc3-6948-4d0c-a2a4-988f1612e1f5 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] [instance: 2a5ed5bc-23a0-42f5-8b38-167d24e822b7] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:59:04 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-d0822bc3-6948-4d0c-a2a4-988f1612e1f5 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:59:04 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-d0822bc3-6948-4d0c-a2a4-988f1612e1f5 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:59:04 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-d0822bc3-6948-4d0c-a2a4-988f1612e1f5 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:59:04 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-d0822bc3-6948-4d0c-a2a4-988f1612e1f5 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:59:04 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-d0822bc3-6948-4d0c-a2a4-988f1612e1f5 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:59:04 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-d0822bc3-6948-4d0c-a2a4-988f1612e1f5 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:59:04 user devstack@n-api.service[61253]: INFO nova.api.openstack.wsgi [None req-d0822bc3-6948-4d0c-a2a4-988f1612e1f5 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] HTTP exception thrown: Instance 2a5ed5bc-23a0-42f5-8b38-167d24e822b7 could not be found. Apr 19 14:59:04 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-d0822bc3-6948-4d0c-a2a4-988f1612e1f5 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Request method failure captured: Apr 19 14:59:04 user devstack@n-api.service[61253]: request: GET /compute/v2.1/servers/2a5ed5bc-23a0-42f5-8b38-167d24e822b7 HTTP/1.1 Apr 19 14:59:04 user devstack@n-api.service[61253]: Accept: application/json Apr 19 14:59:04 user devstack@n-api.service[61253]: Accept-Encoding: identity Apr 19 14:59:04 user devstack@n-api.service[61253]: Connection: close Apr 19 14:59:04 user devstack@n-api.service[61253]: Content-Length: 0 Apr 19 14:59:04 user devstack@n-api.service[61253]: Content-Type: application/json Apr 19 14:59:04 user devstack@n-api.service[61253]: Host: 10.0.0.210 Apr 19 14:59:04 user devstack@n-api.service[61253]: Openstack-System-Scope: None Apr 19 14:59:04 user devstack@n-api.service[61253]: User-Agent: python-urllib3/1.26.15 Apr 19 14:59:04 user devstack@n-api.service[61253]: X-Auth-Token: gAAAAABkP_-41ftQj_8wSAoFbkjOmwhZZoFbhh5figS3gy8Y-8Rr62DKw5pnfvwe3_ePsrBFzQDyXP0nE89w-ekmIB6jyLYgHp7dbA5RtqoBabtEuFUzFLm8IICf13TYAYTMmMrKMqZW2nq03-vXmmLdmC3MxGkuS1Zo6VWlf5dHBSwp9Fet2j8 Apr 19 14:59:04 user devstack@n-api.service[61253]: X-Domain-Id: None Apr 19 14:59:04 user devstack@n-api.service[61253]: X-Domain-Name: None Apr 19 14:59:04 user devstack@n-api.service[61253]: X-Identity-Status: Confirmed Apr 19 14:59:04 user devstack@n-api.service[61253]: X-Is-Admin-Project: True Apr 19 14:59:04 user devstack@n-api.service[61253]: X-Openstack-Nova-Api-Version: 2.87 Apr 19 14:59:04 user devstack@n-api.service[61253]: X-Project-Domain-Id: default Apr 19 14:59:04 user devstack@n-api.service[61253]: X-Project-Domain-Name: Default Apr 19 14:59:04 user devstack@n-api.service[61253]: X-Project-Id: b1bc7474b840449da88a8f420316ecfb Apr 19 14:59:04 user devstack@n-api.service[61253]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1484020474 Apr 19 14:59:04 user devstack@n-api.service[61253]: X-Role: member,reader Apr 19 14:59:04 user devstack@n-api.service[61253]: X-Roles: member,reader Apr 19 14:59:04 user devstack@n-api.service[61253]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b1bc7474b840449da88a8f420316ecfb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b1bc7474b840449da88a8f420316ecfb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b1bc7474b840449da88a8f420316ecfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 14:59:04 user devstack@n-api.service[61253]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1484020474 Apr 19 14:59:04 user devstack@n-api.service[61253]: X-Tenant-Id: b1bc7474b840449da88a8f420316ecfb Apr 19 14:59:04 user devstack@n-api.service[61253]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1484020474 Apr 19 14:59:04 user devstack@n-api.service[61253]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member Apr 19 14:59:04 user devstack@n-api.service[61253]: X-User-Domain-Id: default Apr 19 14:59:04 user devstack@n-api.service[61253]: X-User-Domain-Name: Default Apr 19 14:59:04 user devstack@n-api.service[61253]: X-User-Id: b33dd700a9314ab9a70428a3455a571c Apr 19 14:59:04 user devstack@n-api.service[61253]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member Apr 19 14:59:04 user devstack@n-api.service[61253]: method: > Apr 19 14:59:04 user devstack@n-api.service[61253]: exception: Instance 2a5ed5bc-23a0-42f5-8b38-167d24e822b7 could not be found. Apr 19 14:59:04 user devstack@n-api.service[61253]: action_args: {'id': '2a5ed5bc-23a0-42f5-8b38-167d24e822b7'} Apr 19 14:59:04 user devstack@n-api.service[61253]: {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:59:04 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:59:04 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:59:04 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:59:04 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:59:04 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:59:04 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:59:04 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:59:04 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:59:04 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:59:04 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a5ed5bc-23a0-42f5-8b38-167d24e822b7 could not be found. Apr 19 14:59:04 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 14:59:04 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:59:04 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 14:59:04 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:59:04 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:59:04 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:59:04 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:59:04 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:59:04 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:59:04 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:59:04 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:59:04 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:59:04 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:59:04 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:59:04 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:59:04 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:59:04 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a5ed5bc-23a0-42f5-8b38-167d24e822b7 could not be found. Apr 19 14:59:04 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 14:59:04 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:59:04 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 14:59:04 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:59:04 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:59:04 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:59:04 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:59:04 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:59:04 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a5ed5bc-23a0-42f5-8b38-167d24e822b7 could not be found. Apr 19 14:59:04 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 14:59:04 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-d0822bc3-6948-4d0c-a2a4-988f1612e1f5 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Returning 404 to user: Instance 2a5ed5bc-23a0-42f5-8b38-167d24e822b7 could not be found. {{(pid=61253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:59:04 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-d0822bc3-6948-4d0c-a2a4-988f1612e1f5 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2a5ed5bc-23a0-42f5-8b38-167d24e822b7" status: 404 len: 111 microversion: 2.87 time: 0.027811 Apr 19 14:59:04 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 113/338] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 14:59:04 2023] GET /compute/v2.1/servers/2a5ed5bc-23a0-42f5-8b38-167d24e822b7 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 19 14:59:04 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [req-b47cc169-8f73-41b8-86f9-0b799dc8bc4c req-152b384a-7017-467e-af49-75e764a1f675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c330e74-9939-422b-88f6-1958857b6c41", "name": "network-vif-plugged", "status": "completed", "tag": "857c8812-0d5a-4ec9-b7a9-23592a1be890"}, {"server_uuid": "9c330e74-9939-422b-88f6-1958857b6c41", "name": "network-vif-deleted", "tag": "857c8812-0d5a-4ec9-b7a9-23592a1be890"}]} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:59:04 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-b47cc169-8f73-41b8-86f9-0b799dc8bc4c req-152b384a-7017-467e-af49-75e764a1f675 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:59:04 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-b47cc169-8f73-41b8-86f9-0b799dc8bc4c req-152b384a-7017-467e-af49-75e764a1f675 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:59:04 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-b47cc169-8f73-41b8-86f9-0b799dc8bc4c req-152b384a-7017-467e-af49-75e764a1f675 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:59:04 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-b47cc169-8f73-41b8-86f9-0b799dc8bc4c req-152b384a-7017-467e-af49-75e764a1f675 service nova] Creating event network-vif-plugged:857c8812-0d5a-4ec9-b7a9-23592a1be890 for instance 9c330e74-9939-422b-88f6-1958857b6c41 on user Apr 19 14:59:04 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-b47cc169-8f73-41b8-86f9-0b799dc8bc4c req-152b384a-7017-467e-af49-75e764a1f675 service nova] Creating event network-vif-deleted:857c8812-0d5a-4ec9-b7a9-23592a1be890 for instance 9c330e74-9939-422b-88f6-1958857b6c41 on user Apr 19 14:59:04 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [req-b47cc169-8f73-41b8-86f9-0b799dc8bc4c req-152b384a-7017-467e-af49-75e764a1f675 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030610 Apr 19 14:59:04 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 112/339] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:59:04 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:59:04 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-031b3f69-bba5-45e8-bfaa-d17eb39b4fe8 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:59:04 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-031b3f69-bba5-45e8-bfaa-d17eb39b4fe8 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] [instance: 95058640-8ace-444b-8e6b-685575695a46] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:59:04 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-031b3f69-bba5-45e8-bfaa-d17eb39b4fe8 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:59:04 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-031b3f69-bba5-45e8-bfaa-d17eb39b4fe8 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:59:04 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-031b3f69-bba5-45e8-bfaa-d17eb39b4fe8 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:59:04 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-031b3f69-bba5-45e8-bfaa-d17eb39b4fe8 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:59:04 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-031b3f69-bba5-45e8-bfaa-d17eb39b4fe8 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:59:04 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-031b3f69-bba5-45e8-bfaa-d17eb39b4fe8 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:59:04 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-031b3f69-bba5-45e8-bfaa-d17eb39b4fe8 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] [instance: 95058640-8ace-444b-8e6b-685575695a46] Going to try to terminate instance {{(pid=61255) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 14:59:04 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-031b3f69-bba5-45e8-bfaa-d17eb39b4fe8 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/95058640-8ace-444b-8e6b-685575695a46" status: 204 len: 0 microversion: 2.87 time: 0.100282 Apr 19 14:59:04 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 115/340] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 19 14:59:04 2023] DELETE /compute/v2.1/servers/95058640-8ace-444b-8e6b-685575695a46 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 19 14:59:04 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-47771ac9-4669-4a21-bc82-332724fab8ce tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:59:04 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-47771ac9-4669-4a21-bc82-332724fab8ce tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] [instance: 95058640-8ace-444b-8e6b-685575695a46] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:59:04 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-47771ac9-4669-4a21-bc82-332724fab8ce tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:59:04 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-47771ac9-4669-4a21-bc82-332724fab8ce tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:59:04 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-47771ac9-4669-4a21-bc82-332724fab8ce tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:59:04 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-47771ac9-4669-4a21-bc82-332724fab8ce tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:59:04 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-47771ac9-4669-4a21-bc82-332724fab8ce tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:59:04 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-47771ac9-4669-4a21-bc82-332724fab8ce tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:59:04 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [req-1746b3d6-3b04-40f7-bced-fd8f3ed519bf req-448f0625-45c0-43f3-966f-37956e0461a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95058640-8ace-444b-8e6b-685575695a46", "name": "network-vif-unplugged", "status": "completed", "tag": "4899e7a4-0c57-44a0-adcc-20591aa70d7e"}]} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:59:04 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-1746b3d6-3b04-40f7-bced-fd8f3ed519bf req-448f0625-45c0-43f3-966f-37956e0461a9 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:59:04 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-1746b3d6-3b04-40f7-bced-fd8f3ed519bf req-448f0625-45c0-43f3-966f-37956e0461a9 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:59:04 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-1746b3d6-3b04-40f7-bced-fd8f3ed519bf req-448f0625-45c0-43f3-966f-37956e0461a9 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:59:04 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-1746b3d6-3b04-40f7-bced-fd8f3ed519bf req-448f0625-45c0-43f3-966f-37956e0461a9 service nova] Creating event network-vif-unplugged:4899e7a4-0c57-44a0-adcc-20591aa70d7e for instance 95058640-8ace-444b-8e6b-685575695a46 on user Apr 19 14:59:04 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [req-1746b3d6-3b04-40f7-bced-fd8f3ed519bf req-448f0625-45c0-43f3-966f-37956e0461a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029516 Apr 19 14:59:04 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 113/341] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:59:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:59:04 user devstack@n-api.service[61253]: DEBUG nova.policy [None req-47771ac9-4669-4a21-bc82-332724fab8ce tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33dd700a9314ab9a70428a3455a571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bc7474b840449da88a8f420316ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61253) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:59:04 user devstack@n-api.service[61253]: DEBUG nova.policy [None req-47771ac9-4669-4a21-bc82-332724fab8ce tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b33dd700a9314ab9a70428a3455a571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bc7474b840449da88a8f420316ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61253) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:59:04 user devstack@n-api.service[61253]: DEBUG nova.policy [None req-47771ac9-4669-4a21-bc82-332724fab8ce tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b33dd700a9314ab9a70428a3455a571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bc7474b840449da88a8f420316ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61253) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:59:04 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-47771ac9-4669-4a21-bc82-332724fab8ce tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95058640-8ace-444b-8e6b-685575695a46" status: 200 len: 1697 microversion: 2.87 time: 0.469809 Apr 19 14:59:04 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 114/342] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 14:59:04 2023] GET /compute/v2.1/servers/95058640-8ace-444b-8e6b-685575695a46 => generated 1697 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 14:59:06 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-d179eebd-4c3c-4861-b530-49edb5578164 req-279b58dd-e6bb-4877-92df-d04b86ca34d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95058640-8ace-444b-8e6b-685575695a46", "name": "network-vif-deleted", "tag": "4899e7a4-0c57-44a0-adcc-20591aa70d7e"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:59:06 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-d179eebd-4c3c-4861-b530-49edb5578164 req-279b58dd-e6bb-4877-92df-d04b86ca34d1 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:59:06 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-d179eebd-4c3c-4861-b530-49edb5578164 req-279b58dd-e6bb-4877-92df-d04b86ca34d1 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:59:06 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-d179eebd-4c3c-4861-b530-49edb5578164 req-279b58dd-e6bb-4877-92df-d04b86ca34d1 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:59:06 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-d179eebd-4c3c-4861-b530-49edb5578164 req-279b58dd-e6bb-4877-92df-d04b86ca34d1 service nova] Creating event network-vif-deleted:4899e7a4-0c57-44a0-adcc-20591aa70d7e for instance 95058640-8ace-444b-8e6b-685575695a46 on user Apr 19 14:59:06 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [req-d179eebd-4c3c-4861-b530-49edb5578164 req-279b58dd-e6bb-4877-92df-d04b86ca34d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034813 Apr 19 14:59:06 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 116/343] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:59:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:59:06 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [req-c0c7c9e5-4a71-4c53-849c-6c7a32fcddf9 req-441a5e06-7530-4266-bc16-85d3843d191b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95058640-8ace-444b-8e6b-685575695a46", "name": "network-vif-plugged", "status": "completed", "tag": "4899e7a4-0c57-44a0-adcc-20591aa70d7e"}]} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:59:07 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-c0c7c9e5-4a71-4c53-849c-6c7a32fcddf9 req-441a5e06-7530-4266-bc16-85d3843d191b service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:59:07 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-c0c7c9e5-4a71-4c53-849c-6c7a32fcddf9 req-441a5e06-7530-4266-bc16-85d3843d191b service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:59:07 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-c0c7c9e5-4a71-4c53-849c-6c7a32fcddf9 req-441a5e06-7530-4266-bc16-85d3843d191b service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:59:07 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-c0c7c9e5-4a71-4c53-849c-6c7a32fcddf9 req-441a5e06-7530-4266-bc16-85d3843d191b service nova] Creating event network-vif-plugged:4899e7a4-0c57-44a0-adcc-20591aa70d7e for instance 95058640-8ace-444b-8e6b-685575695a46 on user Apr 19 14:59:07 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [req-c0c7c9e5-4a71-4c53-849c-6c7a32fcddf9 req-441a5e06-7530-4266-bc16-85d3843d191b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034097 Apr 19 14:59:07 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 114/344] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:59:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:59:14 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-913acc0f-94b4-4706-a4f8-551b9ed07c6d tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:59:14 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-913acc0f-94b4-4706-a4f8-551b9ed07c6d tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] [instance: 9fee43ad-330a-45d7-9374-07feefcf9e14] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:59:14 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-913acc0f-94b4-4706-a4f8-551b9ed07c6d tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:59:14 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-913acc0f-94b4-4706-a4f8-551b9ed07c6d tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:59:14 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-913acc0f-94b4-4706-a4f8-551b9ed07c6d tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:59:14 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-913acc0f-94b4-4706-a4f8-551b9ed07c6d tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:59:14 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-913acc0f-94b4-4706-a4f8-551b9ed07c6d tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:59:14 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-913acc0f-94b4-4706-a4f8-551b9ed07c6d tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:59:15 user devstack@n-api.service[61253]: DEBUG nova.policy [None req-913acc0f-94b4-4706-a4f8-551b9ed07c6d tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aab0b2e3424d80852e588323f187bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dbf312f7154ce1ae7fc1403947d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61253) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:59:15 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-913acc0f-94b4-4706-a4f8-551b9ed07c6d tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9fee43ad-330a-45d7-9374-07feefcf9e14" status: 200 len: 1658 microversion: 2.1 time: 0.215837 Apr 19 14:59:15 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 115/345] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:59:14 2023] GET /compute/v2.1/servers/9fee43ad-330a-45d7-9374-07feefcf9e14 => generated 1658 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:59:27 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:59:27 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:59:27 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-e760e9ea-5beb-4937-a950-ee953dbfb676 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:59:27 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-e760e9ea-5beb-4937-a950-ee953dbfb676 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] [instance: 4dee286e-96ba-4b45-a572-d1e098807b8a] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:59:27 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-e760e9ea-5beb-4937-a950-ee953dbfb676 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:59:27 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-e760e9ea-5beb-4937-a950-ee953dbfb676 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:59:27 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-e760e9ea-5beb-4937-a950-ee953dbfb676 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:59:27 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-e760e9ea-5beb-4937-a950-ee953dbfb676 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:59:27 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-e760e9ea-5beb-4937-a950-ee953dbfb676 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:59:27 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-e760e9ea-5beb-4937-a950-ee953dbfb676 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:59:27 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-e760e9ea-5beb-4937-a950-ee953dbfb676 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2985fabe974b80a37af599e28c8fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c121e3e3fa440d8a2e1c3e42975a9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:59:27 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-e760e9ea-5beb-4937-a950-ee953dbfb676 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4dee286e-96ba-4b45-a572-d1e098807b8a" status: 200 len: 1536 microversion: 2.1 time: 0.228697 Apr 19 14:59:27 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 117/346] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:59:27 2023] GET /compute/v2.1/servers/4dee286e-96ba-4b45-a572-d1e098807b8a => generated 1536 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:59:27 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-232c9365-4aa0-4e64-b358-3f1b708a82bd tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:59:27 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-232c9365-4aa0-4e64-b358-3f1b708a82bd tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7e2985fabe974b80a37af599e28c8fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c121e3e3fa440d8a2e1c3e42975a9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:59:27 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-232c9365-4aa0-4e64-b358-3f1b708a82bd tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Searching by: {'deleted': False, 'project_id': '3c121e3e3fa440d8a2e1c3e42975a9a1'} {{(pid=61254) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 19 14:59:27 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_api:SELECT=8 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:59:27 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell1:SELECT=12 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:59:27 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-232c9365-4aa0-4e64-b358-3f1b708a82bd tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:59:27 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-232c9365-4aa0-4e64-b358-3f1b708a82bd tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:59:27 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-232c9365-4aa0-4e64-b358-3f1b708a82bd tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:59:27 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-232c9365-4aa0-4e64-b358-3f1b708a82bd tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:59:27 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-232c9365-4aa0-4e64-b358-3f1b708a82bd tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:59:27 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-232c9365-4aa0-4e64-b358-3f1b708a82bd tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:59:27 user devstack@n-api.service[61254]: DEBUG nova.compute.multi_cell_list [None req-232c9365-4aa0-4e64-b358-3f1b708a82bd tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61254) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 19 14:59:28 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-232c9365-4aa0-4e64-b358-3f1b708a82bd tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.202602 Apr 19 14:59:28 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 115/347] 10.0.0.210 () {62 vars in 1202 bytes} [Wed Apr 19 14:59:27 2023] GET /compute/v2.1/servers => generated 340 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:59:28 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-f49a364f-00a4-4036-9833-3d663d263f2a tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:59:28 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-f49a364f-00a4-4036-9833-3d663d263f2a tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] [instance: 4dee286e-96ba-4b45-a572-d1e098807b8a] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:59:28 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:59:28 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:59:28 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-f49a364f-00a4-4036-9833-3d663d263f2a tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:59:28 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-f49a364f-00a4-4036-9833-3d663d263f2a tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:59:28 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-f49a364f-00a4-4036-9833-3d663d263f2a tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:59:28 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-f49a364f-00a4-4036-9833-3d663d263f2a tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:59:28 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-f49a364f-00a4-4036-9833-3d663d263f2a tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:59:28 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-f49a364f-00a4-4036-9833-3d663d263f2a tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:59:28 user devstack@n-api.service[61253]: DEBUG nova.policy [None req-f49a364f-00a4-4036-9833-3d663d263f2a tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2985fabe974b80a37af599e28c8fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c121e3e3fa440d8a2e1c3e42975a9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61253) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:59:28 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-f49a364f-00a4-4036-9833-3d663d263f2a tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4dee286e-96ba-4b45-a572-d1e098807b8a" status: 200 len: 1536 microversion: 2.1 time: 0.245113 Apr 19 14:59:28 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 116/348] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:59:28 2023] GET /compute/v2.1/servers/4dee286e-96ba-4b45-a572-d1e098807b8a => generated 1536 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:59:29 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-8b9e5ebb-b067-4986-a7cf-ab34344bca7d tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:59:29 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-8b9e5ebb-b067-4986-a7cf-ab34344bca7d tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] [instance: 4dee286e-96ba-4b45-a572-d1e098807b8a] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:59:29 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-8b9e5ebb-b067-4986-a7cf-ab34344bca7d tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:59:29 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-8b9e5ebb-b067-4986-a7cf-ab34344bca7d tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:59:29 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-8b9e5ebb-b067-4986-a7cf-ab34344bca7d tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:59:29 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-8b9e5ebb-b067-4986-a7cf-ab34344bca7d tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:59:29 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-8b9e5ebb-b067-4986-a7cf-ab34344bca7d tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:59:29 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-8b9e5ebb-b067-4986-a7cf-ab34344bca7d tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:59:29 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-8b9e5ebb-b067-4986-a7cf-ab34344bca7d tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] [instance: 4dee286e-96ba-4b45-a572-d1e098807b8a] Going to try to terminate instance {{(pid=61255) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 14:59:29 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-8b9e5ebb-b067-4986-a7cf-ab34344bca7d tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4dee286e-96ba-4b45-a572-d1e098807b8a" status: 204 len: 0 microversion: 2.1 time: 0.108711 Apr 19 14:59:29 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 118/349] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 14:59:29 2023] DELETE /compute/v2.1/servers/4dee286e-96ba-4b45-a572-d1e098807b8a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 14:59:29 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-5be983b7-56ac-4b7d-8876-95a4278a076d tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:59:29 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-5be983b7-56ac-4b7d-8876-95a4278a076d tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] [instance: 4dee286e-96ba-4b45-a572-d1e098807b8a] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:59:29 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-5be983b7-56ac-4b7d-8876-95a4278a076d tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:59:29 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-5be983b7-56ac-4b7d-8876-95a4278a076d tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:59:29 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-5be983b7-56ac-4b7d-8876-95a4278a076d tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:59:29 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-5be983b7-56ac-4b7d-8876-95a4278a076d tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:59:29 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-5be983b7-56ac-4b7d-8876-95a4278a076d tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:59:29 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-5be983b7-56ac-4b7d-8876-95a4278a076d tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:59:30 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [req-1d322ef2-e21f-4854-8a3f-469b782e14ea req-780769a9-8522-4440-9e59-4bb8ed634e10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dee286e-96ba-4b45-a572-d1e098807b8a", "name": "network-vif-unplugged", "status": "completed", "tag": "c6c7ca7c-65c4-41ba-825e-34e20fa420b8"}]} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:59:30 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-1d322ef2-e21f-4854-8a3f-469b782e14ea req-780769a9-8522-4440-9e59-4bb8ed634e10 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:59:30 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-1d322ef2-e21f-4854-8a3f-469b782e14ea req-780769a9-8522-4440-9e59-4bb8ed634e10 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:59:30 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-1d322ef2-e21f-4854-8a3f-469b782e14ea req-780769a9-8522-4440-9e59-4bb8ed634e10 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:59:30 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-1d322ef2-e21f-4854-8a3f-469b782e14ea req-780769a9-8522-4440-9e59-4bb8ed634e10 service nova] Creating event network-vif-unplugged:c6c7ca7c-65c4-41ba-825e-34e20fa420b8 for instance 4dee286e-96ba-4b45-a572-d1e098807b8a on user Apr 19 14:59:30 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-5be983b7-56ac-4b7d-8876-95a4278a076d tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2985fabe974b80a37af599e28c8fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c121e3e3fa440d8a2e1c3e42975a9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:59:30 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [req-1d322ef2-e21f-4854-8a3f-469b782e14ea req-780769a9-8522-4440-9e59-4bb8ed634e10 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028258 Apr 19 14:59:30 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 117/350] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:59:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:59:30 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-5be983b7-56ac-4b7d-8876-95a4278a076d tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4dee286e-96ba-4b45-a572-d1e098807b8a" status: 200 len: 1542 microversion: 2.1 time: 0.246167 Apr 19 14:59:30 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 116/351] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:59:29 2023] GET /compute/v2.1/servers/4dee286e-96ba-4b45-a572-d1e098807b8a => generated 1542 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:59:32 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-4f6ed772-30d0-41a2-98db-875837e87dd4 req-a29b93c1-ea4f-4a04-8d74-18098c8862e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dee286e-96ba-4b45-a572-d1e098807b8a", "name": "network-vif-plugged", "status": "completed", "tag": "c6c7ca7c-65c4-41ba-825e-34e20fa420b8"}, {"server_uuid": "4dee286e-96ba-4b45-a572-d1e098807b8a", "name": "network-vif-deleted", "tag": "c6c7ca7c-65c4-41ba-825e-34e20fa420b8"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:59:32 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-4f6ed772-30d0-41a2-98db-875837e87dd4 req-a29b93c1-ea4f-4a04-8d74-18098c8862e3 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:59:32 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-4f6ed772-30d0-41a2-98db-875837e87dd4 req-a29b93c1-ea4f-4a04-8d74-18098c8862e3 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:59:32 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-4f6ed772-30d0-41a2-98db-875837e87dd4 req-a29b93c1-ea4f-4a04-8d74-18098c8862e3 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:59:32 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-4f6ed772-30d0-41a2-98db-875837e87dd4 req-a29b93c1-ea4f-4a04-8d74-18098c8862e3 service nova] Creating event network-vif-plugged:c6c7ca7c-65c4-41ba-825e-34e20fa420b8 for instance 4dee286e-96ba-4b45-a572-d1e098807b8a on user Apr 19 14:59:32 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-4f6ed772-30d0-41a2-98db-875837e87dd4 req-a29b93c1-ea4f-4a04-8d74-18098c8862e3 service nova] Creating event network-vif-deleted:c6c7ca7c-65c4-41ba-825e-34e20fa420b8 for instance 4dee286e-96ba-4b45-a572-d1e098807b8a on user Apr 19 14:59:32 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [req-4f6ed772-30d0-41a2-98db-875837e87dd4 req-a29b93c1-ea4f-4a04-8d74-18098c8862e3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.027533 Apr 19 14:59:32 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 119/352] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:59:32 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:59:34 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-69be4241-690e-466c-b3be-b93cade5f1c9 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:59:34 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-69be4241-690e-466c-b3be-b93cade5f1c9 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] [instance: 25a11d52-4c81-46e5-925d-ba88df6dfdff] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:59:34 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-69be4241-690e-466c-b3be-b93cade5f1c9 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:59:34 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-69be4241-690e-466c-b3be-b93cade5f1c9 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:59:34 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-69be4241-690e-466c-b3be-b93cade5f1c9 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:59:34 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-69be4241-690e-466c-b3be-b93cade5f1c9 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:59:34 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-69be4241-690e-466c-b3be-b93cade5f1c9 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:59:34 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-69be4241-690e-466c-b3be-b93cade5f1c9 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:59:34 user devstack@n-api.service[61253]: INFO nova.api.openstack.wsgi [None req-69be4241-690e-466c-b3be-b93cade5f1c9 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] HTTP exception thrown: Instance 25a11d52-4c81-46e5-925d-ba88df6dfdff could not be found. Apr 19 14:59:34 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-69be4241-690e-466c-b3be-b93cade5f1c9 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Request method failure captured: Apr 19 14:59:34 user devstack@n-api.service[61253]: request: GET /compute/v2.1/servers/25a11d52-4c81-46e5-925d-ba88df6dfdff HTTP/1.1 Apr 19 14:59:34 user devstack@n-api.service[61253]: Accept: application/json Apr 19 14:59:34 user devstack@n-api.service[61253]: Accept-Encoding: identity Apr 19 14:59:34 user devstack@n-api.service[61253]: Connection: close Apr 19 14:59:34 user devstack@n-api.service[61253]: Content-Length: 0 Apr 19 14:59:34 user devstack@n-api.service[61253]: Content-Type: application/json Apr 19 14:59:34 user devstack@n-api.service[61253]: Host: 10.0.0.210 Apr 19 14:59:34 user devstack@n-api.service[61253]: Openstack-System-Scope: None Apr 19 14:59:34 user devstack@n-api.service[61253]: User-Agent: python-urllib3/1.26.15 Apr 19 14:59:34 user devstack@n-api.service[61253]: X-Auth-Token: gAAAAABkQACJPl0P3yXKrMRibG79Hqp658in8va3b56MSx-w2zVdHzowg8aIK2QJzNaAu2nYCKOP0EC45n1JzRmkaqYpH8h-BaJQguDeBnVkMVS-0kmTwe8oxShNFbvWV7tvu9Eck7mAYMIZN8Q8WAD_N1YEUOjIIrn9-SU9eVgT8lsH3ldOGl4 Apr 19 14:59:34 user devstack@n-api.service[61253]: X-Domain-Id: None Apr 19 14:59:34 user devstack@n-api.service[61253]: X-Domain-Name: None Apr 19 14:59:34 user devstack@n-api.service[61253]: X-Identity-Status: Confirmed Apr 19 14:59:34 user devstack@n-api.service[61253]: X-Is-Admin-Project: True Apr 19 14:59:34 user devstack@n-api.service[61253]: X-Project-Domain-Id: default Apr 19 14:59:34 user devstack@n-api.service[61253]: X-Project-Domain-Name: Default Apr 19 14:59:34 user devstack@n-api.service[61253]: X-Project-Id: 9a5079ce8a52417fb2b8b8122bfeaa5e Apr 19 14:59:34 user devstack@n-api.service[61253]: X-Project-Name: tempest-AttachVolumeNegativeTest-68783932 Apr 19 14:59:34 user devstack@n-api.service[61253]: X-Role: member,reader Apr 19 14:59:34 user devstack@n-api.service[61253]: X-Roles: member,reader Apr 19 14:59:34 user devstack@n-api.service[61253]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9a5079ce8a52417fb2b8b8122bfeaa5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9a5079ce8a52417fb2b8b8122bfeaa5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9a5079ce8a52417fb2b8b8122bfeaa5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 14:59:34 user devstack@n-api.service[61253]: X-Tenant: tempest-AttachVolumeNegativeTest-68783932 Apr 19 14:59:34 user devstack@n-api.service[61253]: X-Tenant-Id: 9a5079ce8a52417fb2b8b8122bfeaa5e Apr 19 14:59:34 user devstack@n-api.service[61253]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-68783932 Apr 19 14:59:34 user devstack@n-api.service[61253]: X-User: tempest-AttachVolumeNegativeTest-68783932-project-member Apr 19 14:59:34 user devstack@n-api.service[61253]: X-User-Domain-Id: default Apr 19 14:59:34 user devstack@n-api.service[61253]: X-User-Domain-Name: Default Apr 19 14:59:34 user devstack@n-api.service[61253]: X-User-Id: 35b23f0d7300496990e74b2fb4945c15 Apr 19 14:59:34 user devstack@n-api.service[61253]: X-User-Name: tempest-AttachVolumeNegativeTest-68783932-project-member Apr 19 14:59:34 user devstack@n-api.service[61253]: method: > Apr 19 14:59:34 user devstack@n-api.service[61253]: exception: Instance 25a11d52-4c81-46e5-925d-ba88df6dfdff could not be found. Apr 19 14:59:34 user devstack@n-api.service[61253]: action_args: {'id': '25a11d52-4c81-46e5-925d-ba88df6dfdff'} Apr 19 14:59:34 user devstack@n-api.service[61253]: {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:59:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:59:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:59:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:59:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:59:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:59:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:59:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:59:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:59:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:59:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25a11d52-4c81-46e5-925d-ba88df6dfdff could not be found. Apr 19 14:59:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 14:59:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:59:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 14:59:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:59:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:59:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:59:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:59:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:59:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:59:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:59:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:59:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:59:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:59:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:59:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:59:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:59:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25a11d52-4c81-46e5-925d-ba88df6dfdff could not be found. Apr 19 14:59:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 14:59:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:59:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 14:59:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:59:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:59:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:59:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:59:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:59:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25a11d52-4c81-46e5-925d-ba88df6dfdff could not be found. Apr 19 14:59:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 14:59:34 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-69be4241-690e-466c-b3be-b93cade5f1c9 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Returning 404 to user: Instance 25a11d52-4c81-46e5-925d-ba88df6dfdff could not be found. {{(pid=61253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:59:34 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-69be4241-690e-466c-b3be-b93cade5f1c9 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25a11d52-4c81-46e5-925d-ba88df6dfdff" status: 404 len: 111 microversion: 2.1 time: 0.130719 Apr 19 14:59:34 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 118/353] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:59:34 2023] GET /compute/v2.1/servers/25a11d52-4c81-46e5-925d-ba88df6dfdff => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:59:34 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-a6990f59-ff70-46a6-89e7-bf8fa371e23a tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Calling method '.version_select at 0x7f3cfa98eb90>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:59:34 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-a6990f59-ff70-46a6-89e7-bf8fa371e23a tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2088268776" status: 202 len: 0 microversion: 2.1 time: 0.020503 Apr 19 14:59:34 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 117/354] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 19 14:59:34 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2088268776 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 14:59:35 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-f2ebf160-5e5c-4db7-a636-4395feed5c6c tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Action: 'create', calling method: .version_select at 0x7f3cfa9c2170>, body: {"keypair": {"name": "tempest-keypair-513937092", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCj9P1SYG0PF2I+RlNjbb2Wjqu312ravi+xRYDXHUSAy47AErzqxulLGtxGDvNTWul1gpPQnkCpQ3KzoA8GWlHTKyLxjP3PemievS237vYzZf2WXZ6mJBkHM4swSHIsgg=="}} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:59:35 user devstack@n-api.service[61255]: DEBUG nova.quota [None req-f2ebf160-5e5c-4db7-a636-4395feed5c6c tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Getting quotas for project 9a5079ce8a52417fb2b8b8122bfeaa5e. Resources: {'key_pairs'} {{(pid=61255) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:59:35 user devstack@n-api.service[61255]: DEBUG nova.quota [None req-f2ebf160-5e5c-4db7-a636-4395feed5c6c tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Getting quotas for user 35b23f0d7300496990e74b2fb4945c15 and project 9a5079ce8a52417fb2b8b8122bfeaa5e. Resources: {'key_pairs'} {{(pid=61255) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:59:35 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-f2ebf160-5e5c-4db7-a636-4395feed5c6c tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044245 Apr 19 14:59:35 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 120/355] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 14:59:35 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:59:36 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-2b832bcb-c311-4ad9-99b8-3b7ac4c5cc6b tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1117553723", "imageRef": "283dcfe8-75fd-4917-902e-1b940387187c", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "c9614385-ce43-416a-aeee-94db7fe5338e"}], "security_groups": [{"name": "tempest-securitygroup--1994153144"}], "key_name": "tempest-keypair-513937092", "user_data": "}} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:59:36 user devstack@n-api.service[61253]: DEBUG nova.network.neutron [None req-2b832bcb-c311-4ad9-99b8-3b7ac4c5cc6b tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] validate_networks() for [('c9614385-ce43-416a-aeee-94db7fe5338e', None, None, None, None, None)] {{(pid=61253) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 14:59:37 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-2b832bcb-c311-4ad9-99b8-3b7ac4c5cc6b tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Flavor limits 0:0:0 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 14:59:37 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-2b832bcb-c311-4ad9-99b8-3b7ac4c5cc6b tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Image limits 0:0:0 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 14:59:37 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-2b832bcb-c311-4ad9-99b8-3b7ac4c5cc6b tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Flavor pref 0:0:0 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 14:59:37 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-2b832bcb-c311-4ad9-99b8-3b7ac4c5cc6b tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Image pref 0:0:0 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 14:59:37 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-2b832bcb-c311-4ad9-99b8-3b7ac4c5cc6b tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 14:59:37 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-2b832bcb-c311-4ad9-99b8-3b7ac4c5cc6b tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:59:37 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-2b832bcb-c311-4ad9-99b8-3b7ac4c5cc6b tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:59:37 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-2b832bcb-c311-4ad9-99b8-3b7ac4c5cc6b tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:59:37 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-2b832bcb-c311-4ad9-99b8-3b7ac4c5cc6b tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:59:37 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-2b832bcb-c311-4ad9-99b8-3b7ac4c5cc6b tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:59:37 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-2b832bcb-c311-4ad9-99b8-3b7ac4c5cc6b tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:59:37 user devstack@n-api.service[61253]: DEBUG nova.quota [None req-2b832bcb-c311-4ad9-99b8-3b7ac4c5cc6b tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Getting quotas for project 9a5079ce8a52417fb2b8b8122bfeaa5e. Resources: {'ram', 'instances', 'cores'} {{(pid=61253) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:59:37 user devstack@n-api.service[61253]: DEBUG nova.quota [None req-2b832bcb-c311-4ad9-99b8-3b7ac4c5cc6b tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Getting quotas for user 35b23f0d7300496990e74b2fb4945c15 and project 9a5079ce8a52417fb2b8b8122bfeaa5e. Resources: {'ram', 'instances', 'cores'} {{(pid=61253) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:59:37 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-2b832bcb-c311-4ad9-99b8-3b7ac4c5cc6b tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Going to run 1 instances... {{(pid=61253) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 14:59:37 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-2b832bcb-c311-4ad9-99b8-3b7ac4c5cc6b tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] [instance: ecc2e555-42ac-4e87-b226-ef708dc26627] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='283dcfe8-75fd-4917-902e-1b940387187c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61253) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 14:59:37 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-2b832bcb-c311-4ad9-99b8-3b7ac4c5cc6b tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.003213 Apr 19 14:59:37 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 119/356] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 14:59:36 2023] POST /compute/v2.1/servers => generated 400 bytes in 1004 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 14:59:37 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-2c3e7c10-0f43-4e95-aaed-c154346fbffe tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:59:37 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-2c3e7c10-0f43-4e95-aaed-c154346fbffe tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] [instance: ecc2e555-42ac-4e87-b226-ef708dc26627] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:59:37 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-2c3e7c10-0f43-4e95-aaed-c154346fbffe tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b23f0d7300496990e74b2fb4945c15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5079ce8a52417fb2b8b8122bfeaa5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:59:37 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-2c3e7c10-0f43-4e95-aaed-c154346fbffe tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ecc2e555-42ac-4e87-b226-ef708dc26627" status: 200 len: 1235 microversion: 2.1 time: 0.066613 Apr 19 14:59:37 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 118/357] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:59:37 2023] GET /compute/v2.1/servers/ecc2e555-42ac-4e87-b226-ef708dc26627 => generated 1235 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:59:39 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-b2bc1a27-d5a7-419f-af61-858d4346f36d req-6ad19a26-9db2-4c33-8c53-18c72ff71505 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecc2e555-42ac-4e87-b226-ef708dc26627", "tag": "b1082a8b-7d77-4850-b76a-a9022c19a4a1"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:59:39 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-b2bc1a27-d5a7-419f-af61-858d4346f36d req-6ad19a26-9db2-4c33-8c53-18c72ff71505 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:59:39 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-b2bc1a27-d5a7-419f-af61-858d4346f36d req-6ad19a26-9db2-4c33-8c53-18c72ff71505 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:59:39 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-b2bc1a27-d5a7-419f-af61-858d4346f36d req-6ad19a26-9db2-4c33-8c53-18c72ff71505 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:59:39 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-b2bc1a27-d5a7-419f-af61-858d4346f36d req-6ad19a26-9db2-4c33-8c53-18c72ff71505 service nova] Creating event network-changed:b1082a8b-7d77-4850-b76a-a9022c19a4a1 for instance ecc2e555-42ac-4e87-b226-ef708dc26627 on user Apr 19 14:59:39 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [req-b2bc1a27-d5a7-419f-af61-858d4346f36d req-6ad19a26-9db2-4c33-8c53-18c72ff71505 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027905 Apr 19 14:59:39 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 121/358] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:59:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:59:42 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [req-266f6e39-0204-49bc-a0da-7c119ec724d7 req-c23dadee-c7d9-4137-b754-3a0d9e07df33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecc2e555-42ac-4e87-b226-ef708dc26627", "name": "network-vif-plugged", "status": "completed", "tag": "b1082a8b-7d77-4850-b76a-a9022c19a4a1"}]} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:59:42 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-266f6e39-0204-49bc-a0da-7c119ec724d7 req-c23dadee-c7d9-4137-b754-3a0d9e07df33 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:59:42 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-266f6e39-0204-49bc-a0da-7c119ec724d7 req-c23dadee-c7d9-4137-b754-3a0d9e07df33 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:59:42 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-266f6e39-0204-49bc-a0da-7c119ec724d7 req-c23dadee-c7d9-4137-b754-3a0d9e07df33 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:59:42 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-266f6e39-0204-49bc-a0da-7c119ec724d7 req-c23dadee-c7d9-4137-b754-3a0d9e07df33 service nova] Creating event network-vif-plugged:b1082a8b-7d77-4850-b76a-a9022c19a4a1 for instance ecc2e555-42ac-4e87-b226-ef708dc26627 on user Apr 19 14:59:42 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [req-266f6e39-0204-49bc-a0da-7c119ec724d7 req-c23dadee-c7d9-4137-b754-3a0d9e07df33 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035985 Apr 19 14:59:42 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 120/359] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:59:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:59:44 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [req-f991b2e7-9b0a-47e0-a32a-2cd6daf8faab req-4a45a9ef-1d8b-46d3-8b50-e00724e8efaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecc2e555-42ac-4e87-b226-ef708dc26627", "name": "network-vif-plugged", "status": "completed", "tag": "b1082a8b-7d77-4850-b76a-a9022c19a4a1"}]} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:59:44 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell0:SELECT=2 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:59:44 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell1:SELECT=14 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:59:44 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-f991b2e7-9b0a-47e0-a32a-2cd6daf8faab req-4a45a9ef-1d8b-46d3-8b50-e00724e8efaa service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:59:44 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-f991b2e7-9b0a-47e0-a32a-2cd6daf8faab req-4a45a9ef-1d8b-46d3-8b50-e00724e8efaa service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:59:44 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-f991b2e7-9b0a-47e0-a32a-2cd6daf8faab req-4a45a9ef-1d8b-46d3-8b50-e00724e8efaa service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:59:44 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-f991b2e7-9b0a-47e0-a32a-2cd6daf8faab req-4a45a9ef-1d8b-46d3-8b50-e00724e8efaa service nova] Creating event network-vif-plugged:b1082a8b-7d77-4850-b76a-a9022c19a4a1 for instance ecc2e555-42ac-4e87-b226-ef708dc26627 on user Apr 19 14:59:44 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [req-f991b2e7-9b0a-47e0-a32a-2cd6daf8faab req-4a45a9ef-1d8b-46d3-8b50-e00724e8efaa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037318 Apr 19 14:59:44 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 119/360] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:59:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:59:52 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell0:SELECT=4 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:59:52 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:59:52 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:59:52 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-2cdd096b-9298-4a83-93a6-788f404aabaf tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:59:52 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-2cdd096b-9298-4a83-93a6-788f404aabaf tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] [instance: 9c330e74-9939-422b-88f6-1958857b6c41] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:59:52 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-2cdd096b-9298-4a83-93a6-788f404aabaf tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:59:52 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-2cdd096b-9298-4a83-93a6-788f404aabaf tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:59:52 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-2cdd096b-9298-4a83-93a6-788f404aabaf tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:59:52 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-2cdd096b-9298-4a83-93a6-788f404aabaf tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:59:52 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-2cdd096b-9298-4a83-93a6-788f404aabaf tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:59:52 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-2cdd096b-9298-4a83-93a6-788f404aabaf tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:59:52 user devstack@n-api.service[61255]: INFO nova.api.openstack.wsgi [None req-2cdd096b-9298-4a83-93a6-788f404aabaf tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] HTTP exception thrown: Instance 9c330e74-9939-422b-88f6-1958857b6c41 could not be found. Apr 19 14:59:52 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-2cdd096b-9298-4a83-93a6-788f404aabaf tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Request method failure captured: Apr 19 14:59:52 user devstack@n-api.service[61255]: request: GET /compute/v2.1/servers/9c330e74-9939-422b-88f6-1958857b6c41 HTTP/1.1 Apr 19 14:59:52 user devstack@n-api.service[61255]: Accept: application/json Apr 19 14:59:52 user devstack@n-api.service[61255]: Accept-Encoding: identity Apr 19 14:59:52 user devstack@n-api.service[61255]: Connection: close Apr 19 14:59:52 user devstack@n-api.service[61255]: Content-Length: 0 Apr 19 14:59:52 user devstack@n-api.service[61255]: Content-Type: application/json Apr 19 14:59:52 user devstack@n-api.service[61255]: Host: 10.0.0.210 Apr 19 14:59:52 user devstack@n-api.service[61255]: Openstack-System-Scope: None Apr 19 14:59:52 user devstack@n-api.service[61255]: User-Agent: python-urllib3/1.26.15 Apr 19 14:59:52 user devstack@n-api.service[61255]: X-Auth-Token: gAAAAABkQABkxMNS_OR07MiE4iEcjY7FZP_ARzM9mRs3rXIh5gejPSL97jmyRWR6bHsF4HQmtxCwY77thUVyVBT6B9jqWqeSVuQQI63qZM_3x5oIlRKDCfYZrzXheXCbXMW4F2ahBIYT2-doi6eU1GgwtuGuHlqCUMbWcsQ-mEhKOFYoCn-g0gE Apr 19 14:59:52 user devstack@n-api.service[61255]: X-Domain-Id: None Apr 19 14:59:52 user devstack@n-api.service[61255]: X-Domain-Name: None Apr 19 14:59:52 user devstack@n-api.service[61255]: X-Identity-Status: Confirmed Apr 19 14:59:52 user devstack@n-api.service[61255]: X-Is-Admin-Project: True Apr 19 14:59:52 user devstack@n-api.service[61255]: X-Project-Domain-Id: default Apr 19 14:59:52 user devstack@n-api.service[61255]: X-Project-Domain-Name: Default Apr 19 14:59:52 user devstack@n-api.service[61255]: X-Project-Id: 8f94be4fa38d44fe84c03b02b09bab0a Apr 19 14:59:52 user devstack@n-api.service[61255]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-343306122 Apr 19 14:59:52 user devstack@n-api.service[61255]: X-Role: member,reader Apr 19 14:59:52 user devstack@n-api.service[61255]: X-Roles: member,reader Apr 19 14:59:52 user devstack@n-api.service[61255]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8f94be4fa38d44fe84c03b02b09bab0a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8f94be4fa38d44fe84c03b02b09bab0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8f94be4fa38d44fe84c03b02b09bab0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 14:59:52 user devstack@n-api.service[61255]: X-Tenant: tempest-ServerRescueNegativeTestJSON-343306122 Apr 19 14:59:52 user devstack@n-api.service[61255]: X-Tenant-Id: 8f94be4fa38d44fe84c03b02b09bab0a Apr 19 14:59:52 user devstack@n-api.service[61255]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-343306122 Apr 19 14:59:52 user devstack@n-api.service[61255]: X-User: tempest-ServerRescueNegativeTestJSON-343306122-project-member Apr 19 14:59:52 user devstack@n-api.service[61255]: X-User-Domain-Id: default Apr 19 14:59:52 user devstack@n-api.service[61255]: X-User-Domain-Name: Default Apr 19 14:59:52 user devstack@n-api.service[61255]: X-User-Id: 8683d0564d7c475c9d26f897e0239640 Apr 19 14:59:52 user devstack@n-api.service[61255]: X-User-Name: tempest-ServerRescueNegativeTestJSON-343306122-project-member Apr 19 14:59:52 user devstack@n-api.service[61255]: method: > Apr 19 14:59:52 user devstack@n-api.service[61255]: exception: Instance 9c330e74-9939-422b-88f6-1958857b6c41 could not be found. Apr 19 14:59:52 user devstack@n-api.service[61255]: action_args: {'id': '9c330e74-9939-422b-88f6-1958857b6c41'} Apr 19 14:59:52 user devstack@n-api.service[61255]: {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:59:52 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:59:52 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:59:52 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:59:52 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:59:52 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:59:52 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:59:52 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:59:52 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:59:52 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:59:52 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c330e74-9939-422b-88f6-1958857b6c41 could not be found. Apr 19 14:59:52 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:59:52 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:59:52 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:59:52 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:59:52 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:59:52 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:59:52 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:59:52 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:59:52 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:59:52 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:59:52 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:59:52 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:59:52 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:59:52 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:59:52 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:59:52 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:59:52 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c330e74-9939-422b-88f6-1958857b6c41 could not be found. Apr 19 14:59:52 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:59:52 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:59:52 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:59:52 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:59:52 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:59:52 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:59:52 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:59:52 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:59:52 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c330e74-9939-422b-88f6-1958857b6c41 could not be found. Apr 19 14:59:52 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 14:59:52 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-2cdd096b-9298-4a83-93a6-788f404aabaf tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] Returning 404 to user: Instance 9c330e74-9939-422b-88f6-1958857b6c41 could not be found. {{(pid=61255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:59:52 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-2cdd096b-9298-4a83-93a6-788f404aabaf tempest-ServerRescueNegativeTestJSON-343306122 tempest-ServerRescueNegativeTestJSON-343306122-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c330e74-9939-422b-88f6-1958857b6c41" status: 404 len: 111 microversion: 2.1 time: 0.038825 Apr 19 14:59:52 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 122/361] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:59:52 2023] GET /compute/v2.1/servers/9c330e74-9939-422b-88f6-1958857b6c41 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:59:55 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell0:SELECT=2 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:59:55 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell0:SELECT=6 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:59:55 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:59:55 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell1:SELECT=14 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:59:55 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-f053d7e6-3944-448c-af1b-8ac280772dc6 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:59:55 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-f053d7e6-3944-448c-af1b-8ac280772dc6 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] [instance: 95058640-8ace-444b-8e6b-685575695a46] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:59:55 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-f053d7e6-3944-448c-af1b-8ac280772dc6 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:59:55 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-f053d7e6-3944-448c-af1b-8ac280772dc6 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:59:55 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-f053d7e6-3944-448c-af1b-8ac280772dc6 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:59:55 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-f053d7e6-3944-448c-af1b-8ac280772dc6 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:59:55 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-f053d7e6-3944-448c-af1b-8ac280772dc6 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:59:55 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-f053d7e6-3944-448c-af1b-8ac280772dc6 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:59:55 user devstack@n-api.service[61253]: INFO nova.api.openstack.wsgi [None req-f053d7e6-3944-448c-af1b-8ac280772dc6 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] HTTP exception thrown: Instance 95058640-8ace-444b-8e6b-685575695a46 could not be found. Apr 19 14:59:55 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-f053d7e6-3944-448c-af1b-8ac280772dc6 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Request method failure captured: Apr 19 14:59:55 user devstack@n-api.service[61253]: request: GET /compute/v2.1/servers/95058640-8ace-444b-8e6b-685575695a46 HTTP/1.1 Apr 19 14:59:55 user devstack@n-api.service[61253]: Accept: application/json Apr 19 14:59:55 user devstack@n-api.service[61253]: Accept-Encoding: identity Apr 19 14:59:55 user devstack@n-api.service[61253]: Connection: close Apr 19 14:59:55 user devstack@n-api.service[61253]: Content-Length: 0 Apr 19 14:59:55 user devstack@n-api.service[61253]: Content-Type: application/json Apr 19 14:59:55 user devstack@n-api.service[61253]: Host: 10.0.0.210 Apr 19 14:59:55 user devstack@n-api.service[61253]: Openstack-System-Scope: None Apr 19 14:59:55 user devstack@n-api.service[61253]: User-Agent: python-urllib3/1.26.15 Apr 19 14:59:55 user devstack@n-api.service[61253]: X-Auth-Token: gAAAAABkP_-41ftQj_8wSAoFbkjOmwhZZoFbhh5figS3gy8Y-8Rr62DKw5pnfvwe3_ePsrBFzQDyXP0nE89w-ekmIB6jyLYgHp7dbA5RtqoBabtEuFUzFLm8IICf13TYAYTMmMrKMqZW2nq03-vXmmLdmC3MxGkuS1Zo6VWlf5dHBSwp9Fet2j8 Apr 19 14:59:55 user devstack@n-api.service[61253]: X-Domain-Id: None Apr 19 14:59:55 user devstack@n-api.service[61253]: X-Domain-Name: None Apr 19 14:59:55 user devstack@n-api.service[61253]: X-Identity-Status: Confirmed Apr 19 14:59:55 user devstack@n-api.service[61253]: X-Is-Admin-Project: True Apr 19 14:59:55 user devstack@n-api.service[61253]: X-Openstack-Nova-Api-Version: 2.87 Apr 19 14:59:55 user devstack@n-api.service[61253]: X-Project-Domain-Id: default Apr 19 14:59:55 user devstack@n-api.service[61253]: X-Project-Domain-Name: Default Apr 19 14:59:55 user devstack@n-api.service[61253]: X-Project-Id: b1bc7474b840449da88a8f420316ecfb Apr 19 14:59:55 user devstack@n-api.service[61253]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1484020474 Apr 19 14:59:55 user devstack@n-api.service[61253]: X-Role: member,reader Apr 19 14:59:55 user devstack@n-api.service[61253]: X-Roles: member,reader Apr 19 14:59:55 user devstack@n-api.service[61253]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b1bc7474b840449da88a8f420316ecfb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b1bc7474b840449da88a8f420316ecfb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b1bc7474b840449da88a8f420316ecfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 14:59:55 user devstack@n-api.service[61253]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1484020474 Apr 19 14:59:55 user devstack@n-api.service[61253]: X-Tenant-Id: b1bc7474b840449da88a8f420316ecfb Apr 19 14:59:55 user devstack@n-api.service[61253]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1484020474 Apr 19 14:59:55 user devstack@n-api.service[61253]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member Apr 19 14:59:55 user devstack@n-api.service[61253]: X-User-Domain-Id: default Apr 19 14:59:55 user devstack@n-api.service[61253]: X-User-Domain-Name: Default Apr 19 14:59:55 user devstack@n-api.service[61253]: X-User-Id: b33dd700a9314ab9a70428a3455a571c Apr 19 14:59:55 user devstack@n-api.service[61253]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member Apr 19 14:59:55 user devstack@n-api.service[61253]: method: > Apr 19 14:59:55 user devstack@n-api.service[61253]: exception: Instance 95058640-8ace-444b-8e6b-685575695a46 could not be found. Apr 19 14:59:55 user devstack@n-api.service[61253]: action_args: {'id': '95058640-8ace-444b-8e6b-685575695a46'} Apr 19 14:59:55 user devstack@n-api.service[61253]: {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:59:55 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:59:55 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:59:55 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:59:55 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:59:55 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:59:55 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:59:55 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:59:55 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:59:55 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:59:55 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95058640-8ace-444b-8e6b-685575695a46 could not be found. Apr 19 14:59:55 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 14:59:55 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:59:55 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 14:59:55 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:59:55 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:59:55 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:59:55 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:59:55 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:59:55 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:59:55 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:59:55 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:59:55 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:59:55 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:59:55 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:59:55 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:59:55 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:59:55 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95058640-8ace-444b-8e6b-685575695a46 could not be found. Apr 19 14:59:55 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 14:59:55 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:59:55 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 14:59:55 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:59:55 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:59:55 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:59:55 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:59:55 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:59:55 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95058640-8ace-444b-8e6b-685575695a46 could not be found. Apr 19 14:59:55 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 14:59:55 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-f053d7e6-3944-448c-af1b-8ac280772dc6 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] Returning 404 to user: Instance 95058640-8ace-444b-8e6b-685575695a46 could not be found. {{(pid=61253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:59:55 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-f053d7e6-3944-448c-af1b-8ac280772dc6 tempest-ServerBootFromVolumeStableRescueTest-1484020474 tempest-ServerBootFromVolumeStableRescueTest-1484020474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95058640-8ace-444b-8e6b-685575695a46" status: 404 len: 111 microversion: 2.87 time: 0.045142 Apr 19 14:59:55 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 121/362] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 14:59:55 2023] GET /compute/v2.1/servers/95058640-8ace-444b-8e6b-685575695a46 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 19 15:00:06 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell0:SELECT=2 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:00:06 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:00:06 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell1:SELECT=2 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:00:06 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-776a3823-22cb-429e-b0c9-a732493d4c91 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1192181801", "imageRef": "283dcfe8-75fd-4917-902e-1b940387187c", "flavorRef": "42", "networks": [{"uuid": "f8d02894-9061-43a1-91e5-a9000d264c9e"}]}} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:00:06 user devstack@n-api.service[61254]: DEBUG nova.network.neutron [None req-776a3823-22cb-429e-b0c9-a732493d4c91 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] validate_networks() for [('f8d02894-9061-43a1-91e5-a9000d264c9e', None, None, None, None, None)] {{(pid=61254) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 15:00:06 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-776a3823-22cb-429e-b0c9-a732493d4c91 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Flavor limits 0:0:0 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 15:00:06 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-776a3823-22cb-429e-b0c9-a732493d4c91 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Image limits 0:0:0 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 15:00:06 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-776a3823-22cb-429e-b0c9-a732493d4c91 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Flavor pref 0:0:0 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 15:00:06 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-776a3823-22cb-429e-b0c9-a732493d4c91 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Image pref 0:0:0 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 15:00:06 user devstack@n-api.service[61254]: DEBUG nova.virt.hardware [None req-776a3823-22cb-429e-b0c9-a732493d4c91 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 15:00:06 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-776a3823-22cb-429e-b0c9-a732493d4c91 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:00:06 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-776a3823-22cb-429e-b0c9-a732493d4c91 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:00:06 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-776a3823-22cb-429e-b0c9-a732493d4c91 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:00:06 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-776a3823-22cb-429e-b0c9-a732493d4c91 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:00:06 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-776a3823-22cb-429e-b0c9-a732493d4c91 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:00:06 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-776a3823-22cb-429e-b0c9-a732493d4c91 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:00:06 user devstack@n-api.service[61254]: DEBUG nova.quota [None req-776a3823-22cb-429e-b0c9-a732493d4c91 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Getting quotas for project 6b55a0da17744d83b432ad3994d1a4b4. Resources: {'ram', 'instances', 'cores'} {{(pid=61254) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:00:06 user devstack@n-api.service[61254]: DEBUG nova.quota [None req-776a3823-22cb-429e-b0c9-a732493d4c91 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Getting quotas for user 88cac3222b6a46af94d475533efdb6a4 and project 6b55a0da17744d83b432ad3994d1a4b4. Resources: {'ram', 'instances', 'cores'} {{(pid=61254) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:00:06 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-776a3823-22cb-429e-b0c9-a732493d4c91 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Going to run 1 instances... {{(pid=61254) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 15:00:06 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-776a3823-22cb-429e-b0c9-a732493d4c91 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] [instance: 99c2d5c6-9b60-4265-9b7c-a3d970df83c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='283dcfe8-75fd-4917-902e-1b940387187c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61254) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 15:00:06 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-776a3823-22cb-429e-b0c9-a732493d4c91 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.910002 Apr 19 15:00:06 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 120/363] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 15:00:06 2023] POST /compute/v2.1/servers => generated 378 bytes in 912 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 15:00:07 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-76469417-d344-44bf-a23e-00736af1c148 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:00:07 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-76469417-d344-44bf-a23e-00736af1c148 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] [instance: 99c2d5c6-9b60-4265-9b7c-a3d970df83c7] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:00:07 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_api:SELECT=2 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:00:07 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell1:SELECT=2 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:00:07 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-76469417-d344-44bf-a23e-00736af1c148 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cac3222b6a46af94d475533efdb6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b55a0da17744d83b432ad3994d1a4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:00:07 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-76469417-d344-44bf-a23e-00736af1c148 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99c2d5c6-9b60-4265-9b7c-a3d970df83c7" status: 200 len: 1211 microversion: 2.1 time: 0.070759 Apr 19 15:00:07 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 123/364] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:00:07 2023] GET /compute/v2.1/servers/99c2d5c6-9b60-4265-9b7c-a3d970df83c7 => generated 1211 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:00:09 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [req-6bf39724-a684-4c9b-b952-ec699a5daf59 req-3e3cb7b0-47af-460d-9e32-24044794b747 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99c2d5c6-9b60-4265-9b7c-a3d970df83c7", "tag": "dc338427-108e-4cf2-8cd9-a1a06bfe1513"}]} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:00:09 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_api:SELECT=2 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:00:09 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell1:SELECT=2 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:00:09 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-6bf39724-a684-4c9b-b952-ec699a5daf59 req-3e3cb7b0-47af-460d-9e32-24044794b747 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:00:09 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-6bf39724-a684-4c9b-b952-ec699a5daf59 req-3e3cb7b0-47af-460d-9e32-24044794b747 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:00:09 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-6bf39724-a684-4c9b-b952-ec699a5daf59 req-3e3cb7b0-47af-460d-9e32-24044794b747 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:00:09 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-6bf39724-a684-4c9b-b952-ec699a5daf59 req-3e3cb7b0-47af-460d-9e32-24044794b747 service nova] Creating event network-changed:dc338427-108e-4cf2-8cd9-a1a06bfe1513 for instance 99c2d5c6-9b60-4265-9b7c-a3d970df83c7 on user Apr 19 15:00:09 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [req-6bf39724-a684-4c9b-b952-ec699a5daf59 req-3e3cb7b0-47af-460d-9e32-24044794b747 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032042 Apr 19 15:00:09 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 122/365] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:00:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:00:11 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [req-ad9049ab-4ab6-4a70-803f-1d48842d06e1 req-c3e9b76c-c7af-48ba-a686-c91c6d8e9325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99c2d5c6-9b60-4265-9b7c-a3d970df83c7", "name": "network-vif-plugged", "status": "completed", "tag": "dc338427-108e-4cf2-8cd9-a1a06bfe1513"}]} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:00:11 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-ad9049ab-4ab6-4a70-803f-1d48842d06e1 req-c3e9b76c-c7af-48ba-a686-c91c6d8e9325 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:00:11 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-ad9049ab-4ab6-4a70-803f-1d48842d06e1 req-c3e9b76c-c7af-48ba-a686-c91c6d8e9325 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:00:11 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-ad9049ab-4ab6-4a70-803f-1d48842d06e1 req-c3e9b76c-c7af-48ba-a686-c91c6d8e9325 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:00:11 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-ad9049ab-4ab6-4a70-803f-1d48842d06e1 req-c3e9b76c-c7af-48ba-a686-c91c6d8e9325 service nova] Creating event network-vif-plugged:dc338427-108e-4cf2-8cd9-a1a06bfe1513 for instance 99c2d5c6-9b60-4265-9b7c-a3d970df83c7 on user Apr 19 15:00:11 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [req-ad9049ab-4ab6-4a70-803f-1d48842d06e1 req-c3e9b76c-c7af-48ba-a686-c91c6d8e9325 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037730 Apr 19 15:00:11 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 121/366] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:00:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:00:13 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-4bf9316e-4ea4-4aa5-8336-55fb44ab9465 req-673aac3a-a4bd-4074-8d9f-6fe3e4cc9442 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99c2d5c6-9b60-4265-9b7c-a3d970df83c7", "name": "network-vif-plugged", "status": "completed", "tag": "dc338427-108e-4cf2-8cd9-a1a06bfe1513"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:00:13 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-4bf9316e-4ea4-4aa5-8336-55fb44ab9465 req-673aac3a-a4bd-4074-8d9f-6fe3e4cc9442 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:00:13 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-4bf9316e-4ea4-4aa5-8336-55fb44ab9465 req-673aac3a-a4bd-4074-8d9f-6fe3e4cc9442 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:00:13 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-4bf9316e-4ea4-4aa5-8336-55fb44ab9465 req-673aac3a-a4bd-4074-8d9f-6fe3e4cc9442 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:00:13 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-4bf9316e-4ea4-4aa5-8336-55fb44ab9465 req-673aac3a-a4bd-4074-8d9f-6fe3e4cc9442 service nova] Creating event network-vif-plugged:dc338427-108e-4cf2-8cd9-a1a06bfe1513 for instance 99c2d5c6-9b60-4265-9b7c-a3d970df83c7 on user Apr 19 15:00:13 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [req-4bf9316e-4ea4-4aa5-8336-55fb44ab9465 req-673aac3a-a4bd-4074-8d9f-6fe3e4cc9442 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028557 Apr 19 15:00:13 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 124/367] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:00:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:00:15 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-ae609e6f-d5c6-42c8-bb17-f29a9b34e613 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:00:15 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-ae609e6f-d5c6-42c8-bb17-f29a9b34e613 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] [instance: 9fee43ad-330a-45d7-9374-07feefcf9e14] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:00:15 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-ae609e6f-d5c6-42c8-bb17-f29a9b34e613 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:00:15 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-ae609e6f-d5c6-42c8-bb17-f29a9b34e613 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:00:15 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-ae609e6f-d5c6-42c8-bb17-f29a9b34e613 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:00:15 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-ae609e6f-d5c6-42c8-bb17-f29a9b34e613 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:00:15 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-ae609e6f-d5c6-42c8-bb17-f29a9b34e613 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:00:15 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-ae609e6f-d5c6-42c8-bb17-f29a9b34e613 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:00:15 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-ae609e6f-d5c6-42c8-bb17-f29a9b34e613 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] [instance: 9fee43ad-330a-45d7-9374-07feefcf9e14] Going to try to terminate instance {{(pid=61253) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 15:00:15 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-ae609e6f-d5c6-42c8-bb17-f29a9b34e613 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9fee43ad-330a-45d7-9374-07feefcf9e14" status: 204 len: 0 microversion: 2.1 time: 0.117682 Apr 19 15:00:15 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 123/368] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 15:00:15 2023] DELETE /compute/v2.1/servers/9fee43ad-330a-45d7-9374-07feefcf9e14 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 15:00:15 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-349ae00f-ba27-4c29-b994-bf32f6770d94 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:00:15 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-349ae00f-ba27-4c29-b994-bf32f6770d94 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] [instance: 9fee43ad-330a-45d7-9374-07feefcf9e14] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:00:15 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-349ae00f-ba27-4c29-b994-bf32f6770d94 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:00:15 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-349ae00f-ba27-4c29-b994-bf32f6770d94 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:00:15 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-349ae00f-ba27-4c29-b994-bf32f6770d94 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:00:15 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-349ae00f-ba27-4c29-b994-bf32f6770d94 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:00:15 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-349ae00f-ba27-4c29-b994-bf32f6770d94 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:00:15 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-349ae00f-ba27-4c29-b994-bf32f6770d94 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:00:15 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-30df0bfb-f52e-462a-93d2-af556350645e req-cc1d190f-1d48-46c1-9770-347718f69418 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fee43ad-330a-45d7-9374-07feefcf9e14", "name": "network-vif-unplugged", "status": "completed", "tag": "08e83784-97d8-4c35-a28e-ab60d1724994"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:00:15 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-30df0bfb-f52e-462a-93d2-af556350645e req-cc1d190f-1d48-46c1-9770-347718f69418 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:00:15 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-30df0bfb-f52e-462a-93d2-af556350645e req-cc1d190f-1d48-46c1-9770-347718f69418 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:00:15 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-30df0bfb-f52e-462a-93d2-af556350645e req-cc1d190f-1d48-46c1-9770-347718f69418 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:00:15 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-30df0bfb-f52e-462a-93d2-af556350645e req-cc1d190f-1d48-46c1-9770-347718f69418 service nova] Creating event network-vif-unplugged:08e83784-97d8-4c35-a28e-ab60d1724994 for instance 9fee43ad-330a-45d7-9374-07feefcf9e14 on user Apr 19 15:00:15 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [req-30df0bfb-f52e-462a-93d2-af556350645e req-cc1d190f-1d48-46c1-9770-347718f69418 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031628 Apr 19 15:00:15 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 125/369] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:00:15 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:00:16 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-349ae00f-ba27-4c29-b994-bf32f6770d94 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aab0b2e3424d80852e588323f187bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dbf312f7154ce1ae7fc1403947d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:00:16 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-349ae00f-ba27-4c29-b994-bf32f6770d94 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9fee43ad-330a-45d7-9374-07feefcf9e14" status: 200 len: 1664 microversion: 2.1 time: 0.592619 Apr 19 15:00:16 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 122/370] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:00:15 2023] GET /compute/v2.1/servers/9fee43ad-330a-45d7-9374-07feefcf9e14 => generated 1664 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:00:17 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [req-ee252571-53ae-4d03-9b88-292382add33f req-6b3628ed-81a5-455c-9aeb-97d7460c5d92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fee43ad-330a-45d7-9374-07feefcf9e14", "name": "network-vif-deleted", "tag": "08e83784-97d8-4c35-a28e-ab60d1724994"}]} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:00:17 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-ee252571-53ae-4d03-9b88-292382add33f req-6b3628ed-81a5-455c-9aeb-97d7460c5d92 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:00:17 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-ee252571-53ae-4d03-9b88-292382add33f req-6b3628ed-81a5-455c-9aeb-97d7460c5d92 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:00:17 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-ee252571-53ae-4d03-9b88-292382add33f req-6b3628ed-81a5-455c-9aeb-97d7460c5d92 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:00:17 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-ee252571-53ae-4d03-9b88-292382add33f req-6b3628ed-81a5-455c-9aeb-97d7460c5d92 service nova] Creating event network-vif-deleted:08e83784-97d8-4c35-a28e-ab60d1724994 for instance 9fee43ad-330a-45d7-9374-07feefcf9e14 on user Apr 19 15:00:17 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [req-ee252571-53ae-4d03-9b88-292382add33f req-6b3628ed-81a5-455c-9aeb-97d7460c5d92 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031220 Apr 19 15:00:17 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 124/371] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:00:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:00:17 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell0:SELECT=2 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:00:17 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-5654c78c-edca-42e7-a114-81b285eee8b8 req-8a69b3df-5bc6-48d1-842f-6dd8020e2167 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fee43ad-330a-45d7-9374-07feefcf9e14", "name": "network-vif-plugged", "status": "completed", "tag": "08e83784-97d8-4c35-a28e-ab60d1724994"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:00:17 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-5654c78c-edca-42e7-a114-81b285eee8b8 req-8a69b3df-5bc6-48d1-842f-6dd8020e2167 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:00:17 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-5654c78c-edca-42e7-a114-81b285eee8b8 req-8a69b3df-5bc6-48d1-842f-6dd8020e2167 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:00:17 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-5654c78c-edca-42e7-a114-81b285eee8b8 req-8a69b3df-5bc6-48d1-842f-6dd8020e2167 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:00:17 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-5654c78c-edca-42e7-a114-81b285eee8b8 req-8a69b3df-5bc6-48d1-842f-6dd8020e2167 service nova] Creating event network-vif-plugged:08e83784-97d8-4c35-a28e-ab60d1724994 for instance 9fee43ad-330a-45d7-9374-07feefcf9e14 on user Apr 19 15:00:17 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [req-5654c78c-edca-42e7-a114-81b285eee8b8 req-8a69b3df-5bc6-48d1-842f-6dd8020e2167 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033643 Apr 19 15:00:17 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 126/372] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:00:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:00:20 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell0:SELECT=2 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:00:20 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell0:SELECT=6 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:00:20 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-7509ba54-b86c-48a7-8d64-29e9b68b9181 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:00:20 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-7509ba54-b86c-48a7-8d64-29e9b68b9181 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] [instance: 4dee286e-96ba-4b45-a572-d1e098807b8a] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:00:20 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-7509ba54-b86c-48a7-8d64-29e9b68b9181 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:00:20 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-7509ba54-b86c-48a7-8d64-29e9b68b9181 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:00:20 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-7509ba54-b86c-48a7-8d64-29e9b68b9181 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:00:20 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-7509ba54-b86c-48a7-8d64-29e9b68b9181 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:00:20 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-7509ba54-b86c-48a7-8d64-29e9b68b9181 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:00:20 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-7509ba54-b86c-48a7-8d64-29e9b68b9181 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:00:20 user devstack@n-api.service[61254]: INFO nova.api.openstack.wsgi [None req-7509ba54-b86c-48a7-8d64-29e9b68b9181 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] HTTP exception thrown: Instance 4dee286e-96ba-4b45-a572-d1e098807b8a could not be found. Apr 19 15:00:20 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-7509ba54-b86c-48a7-8d64-29e9b68b9181 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Request method failure captured: Apr 19 15:00:20 user devstack@n-api.service[61254]: request: GET /compute/v2.1/servers/4dee286e-96ba-4b45-a572-d1e098807b8a HTTP/1.1 Apr 19 15:00:20 user devstack@n-api.service[61254]: Accept: application/json Apr 19 15:00:20 user devstack@n-api.service[61254]: Accept-Encoding: identity Apr 19 15:00:20 user devstack@n-api.service[61254]: Connection: close Apr 19 15:00:20 user devstack@n-api.service[61254]: Content-Length: 0 Apr 19 15:00:20 user devstack@n-api.service[61254]: Content-Type: application/json Apr 19 15:00:20 user devstack@n-api.service[61254]: Host: 10.0.0.210 Apr 19 15:00:20 user devstack@n-api.service[61254]: Openstack-System-Scope: None Apr 19 15:00:20 user devstack@n-api.service[61254]: User-Agent: python-urllib3/1.26.15 Apr 19 15:00:20 user devstack@n-api.service[61254]: X-Auth-Token: gAAAAABkQACxmegrNJiWVT35GxEagPyQ4xQ5EFPOgXNstcz_xzkPFhG6oC7nb9e4tGtZSpXZ1UiQE2brJZKAQpDrcU0fggbuRHwlOEcX_G8j8BHmJp3x6QE68GgMLQZt_XfokputrzZTNm9jjXtzXSq0NU3dlpaqf-KMdGGF2XBoFAFMeKZfDKM Apr 19 15:00:20 user devstack@n-api.service[61254]: X-Domain-Id: None Apr 19 15:00:20 user devstack@n-api.service[61254]: X-Domain-Name: None Apr 19 15:00:20 user devstack@n-api.service[61254]: X-Identity-Status: Confirmed Apr 19 15:00:20 user devstack@n-api.service[61254]: X-Is-Admin-Project: True Apr 19 15:00:20 user devstack@n-api.service[61254]: X-Project-Domain-Id: default Apr 19 15:00:20 user devstack@n-api.service[61254]: X-Project-Domain-Name: Default Apr 19 15:00:20 user devstack@n-api.service[61254]: X-Project-Id: 3c121e3e3fa440d8a2e1c3e42975a9a1 Apr 19 15:00:20 user devstack@n-api.service[61254]: X-Project-Name: tempest-TestMinimumBasicScenario-107520977 Apr 19 15:00:20 user devstack@n-api.service[61254]: X-Role: member,reader Apr 19 15:00:20 user devstack@n-api.service[61254]: X-Roles: member,reader Apr 19 15:00:20 user devstack@n-api.service[61254]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3c121e3e3fa440d8a2e1c3e42975a9a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3c121e3e3fa440d8a2e1c3e42975a9a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3c121e3e3fa440d8a2e1c3e42975a9a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 15:00:20 user devstack@n-api.service[61254]: X-Tenant: tempest-TestMinimumBasicScenario-107520977 Apr 19 15:00:20 user devstack@n-api.service[61254]: X-Tenant-Id: 3c121e3e3fa440d8a2e1c3e42975a9a1 Apr 19 15:00:20 user devstack@n-api.service[61254]: X-Tenant-Name: tempest-TestMinimumBasicScenario-107520977 Apr 19 15:00:20 user devstack@n-api.service[61254]: X-User: tempest-TestMinimumBasicScenario-107520977-project-member Apr 19 15:00:20 user devstack@n-api.service[61254]: X-User-Domain-Id: default Apr 19 15:00:20 user devstack@n-api.service[61254]: X-User-Domain-Name: Default Apr 19 15:00:20 user devstack@n-api.service[61254]: X-User-Id: 7e2985fabe974b80a37af599e28c8fbb Apr 19 15:00:20 user devstack@n-api.service[61254]: X-User-Name: tempest-TestMinimumBasicScenario-107520977-project-member Apr 19 15:00:20 user devstack@n-api.service[61254]: method: > Apr 19 15:00:20 user devstack@n-api.service[61254]: exception: Instance 4dee286e-96ba-4b45-a572-d1e098807b8a could not be found. Apr 19 15:00:20 user devstack@n-api.service[61254]: action_args: {'id': '4dee286e-96ba-4b45-a572-d1e098807b8a'} Apr 19 15:00:20 user devstack@n-api.service[61254]: {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:00:20 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:00:20 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:00:20 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:00:20 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:00:20 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:00:20 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:00:20 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:00:20 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:00:20 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:00:20 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dee286e-96ba-4b45-a572-d1e098807b8a could not be found. Apr 19 15:00:20 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 15:00:20 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:00:20 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 15:00:20 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:00:20 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:00:20 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:00:20 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:00:20 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:00:20 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:00:20 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:00:20 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 15:00:20 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 15:00:20 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:00:20 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:00:20 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:00:20 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:00:20 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dee286e-96ba-4b45-a572-d1e098807b8a could not be found. Apr 19 15:00:20 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 15:00:20 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:00:20 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 15:00:20 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:00:20 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:00:20 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:00:20 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:00:20 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:00:20 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dee286e-96ba-4b45-a572-d1e098807b8a could not be found. Apr 19 15:00:20 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 15:00:20 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-7509ba54-b86c-48a7-8d64-29e9b68b9181 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Returning 404 to user: Instance 4dee286e-96ba-4b45-a572-d1e098807b8a could not be found. {{(pid=61254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:00:20 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-7509ba54-b86c-48a7-8d64-29e9b68b9181 tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4dee286e-96ba-4b45-a572-d1e098807b8a" status: 404 len: 111 microversion: 2.1 time: 0.179558 Apr 19 15:00:20 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 123/373] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:00:20 2023] GET /compute/v2.1/servers/4dee286e-96ba-4b45-a572-d1e098807b8a => generated 111 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 15:00:20 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-0d6f996c-c0ae-4fde-b238-b471ed4257ff tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] Calling method '.version_select at 0x7f3cfa8b6dd0>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:00:20 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-0d6f996c-c0ae-4fde-b238-b471ed4257ff tempest-TestMinimumBasicScenario-107520977 tempest-TestMinimumBasicScenario-107520977-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1582209514" status: 202 len: 0 microversion: 2.1 time: 0.020465 Apr 19 15:00:20 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 125/374] 10.0.0.210 () {62 vars in 1349 bytes} [Wed Apr 19 15:00:20 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1582209514 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 15:00:27 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-c2b316d0-2b95-49ac-be3c-d8c6bd951193 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:00:27 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-c2b316d0-2b95-49ac-be3c-d8c6bd951193 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] [instance: ecc2e555-42ac-4e87-b226-ef708dc26627] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:00:27 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-c2b316d0-2b95-49ac-be3c-d8c6bd951193 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:00:27 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-c2b316d0-2b95-49ac-be3c-d8c6bd951193 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:00:27 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-c2b316d0-2b95-49ac-be3c-d8c6bd951193 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:00:27 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-c2b316d0-2b95-49ac-be3c-d8c6bd951193 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:00:27 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-c2b316d0-2b95-49ac-be3c-d8c6bd951193 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:00:27 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-c2b316d0-2b95-49ac-be3c-d8c6bd951193 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:00:28 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-c2b316d0-2b95-49ac-be3c-d8c6bd951193 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b23f0d7300496990e74b2fb4945c15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5079ce8a52417fb2b8b8122bfeaa5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:00:28 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-c2b316d0-2b95-49ac-be3c-d8c6bd951193 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ecc2e555-42ac-4e87-b226-ef708dc26627" status: 200 len: 1544 microversion: 2.1 time: 0.471960 Apr 19 15:00:28 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 127/375] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:00:27 2023] GET /compute/v2.1/servers/ecc2e555-42ac-4e87-b226-ef708dc26627 => generated 1544 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:00:57 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-1d2a0b51-da00-4649-ad3f-74ff646fac4a tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:00:57 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-1d2a0b51-da00-4649-ad3f-74ff646fac4a tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] [instance: 99c2d5c6-9b60-4265-9b7c-a3d970df83c7] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:00:57 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:00:57 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell1:SELECT=12 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:00:57 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-1d2a0b51-da00-4649-ad3f-74ff646fac4a tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:00:57 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-1d2a0b51-da00-4649-ad3f-74ff646fac4a tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:00:57 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-1d2a0b51-da00-4649-ad3f-74ff646fac4a tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:00:57 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-1d2a0b51-da00-4649-ad3f-74ff646fac4a tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:00:57 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-1d2a0b51-da00-4649-ad3f-74ff646fac4a tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:00:57 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-1d2a0b51-da00-4649-ad3f-74ff646fac4a tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:00:57 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-1d2a0b51-da00-4649-ad3f-74ff646fac4a tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cac3222b6a46af94d475533efdb6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b55a0da17744d83b432ad3994d1a4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:00:57 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-1d2a0b51-da00-4649-ad3f-74ff646fac4a tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99c2d5c6-9b60-4265-9b7c-a3d970df83c7" status: 200 len: 1494 microversion: 2.1 time: 0.275251 Apr 19 15:00:57 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 124/376] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:00:57 2023] GET /compute/v2.1/servers/99c2d5c6-9b60-4265-9b7c-a3d970df83c7 => generated 1494 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:01:06 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:01:06 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:01:06 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-821aa012-4f92-4520-bda3-68ade9da28f6 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:01:06 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-821aa012-4f92-4520-bda3-68ade9da28f6 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] [instance: 9fee43ad-330a-45d7-9374-07feefcf9e14] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:01:06 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-821aa012-4f92-4520-bda3-68ade9da28f6 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:01:06 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-821aa012-4f92-4520-bda3-68ade9da28f6 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:01:06 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-821aa012-4f92-4520-bda3-68ade9da28f6 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:01:06 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-821aa012-4f92-4520-bda3-68ade9da28f6 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:01:06 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-821aa012-4f92-4520-bda3-68ade9da28f6 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:01:06 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-821aa012-4f92-4520-bda3-68ade9da28f6 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:01:06 user devstack@n-api.service[61253]: INFO nova.api.openstack.wsgi [None req-821aa012-4f92-4520-bda3-68ade9da28f6 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] HTTP exception thrown: Instance 9fee43ad-330a-45d7-9374-07feefcf9e14 could not be found. Apr 19 15:01:06 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-821aa012-4f92-4520-bda3-68ade9da28f6 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Request method failure captured: Apr 19 15:01:06 user devstack@n-api.service[61253]: request: GET /compute/v2.1/servers/9fee43ad-330a-45d7-9374-07feefcf9e14 HTTP/1.1 Apr 19 15:01:06 user devstack@n-api.service[61253]: Accept: application/json Apr 19 15:01:06 user devstack@n-api.service[61253]: Accept-Encoding: identity Apr 19 15:01:06 user devstack@n-api.service[61253]: Connection: close Apr 19 15:01:06 user devstack@n-api.service[61253]: Content-Length: 0 Apr 19 15:01:06 user devstack@n-api.service[61253]: Content-Type: application/json Apr 19 15:01:06 user devstack@n-api.service[61253]: Host: 10.0.0.210 Apr 19 15:01:06 user devstack@n-api.service[61253]: Openstack-System-Scope: None Apr 19 15:01:06 user devstack@n-api.service[61253]: User-Agent: python-urllib3/1.26.15 Apr 19 15:01:06 user devstack@n-api.service[61253]: X-Auth-Token: gAAAAABkP__owZqyjiE4QBHlkva92d2a3XKizVtUiDdtQzfeOQBv_iLCZFq4aieDoZNCmhNoyYn-f2xyuDV1Q-ffwBWezZq-JgsKQIFa2s28svJhqijaC2qrPvgaLoajWNxj2zCWgFYZ0spi6zFXx7KGXq00T3Cm2X0lx_rsnv0ZBvLWIWqditc Apr 19 15:01:06 user devstack@n-api.service[61253]: X-Domain-Id: None Apr 19 15:01:06 user devstack@n-api.service[61253]: X-Domain-Name: None Apr 19 15:01:06 user devstack@n-api.service[61253]: X-Identity-Status: Confirmed Apr 19 15:01:06 user devstack@n-api.service[61253]: X-Is-Admin-Project: True Apr 19 15:01:06 user devstack@n-api.service[61253]: X-Project-Domain-Id: default Apr 19 15:01:06 user devstack@n-api.service[61253]: X-Project-Domain-Name: Default Apr 19 15:01:06 user devstack@n-api.service[61253]: X-Project-Id: 07dbf312f7154ce1ae7fc1403947d51c Apr 19 15:01:06 user devstack@n-api.service[61253]: X-Project-Name: tempest-ServerActionsTestJSON-155031228 Apr 19 15:01:06 user devstack@n-api.service[61253]: X-Role: member,reader Apr 19 15:01:06 user devstack@n-api.service[61253]: X-Roles: member,reader Apr 19 15:01:06 user devstack@n-api.service[61253]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/07dbf312f7154ce1ae7fc1403947d51c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/07dbf312f7154ce1ae7fc1403947d51c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/07dbf312f7154ce1ae7fc1403947d51c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 15:01:06 user devstack@n-api.service[61253]: X-Tenant: tempest-ServerActionsTestJSON-155031228 Apr 19 15:01:06 user devstack@n-api.service[61253]: X-Tenant-Id: 07dbf312f7154ce1ae7fc1403947d51c Apr 19 15:01:06 user devstack@n-api.service[61253]: X-Tenant-Name: tempest-ServerActionsTestJSON-155031228 Apr 19 15:01:06 user devstack@n-api.service[61253]: X-User: tempest-ServerActionsTestJSON-155031228-project-member Apr 19 15:01:06 user devstack@n-api.service[61253]: X-User-Domain-Id: default Apr 19 15:01:06 user devstack@n-api.service[61253]: X-User-Domain-Name: Default Apr 19 15:01:06 user devstack@n-api.service[61253]: X-User-Id: 59aab0b2e3424d80852e588323f187bb Apr 19 15:01:06 user devstack@n-api.service[61253]: X-User-Name: tempest-ServerActionsTestJSON-155031228-project-member Apr 19 15:01:06 user devstack@n-api.service[61253]: method: > Apr 19 15:01:06 user devstack@n-api.service[61253]: exception: Instance 9fee43ad-330a-45d7-9374-07feefcf9e14 could not be found. Apr 19 15:01:06 user devstack@n-api.service[61253]: action_args: {'id': '9fee43ad-330a-45d7-9374-07feefcf9e14'} Apr 19 15:01:06 user devstack@n-api.service[61253]: {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:01:06 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:01:06 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:01:06 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:01:06 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:01:06 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:01:06 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:01:06 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:01:06 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:01:06 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:01:06 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fee43ad-330a-45d7-9374-07feefcf9e14 could not be found. Apr 19 15:01:06 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 15:01:06 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:01:06 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 15:01:06 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:01:06 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:01:06 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:01:06 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:01:06 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:01:06 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:01:06 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:01:06 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 15:01:06 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 15:01:06 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:01:06 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:01:06 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:01:06 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:01:06 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fee43ad-330a-45d7-9374-07feefcf9e14 could not be found. Apr 19 15:01:06 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 15:01:06 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:01:06 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 15:01:06 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:01:06 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:01:06 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:01:06 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:01:06 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:01:06 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fee43ad-330a-45d7-9374-07feefcf9e14 could not be found. Apr 19 15:01:06 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 15:01:06 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-821aa012-4f92-4520-bda3-68ade9da28f6 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Returning 404 to user: Instance 9fee43ad-330a-45d7-9374-07feefcf9e14 could not be found. {{(pid=61253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:01:06 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-821aa012-4f92-4520-bda3-68ade9da28f6 tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9fee43ad-330a-45d7-9374-07feefcf9e14" status: 404 len: 111 microversion: 2.1 time: 0.035577 Apr 19 15:01:06 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 126/377] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:01:06 2023] GET /compute/v2.1/servers/9fee43ad-330a-45d7-9374-07feefcf9e14 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 15:01:06 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-fbf9df66-b839-4777-8aad-384147e9719a tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] Calling method '.version_select at 0x7f3cfa9c2290>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:01:06 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_api:SELECT=12 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:01:06 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell1:SELECT=12 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:01:06 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-fbf9df66-b839-4777-8aad-384147e9719a tempest-ServerActionsTestJSON-155031228 tempest-ServerActionsTestJSON-155031228-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1240204617" status: 202 len: 0 microversion: 2.1 time: 0.024787 Apr 19 15:01:06 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 128/378] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 19 15:01:06 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1240204617 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 15:01:16 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_api:SELECT=2 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:01:16 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell1:SELECT=6 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:01:17 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-fc5852a6-e652-455f-b820-87057be7398f tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Action: 'create', calling method: .version_select at 0x7f3cfa8c6560>, body: {"keypair": {"name": "tempest-keypair-677154477", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjpJHieYxsROxoLkczqyanmWDMU2MFvXS0Vosv6bEvcEQlco1tZS1fGutl1M5MG0VmcnTNn5zgXqxGJGByWq374Z3xnJOFQUrIvuSlX89z45oCw6a3EYo5BJAOJLkPJeA=="}} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:01:17 user devstack@n-api.service[61254]: DEBUG nova.quota [None req-fc5852a6-e652-455f-b820-87057be7398f tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Getting quotas for project ccc36f2d52844dc090a6c23e0f14d9a9. Resources: {'key_pairs'} {{(pid=61254) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:01:17 user devstack@n-api.service[61254]: DEBUG nova.quota [None req-fc5852a6-e652-455f-b820-87057be7398f tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Getting quotas for user 6f765d12fe234d0a9df2aa1f12e71b9d and project ccc36f2d52844dc090a6c23e0f14d9a9. Resources: {'key_pairs'} {{(pid=61254) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:01:17 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-fc5852a6-e652-455f-b820-87057be7398f tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.137064 Apr 19 15:01:17 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 125/379] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 19 15:01:16 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 138 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 19 15:01:18 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-d90c0142-c034-4698-92bc-61252097cbc4 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-235550226", "imageRef": "283dcfe8-75fd-4917-902e-1b940387187c", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "755c650f-2b5a-4ab1-bd77-7ba3366afde4"}], "security_groups": [{"name": "tempest-securitygroup--861680688"}], "key_name": "tempest-keypair-677154477", "user_data": "}} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:01:18 user devstack@n-api.service[61253]: DEBUG nova.network.neutron [None req-d90c0142-c034-4698-92bc-61252097cbc4 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] validate_networks() for [('755c650f-2b5a-4ab1-bd77-7ba3366afde4', None, None, None, None, None)] {{(pid=61253) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 15:01:19 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-d90c0142-c034-4698-92bc-61252097cbc4 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Flavor limits 0:0:0 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 15:01:19 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-d90c0142-c034-4698-92bc-61252097cbc4 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Image limits 0:0:0 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 15:01:19 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-d90c0142-c034-4698-92bc-61252097cbc4 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Flavor pref 0:0:0 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 15:01:19 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-d90c0142-c034-4698-92bc-61252097cbc4 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Image pref 0:0:0 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 15:01:19 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-d90c0142-c034-4698-92bc-61252097cbc4 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 15:01:19 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-d90c0142-c034-4698-92bc-61252097cbc4 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:01:19 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-d90c0142-c034-4698-92bc-61252097cbc4 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:01:19 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-d90c0142-c034-4698-92bc-61252097cbc4 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:01:19 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-d90c0142-c034-4698-92bc-61252097cbc4 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:01:19 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-d90c0142-c034-4698-92bc-61252097cbc4 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:01:19 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-d90c0142-c034-4698-92bc-61252097cbc4 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:01:19 user devstack@n-api.service[61253]: DEBUG nova.quota [None req-d90c0142-c034-4698-92bc-61252097cbc4 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Getting quotas for project ccc36f2d52844dc090a6c23e0f14d9a9. Resources: {'ram', 'instances', 'cores'} {{(pid=61253) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:01:19 user devstack@n-api.service[61253]: DEBUG nova.quota [None req-d90c0142-c034-4698-92bc-61252097cbc4 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Getting quotas for user 6f765d12fe234d0a9df2aa1f12e71b9d and project ccc36f2d52844dc090a6c23e0f14d9a9. Resources: {'ram', 'instances', 'cores'} {{(pid=61253) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:01:19 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-d90c0142-c034-4698-92bc-61252097cbc4 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Going to run 1 instances... {{(pid=61253) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 15:01:19 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-d90c0142-c034-4698-92bc-61252097cbc4 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] [instance: b0637e45-4a13-4970-b933-7c5fc5b84fff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='283dcfe8-75fd-4917-902e-1b940387187c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61253) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 15:01:19 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-d90c0142-c034-4698-92bc-61252097cbc4 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.770707 Apr 19 15:01:19 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 127/380] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 19 15:01:18 2023] POST /compute/v2.1/servers => generated 399 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 19 15:01:19 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:01:19 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-5da98e49-edee-4aec-b4ac-2a27619f7849 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:01:19 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-5da98e49-edee-4aec-b4ac-2a27619f7849 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] [instance: b0637e45-4a13-4970-b933-7c5fc5b84fff] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:01:19 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-5da98e49-edee-4aec-b4ac-2a27619f7849 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f765d12fe234d0a9df2aa1f12e71b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc36f2d52844dc090a6c23e0f14d9a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:01:19 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-5da98e49-edee-4aec-b4ac-2a27619f7849 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f765d12fe234d0a9df2aa1f12e71b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc36f2d52844dc090a6c23e0f14d9a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:01:19 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-5da98e49-edee-4aec-b4ac-2a27619f7849 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f765d12fe234d0a9df2aa1f12e71b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc36f2d52844dc090a6c23e0f14d9a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:01:19 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-5da98e49-edee-4aec-b4ac-2a27619f7849 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0637e45-4a13-4970-b933-7c5fc5b84fff" status: 200 len: 1274 microversion: 2.20 time: 0.065494 Apr 19 15:01:19 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 129/381] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 15:01:19 2023] GET /compute/v2.1/servers/b0637e45-4a13-4970-b933-7c5fc5b84fff => generated 1274 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 15:01:21 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [req-b7a5e54b-ccc2-4209-8826-61ea8611089c req-1a932d70-0b7b-48c0-9b63-ae02775e137c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0637e45-4a13-4970-b933-7c5fc5b84fff", "tag": "8e93daaa-f7d2-4e80-8f8a-090c3d859877"}]} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:01:21 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-b7a5e54b-ccc2-4209-8826-61ea8611089c req-1a932d70-0b7b-48c0-9b63-ae02775e137c service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:01:21 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-b7a5e54b-ccc2-4209-8826-61ea8611089c req-1a932d70-0b7b-48c0-9b63-ae02775e137c service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:01:21 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-b7a5e54b-ccc2-4209-8826-61ea8611089c req-1a932d70-0b7b-48c0-9b63-ae02775e137c service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:01:21 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-b7a5e54b-ccc2-4209-8826-61ea8611089c req-1a932d70-0b7b-48c0-9b63-ae02775e137c service nova] Creating event network-changed:8e93daaa-f7d2-4e80-8f8a-090c3d859877 for instance b0637e45-4a13-4970-b933-7c5fc5b84fff on user Apr 19 15:01:21 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [req-b7a5e54b-ccc2-4209-8826-61ea8611089c req-1a932d70-0b7b-48c0-9b63-ae02775e137c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085586 Apr 19 15:01:21 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 126/382] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:01:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:01:23 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [req-4e24c79f-13e0-4cb8-aa0b-687d82d36fae req-cf3bd6b4-7700-4352-9f2c-b4f9d1209d12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0637e45-4a13-4970-b933-7c5fc5b84fff", "name": "network-vif-plugged", "status": "completed", "tag": "8e93daaa-f7d2-4e80-8f8a-090c3d859877"}]} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:01:23 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-4e24c79f-13e0-4cb8-aa0b-687d82d36fae req-cf3bd6b4-7700-4352-9f2c-b4f9d1209d12 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:01:23 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-4e24c79f-13e0-4cb8-aa0b-687d82d36fae req-cf3bd6b4-7700-4352-9f2c-b4f9d1209d12 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:01:23 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-4e24c79f-13e0-4cb8-aa0b-687d82d36fae req-cf3bd6b4-7700-4352-9f2c-b4f9d1209d12 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:01:23 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-4e24c79f-13e0-4cb8-aa0b-687d82d36fae req-cf3bd6b4-7700-4352-9f2c-b4f9d1209d12 service nova] Creating event network-vif-plugged:8e93daaa-f7d2-4e80-8f8a-090c3d859877 for instance b0637e45-4a13-4970-b933-7c5fc5b84fff on user Apr 19 15:01:23 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [req-4e24c79f-13e0-4cb8-aa0b-687d82d36fae req-cf3bd6b4-7700-4352-9f2c-b4f9d1209d12 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039948 Apr 19 15:01:23 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 128/383] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:01:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:01:25 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-acd9c3c4-a2b9-4784-b474-f81bb2d434d0 req-33b58cbe-c546-4578-9343-d0d4f3c3a14d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0637e45-4a13-4970-b933-7c5fc5b84fff", "name": "network-vif-plugged", "status": "completed", "tag": "8e93daaa-f7d2-4e80-8f8a-090c3d859877"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:01:25 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-acd9c3c4-a2b9-4784-b474-f81bb2d434d0 req-33b58cbe-c546-4578-9343-d0d4f3c3a14d service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:01:25 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-acd9c3c4-a2b9-4784-b474-f81bb2d434d0 req-33b58cbe-c546-4578-9343-d0d4f3c3a14d service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:01:25 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-acd9c3c4-a2b9-4784-b474-f81bb2d434d0 req-33b58cbe-c546-4578-9343-d0d4f3c3a14d service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:01:25 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-acd9c3c4-a2b9-4784-b474-f81bb2d434d0 req-33b58cbe-c546-4578-9343-d0d4f3c3a14d service nova] Creating event network-vif-plugged:8e93daaa-f7d2-4e80-8f8a-090c3d859877 for instance b0637e45-4a13-4970-b933-7c5fc5b84fff on user Apr 19 15:01:25 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [req-acd9c3c4-a2b9-4784-b474-f81bb2d434d0 req-33b58cbe-c546-4578-9343-d0d4f3c3a14d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030601 Apr 19 15:01:25 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 130/384] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:01:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:01:28 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell0:SELECT=4 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:01:28 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-5095f607-1bc1-4c88-8249-50cf5b26501d tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:01:28 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-5095f607-1bc1-4c88-8249-50cf5b26501d tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] [instance: ecc2e555-42ac-4e87-b226-ef708dc26627] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:01:28 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-5095f607-1bc1-4c88-8249-50cf5b26501d tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:01:28 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-5095f607-1bc1-4c88-8249-50cf5b26501d tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:01:28 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-5095f607-1bc1-4c88-8249-50cf5b26501d tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:01:28 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-5095f607-1bc1-4c88-8249-50cf5b26501d tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:01:28 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-5095f607-1bc1-4c88-8249-50cf5b26501d tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:01:28 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-5095f607-1bc1-4c88-8249-50cf5b26501d tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:01:28 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-5095f607-1bc1-4c88-8249-50cf5b26501d tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ecc2e555-42ac-4e87-b226-ef708dc26627/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.184968 Apr 19 15:01:28 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 127/385] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 15:01:28 2023] GET /compute/v2.1/servers/ecc2e555-42ac-4e87-b226-ef708dc26627/os-interface => generated 282 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:01:29 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell0:SELECT=2 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:01:29 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell0:SELECT=6 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:01:29 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [req-2526bdcf-b90c-4650-8802-1402ef715136 req-38eca66d-5cb3-4b50-a512-329b8688ade6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecc2e555-42ac-4e87-b226-ef708dc26627", "tag": "b1082a8b-7d77-4850-b76a-a9022c19a4a1"}]} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:01:29 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-2526bdcf-b90c-4650-8802-1402ef715136 req-38eca66d-5cb3-4b50-a512-329b8688ade6 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:01:29 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-2526bdcf-b90c-4650-8802-1402ef715136 req-38eca66d-5cb3-4b50-a512-329b8688ade6 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:01:29 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-2526bdcf-b90c-4650-8802-1402ef715136 req-38eca66d-5cb3-4b50-a512-329b8688ade6 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:01:29 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-2526bdcf-b90c-4650-8802-1402ef715136 req-38eca66d-5cb3-4b50-a512-329b8688ade6 service nova] Creating event network-changed:b1082a8b-7d77-4850-b76a-a9022c19a4a1 for instance ecc2e555-42ac-4e87-b226-ef708dc26627 on user Apr 19 15:01:29 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [req-2526bdcf-b90c-4650-8802-1402ef715136 req-38eca66d-5cb3-4b50-a512-329b8688ade6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032508 Apr 19 15:01:29 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 129/386] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:01:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:01:29 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-b3dc0e77-a39e-4837-8b0e-27828adba0e4 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:01:29 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-b3dc0e77-a39e-4837-8b0e-27828adba0e4 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] [instance: ecc2e555-42ac-4e87-b226-ef708dc26627] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:01:29 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-b3dc0e77-a39e-4837-8b0e-27828adba0e4 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:01:29 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-b3dc0e77-a39e-4837-8b0e-27828adba0e4 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:01:29 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-b3dc0e77-a39e-4837-8b0e-27828adba0e4 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:01:29 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-b3dc0e77-a39e-4837-8b0e-27828adba0e4 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:01:29 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-b3dc0e77-a39e-4837-8b0e-27828adba0e4 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:01:29 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-b3dc0e77-a39e-4837-8b0e-27828adba0e4 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:01:29 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-b3dc0e77-a39e-4837-8b0e-27828adba0e4 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ecc2e555-42ac-4e87-b226-ef708dc26627/ips" status: 200 len: 107 microversion: 2.1 time: 0.036931 Apr 19 15:01:29 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 131/387] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 19 15:01:29 2023] GET /compute/v2.1/servers/ecc2e555-42ac-4e87-b226-ef708dc26627/ips => generated 107 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:01:30 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-5b58cddd-8634-4525-9c75-e2fefd0db4a6 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:01:30 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-5b58cddd-8634-4525-9c75-e2fefd0db4a6 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] [instance: ecc2e555-42ac-4e87-b226-ef708dc26627] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:01:30 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-5b58cddd-8634-4525-9c75-e2fefd0db4a6 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:01:30 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-5b58cddd-8634-4525-9c75-e2fefd0db4a6 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:01:30 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-5b58cddd-8634-4525-9c75-e2fefd0db4a6 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:01:30 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-5b58cddd-8634-4525-9c75-e2fefd0db4a6 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:01:30 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-5b58cddd-8634-4525-9c75-e2fefd0db4a6 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:01:30 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-5b58cddd-8634-4525-9c75-e2fefd0db4a6 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:01:30 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-5b58cddd-8634-4525-9c75-e2fefd0db4a6 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] [instance: ecc2e555-42ac-4e87-b226-ef708dc26627] Going to try to terminate instance {{(pid=61254) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 15:01:30 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-5b58cddd-8634-4525-9c75-e2fefd0db4a6 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ecc2e555-42ac-4e87-b226-ef708dc26627" status: 204 len: 0 microversion: 2.1 time: 0.105705 Apr 19 15:01:30 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 128/388] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 15:01:30 2023] DELETE /compute/v2.1/servers/ecc2e555-42ac-4e87-b226-ef708dc26627 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 15:01:30 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-ac3518a0-b466-4def-bdd6-2ca0b54f80e2 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:01:30 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-ac3518a0-b466-4def-bdd6-2ca0b54f80e2 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] [instance: ecc2e555-42ac-4e87-b226-ef708dc26627] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:01:30 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-ac3518a0-b466-4def-bdd6-2ca0b54f80e2 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:01:30 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-ac3518a0-b466-4def-bdd6-2ca0b54f80e2 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:01:30 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-ac3518a0-b466-4def-bdd6-2ca0b54f80e2 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:01:30 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-ac3518a0-b466-4def-bdd6-2ca0b54f80e2 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:01:30 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-ac3518a0-b466-4def-bdd6-2ca0b54f80e2 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:01:30 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-ac3518a0-b466-4def-bdd6-2ca0b54f80e2 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:01:31 user devstack@n-api.service[61253]: DEBUG nova.policy [None req-ac3518a0-b466-4def-bdd6-2ca0b54f80e2 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b23f0d7300496990e74b2fb4945c15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5079ce8a52417fb2b8b8122bfeaa5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61253) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:01:31 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-ac3518a0-b466-4def-bdd6-2ca0b54f80e2 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ecc2e555-42ac-4e87-b226-ef708dc26627" status: 200 len: 1668 microversion: 2.1 time: 0.335892 Apr 19 15:01:31 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 130/389] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:01:30 2023] GET /compute/v2.1/servers/ecc2e555-42ac-4e87-b226-ef708dc26627 => generated 1668 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:01:31 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-b8cf0ccf-aec3-4b2f-9719-f5bdf69cf4af req-2e9b3ccf-a912-4b5d-b913-82676292e6fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecc2e555-42ac-4e87-b226-ef708dc26627", "name": "network-vif-unplugged", "status": "completed", "tag": "b1082a8b-7d77-4850-b76a-a9022c19a4a1"}, {"server_uuid": "ecc2e555-42ac-4e87-b226-ef708dc26627", "name": "network-vif-plugged", "status": "completed", "tag": "b1082a8b-7d77-4850-b76a-a9022c19a4a1"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:01:31 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell0:SELECT=2 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:01:31 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-b8cf0ccf-aec3-4b2f-9719-f5bdf69cf4af req-2e9b3ccf-a912-4b5d-b913-82676292e6fd service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:01:31 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-b8cf0ccf-aec3-4b2f-9719-f5bdf69cf4af req-2e9b3ccf-a912-4b5d-b913-82676292e6fd service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:01:31 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-b8cf0ccf-aec3-4b2f-9719-f5bdf69cf4af req-2e9b3ccf-a912-4b5d-b913-82676292e6fd service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:01:31 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-b8cf0ccf-aec3-4b2f-9719-f5bdf69cf4af req-2e9b3ccf-a912-4b5d-b913-82676292e6fd service nova] Creating event network-vif-unplugged:b1082a8b-7d77-4850-b76a-a9022c19a4a1 for instance ecc2e555-42ac-4e87-b226-ef708dc26627 on user Apr 19 15:01:31 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-b8cf0ccf-aec3-4b2f-9719-f5bdf69cf4af req-2e9b3ccf-a912-4b5d-b913-82676292e6fd service nova] Creating event network-vif-plugged:b1082a8b-7d77-4850-b76a-a9022c19a4a1 for instance ecc2e555-42ac-4e87-b226-ef708dc26627 on user Apr 19 15:01:31 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [req-b8cf0ccf-aec3-4b2f-9719-f5bdf69cf4af req-2e9b3ccf-a912-4b5d-b913-82676292e6fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.028484 Apr 19 15:01:31 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 132/390] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:01:31 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:01:32 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [req-458a5da2-5ed2-4a91-b0cb-f3d9c440febf req-da2a7733-a385-496b-8892-fa86143bfcac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecc2e555-42ac-4e87-b226-ef708dc26627", "name": "network-vif-deleted", "tag": "b1082a8b-7d77-4850-b76a-a9022c19a4a1"}]} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:01:32 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-458a5da2-5ed2-4a91-b0cb-f3d9c440febf req-da2a7733-a385-496b-8892-fa86143bfcac service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:01:32 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-458a5da2-5ed2-4a91-b0cb-f3d9c440febf req-da2a7733-a385-496b-8892-fa86143bfcac service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:01:32 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-458a5da2-5ed2-4a91-b0cb-f3d9c440febf req-da2a7733-a385-496b-8892-fa86143bfcac service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:01:32 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-458a5da2-5ed2-4a91-b0cb-f3d9c440febf req-da2a7733-a385-496b-8892-fa86143bfcac service nova] Creating event network-vif-deleted:b1082a8b-7d77-4850-b76a-a9022c19a4a1 for instance ecc2e555-42ac-4e87-b226-ef708dc26627 on user Apr 19 15:01:32 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [req-458a5da2-5ed2-4a91-b0cb-f3d9c440febf req-da2a7733-a385-496b-8892-fa86143bfcac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033899 Apr 19 15:01:32 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 129/391] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:01:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:01:57 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-eec1e5c7-6d83-4cb7-a03b-81f4dd1441f1 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1200678555", "imageRef": "283dcfe8-75fd-4917-902e-1b940387187c", "flavorRef": "42", "networks": [{"uuid": "f8d02894-9061-43a1-91e5-a9000d264c9e"}]}} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:01:57 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:01:57 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell1:SELECT=14 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:01:57 user devstack@n-api.service[61253]: DEBUG nova.network.neutron [None req-eec1e5c7-6d83-4cb7-a03b-81f4dd1441f1 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] validate_networks() for [('f8d02894-9061-43a1-91e5-a9000d264c9e', None, None, None, None, None)] {{(pid=61253) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 15:01:58 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-eec1e5c7-6d83-4cb7-a03b-81f4dd1441f1 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Flavor limits 0:0:0 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 15:01:58 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-eec1e5c7-6d83-4cb7-a03b-81f4dd1441f1 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Image limits 0:0:0 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 15:01:58 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-eec1e5c7-6d83-4cb7-a03b-81f4dd1441f1 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Flavor pref 0:0:0 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 15:01:58 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-eec1e5c7-6d83-4cb7-a03b-81f4dd1441f1 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Image pref 0:0:0 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 15:01:58 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-eec1e5c7-6d83-4cb7-a03b-81f4dd1441f1 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 15:01:58 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-eec1e5c7-6d83-4cb7-a03b-81f4dd1441f1 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:01:58 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-eec1e5c7-6d83-4cb7-a03b-81f4dd1441f1 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:01:58 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-eec1e5c7-6d83-4cb7-a03b-81f4dd1441f1 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:01:58 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-eec1e5c7-6d83-4cb7-a03b-81f4dd1441f1 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:01:58 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-eec1e5c7-6d83-4cb7-a03b-81f4dd1441f1 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:01:58 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-eec1e5c7-6d83-4cb7-a03b-81f4dd1441f1 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:01:58 user devstack@n-api.service[61253]: DEBUG nova.quota [None req-eec1e5c7-6d83-4cb7-a03b-81f4dd1441f1 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Getting quotas for project 6b55a0da17744d83b432ad3994d1a4b4. Resources: {'ram', 'instances', 'cores'} {{(pid=61253) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:01:58 user devstack@n-api.service[61253]: DEBUG nova.quota [None req-eec1e5c7-6d83-4cb7-a03b-81f4dd1441f1 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Getting quotas for user 88cac3222b6a46af94d475533efdb6a4 and project 6b55a0da17744d83b432ad3994d1a4b4. Resources: {'ram', 'instances', 'cores'} {{(pid=61253) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:01:58 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-eec1e5c7-6d83-4cb7-a03b-81f4dd1441f1 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Going to run 1 instances... {{(pid=61253) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 15:01:58 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-eec1e5c7-6d83-4cb7-a03b-81f4dd1441f1 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] [instance: 6e7ecd24-b21a-40f1-aea3-e87104f260bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='283dcfe8-75fd-4917-902e-1b940387187c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61253) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 15:01:58 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-eec1e5c7-6d83-4cb7-a03b-81f4dd1441f1 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.603582 Apr 19 15:01:58 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 131/392] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 15:01:57 2023] POST /compute/v2.1/servers => generated 378 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 15:01:58 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_api:SELECT=10 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:01:58 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell1:SELECT=8 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:01:58 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-f8d42aab-9835-4311-9ca6-e9d9b79f2af6 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:01:58 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-f8d42aab-9835-4311-9ca6-e9d9b79f2af6 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] [instance: 6e7ecd24-b21a-40f1-aea3-e87104f260bf] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:01:58 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-f8d42aab-9835-4311-9ca6-e9d9b79f2af6 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cac3222b6a46af94d475533efdb6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b55a0da17744d83b432ad3994d1a4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:01:58 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-f8d42aab-9835-4311-9ca6-e9d9b79f2af6 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e7ecd24-b21a-40f1-aea3-e87104f260bf" status: 200 len: 1211 microversion: 2.1 time: 0.081604 Apr 19 15:01:58 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 133/393] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:01:58 2023] GET /compute/v2.1/servers/6e7ecd24-b21a-40f1-aea3-e87104f260bf => generated 1211 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:02:00 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:02:00 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:02:00 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [req-375c4e03-5203-4f67-baa0-1fe26ebe8fae req-a12c4d0b-8070-4331-a164-93c817e6bc03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e7ecd24-b21a-40f1-aea3-e87104f260bf", "tag": "380f6e57-62e7-4c8e-ae8a-4a08584a4070"}]} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:02:00 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-375c4e03-5203-4f67-baa0-1fe26ebe8fae req-a12c4d0b-8070-4331-a164-93c817e6bc03 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:02:00 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-375c4e03-5203-4f67-baa0-1fe26ebe8fae req-a12c4d0b-8070-4331-a164-93c817e6bc03 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:02:00 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-375c4e03-5203-4f67-baa0-1fe26ebe8fae req-a12c4d0b-8070-4331-a164-93c817e6bc03 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:02:00 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-375c4e03-5203-4f67-baa0-1fe26ebe8fae req-a12c4d0b-8070-4331-a164-93c817e6bc03 service nova] Creating event network-changed:380f6e57-62e7-4c8e-ae8a-4a08584a4070 for instance 6e7ecd24-b21a-40f1-aea3-e87104f260bf on user Apr 19 15:02:00 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [req-375c4e03-5203-4f67-baa0-1fe26ebe8fae req-a12c4d0b-8070-4331-a164-93c817e6bc03 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038820 Apr 19 15:02:00 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 130/394] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:02:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:02:02 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [req-5e0d84c1-5d43-48a7-976d-81508d4fdc06 req-22ffb74e-712d-4eb6-94d9-7564457716e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e7ecd24-b21a-40f1-aea3-e87104f260bf", "name": "network-vif-plugged", "status": "completed", "tag": "380f6e57-62e7-4c8e-ae8a-4a08584a4070"}]} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:02:02 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-5e0d84c1-5d43-48a7-976d-81508d4fdc06 req-22ffb74e-712d-4eb6-94d9-7564457716e5 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:02:02 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-5e0d84c1-5d43-48a7-976d-81508d4fdc06 req-22ffb74e-712d-4eb6-94d9-7564457716e5 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:02:02 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-5e0d84c1-5d43-48a7-976d-81508d4fdc06 req-22ffb74e-712d-4eb6-94d9-7564457716e5 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:02:02 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-5e0d84c1-5d43-48a7-976d-81508d4fdc06 req-22ffb74e-712d-4eb6-94d9-7564457716e5 service nova] Creating event network-vif-plugged:380f6e57-62e7-4c8e-ae8a-4a08584a4070 for instance 6e7ecd24-b21a-40f1-aea3-e87104f260bf on user Apr 19 15:02:02 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [req-5e0d84c1-5d43-48a7-976d-81508d4fdc06 req-22ffb74e-712d-4eb6-94d9-7564457716e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131481 Apr 19 15:02:02 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 132/395] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:02:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:02:04 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-d43031e4-c392-4503-bac5-a3a384f991f4 req-885e1f8e-74ef-40c1-8de0-2dfceac966bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e7ecd24-b21a-40f1-aea3-e87104f260bf", "name": "network-vif-plugged", "status": "completed", "tag": "380f6e57-62e7-4c8e-ae8a-4a08584a4070"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:02:04 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-d43031e4-c392-4503-bac5-a3a384f991f4 req-885e1f8e-74ef-40c1-8de0-2dfceac966bc service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:02:04 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-d43031e4-c392-4503-bac5-a3a384f991f4 req-885e1f8e-74ef-40c1-8de0-2dfceac966bc service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:02:04 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-d43031e4-c392-4503-bac5-a3a384f991f4 req-885e1f8e-74ef-40c1-8de0-2dfceac966bc service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:02:04 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-d43031e4-c392-4503-bac5-a3a384f991f4 req-885e1f8e-74ef-40c1-8de0-2dfceac966bc service nova] Creating event network-vif-plugged:380f6e57-62e7-4c8e-ae8a-4a08584a4070 for instance 6e7ecd24-b21a-40f1-aea3-e87104f260bf on user Apr 19 15:02:04 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [req-d43031e4-c392-4503-bac5-a3a384f991f4 req-885e1f8e-74ef-40c1-8de0-2dfceac966bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027875 Apr 19 15:02:04 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 134/396] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:02:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:02:09 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-84cf5cff-37c6-401d-9e14-99302e741fe6 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:02:09 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-84cf5cff-37c6-401d-9e14-99302e741fe6 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] [instance: b0637e45-4a13-4970-b933-7c5fc5b84fff] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:02:09 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-84cf5cff-37c6-401d-9e14-99302e741fe6 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:02:09 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-84cf5cff-37c6-401d-9e14-99302e741fe6 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:02:09 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-84cf5cff-37c6-401d-9e14-99302e741fe6 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:02:09 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-84cf5cff-37c6-401d-9e14-99302e741fe6 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:02:09 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-84cf5cff-37c6-401d-9e14-99302e741fe6 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:02:09 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-84cf5cff-37c6-401d-9e14-99302e741fe6 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:02:09 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-84cf5cff-37c6-401d-9e14-99302e741fe6 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f765d12fe234d0a9df2aa1f12e71b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc36f2d52844dc090a6c23e0f14d9a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:02:09 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-84cf5cff-37c6-401d-9e14-99302e741fe6 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f765d12fe234d0a9df2aa1f12e71b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc36f2d52844dc090a6c23e0f14d9a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:02:09 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-84cf5cff-37c6-401d-9e14-99302e741fe6 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f765d12fe234d0a9df2aa1f12e71b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc36f2d52844dc090a6c23e0f14d9a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:02:09 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-84cf5cff-37c6-401d-9e14-99302e741fe6 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0637e45-4a13-4970-b933-7c5fc5b84fff" status: 200 len: 1585 microversion: 2.20 time: 0.251645 Apr 19 15:02:09 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 131/397] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 15:02:09 2023] GET /compute/v2.1/servers/b0637e45-4a13-4970-b933-7c5fc5b84fff => generated 1585 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 15:02:21 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell0:SELECT=2 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:02:21 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell0:SELECT=6 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:02:21 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:02:21 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell1:SELECT=4 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:02:21 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-502cae25-2640-4d0f-9942-5980719bebc9 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:02:21 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-502cae25-2640-4d0f-9942-5980719bebc9 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] [instance: ecc2e555-42ac-4e87-b226-ef708dc26627] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:02:21 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-502cae25-2640-4d0f-9942-5980719bebc9 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:02:21 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-502cae25-2640-4d0f-9942-5980719bebc9 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:02:21 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-502cae25-2640-4d0f-9942-5980719bebc9 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:02:21 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-502cae25-2640-4d0f-9942-5980719bebc9 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:02:21 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-502cae25-2640-4d0f-9942-5980719bebc9 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:02:21 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-502cae25-2640-4d0f-9942-5980719bebc9 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:02:21 user devstack@n-api.service[61253]: INFO nova.api.openstack.wsgi [None req-502cae25-2640-4d0f-9942-5980719bebc9 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] HTTP exception thrown: Instance ecc2e555-42ac-4e87-b226-ef708dc26627 could not be found. Apr 19 15:02:21 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-502cae25-2640-4d0f-9942-5980719bebc9 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Request method failure captured: Apr 19 15:02:21 user devstack@n-api.service[61253]: request: GET /compute/v2.1/servers/ecc2e555-42ac-4e87-b226-ef708dc26627 HTTP/1.1 Apr 19 15:02:21 user devstack@n-api.service[61253]: Accept: application/json Apr 19 15:02:21 user devstack@n-api.service[61253]: Accept-Encoding: identity Apr 19 15:02:21 user devstack@n-api.service[61253]: Connection: close Apr 19 15:02:21 user devstack@n-api.service[61253]: Content-Length: 0 Apr 19 15:02:21 user devstack@n-api.service[61253]: Content-Type: application/json Apr 19 15:02:21 user devstack@n-api.service[61253]: Host: 10.0.0.210 Apr 19 15:02:21 user devstack@n-api.service[61253]: Openstack-System-Scope: None Apr 19 15:02:21 user devstack@n-api.service[61253]: User-Agent: python-urllib3/1.26.15 Apr 19 15:02:21 user devstack@n-api.service[61253]: X-Auth-Token: gAAAAABkQACJPl0P3yXKrMRibG79Hqp658in8va3b56MSx-w2zVdHzowg8aIK2QJzNaAu2nYCKOP0EC45n1JzRmkaqYpH8h-BaJQguDeBnVkMVS-0kmTwe8oxShNFbvWV7tvu9Eck7mAYMIZN8Q8WAD_N1YEUOjIIrn9-SU9eVgT8lsH3ldOGl4 Apr 19 15:02:21 user devstack@n-api.service[61253]: X-Domain-Id: None Apr 19 15:02:21 user devstack@n-api.service[61253]: X-Domain-Name: None Apr 19 15:02:21 user devstack@n-api.service[61253]: X-Identity-Status: Confirmed Apr 19 15:02:21 user devstack@n-api.service[61253]: X-Is-Admin-Project: True Apr 19 15:02:21 user devstack@n-api.service[61253]: X-Project-Domain-Id: default Apr 19 15:02:21 user devstack@n-api.service[61253]: X-Project-Domain-Name: Default Apr 19 15:02:21 user devstack@n-api.service[61253]: X-Project-Id: 9a5079ce8a52417fb2b8b8122bfeaa5e Apr 19 15:02:21 user devstack@n-api.service[61253]: X-Project-Name: tempest-AttachVolumeNegativeTest-68783932 Apr 19 15:02:21 user devstack@n-api.service[61253]: X-Role: member,reader Apr 19 15:02:21 user devstack@n-api.service[61253]: X-Roles: member,reader Apr 19 15:02:21 user devstack@n-api.service[61253]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9a5079ce8a52417fb2b8b8122bfeaa5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9a5079ce8a52417fb2b8b8122bfeaa5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9a5079ce8a52417fb2b8b8122bfeaa5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 15:02:21 user devstack@n-api.service[61253]: X-Tenant: tempest-AttachVolumeNegativeTest-68783932 Apr 19 15:02:21 user devstack@n-api.service[61253]: X-Tenant-Id: 9a5079ce8a52417fb2b8b8122bfeaa5e Apr 19 15:02:21 user devstack@n-api.service[61253]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-68783932 Apr 19 15:02:21 user devstack@n-api.service[61253]: X-User: tempest-AttachVolumeNegativeTest-68783932-project-member Apr 19 15:02:21 user devstack@n-api.service[61253]: X-User-Domain-Id: default Apr 19 15:02:21 user devstack@n-api.service[61253]: X-User-Domain-Name: Default Apr 19 15:02:21 user devstack@n-api.service[61253]: X-User-Id: 35b23f0d7300496990e74b2fb4945c15 Apr 19 15:02:21 user devstack@n-api.service[61253]: X-User-Name: tempest-AttachVolumeNegativeTest-68783932-project-member Apr 19 15:02:21 user devstack@n-api.service[61253]: method: > Apr 19 15:02:21 user devstack@n-api.service[61253]: exception: Instance ecc2e555-42ac-4e87-b226-ef708dc26627 could not be found. Apr 19 15:02:21 user devstack@n-api.service[61253]: action_args: {'id': 'ecc2e555-42ac-4e87-b226-ef708dc26627'} Apr 19 15:02:21 user devstack@n-api.service[61253]: {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:02:21 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:02:21 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:02:21 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:02:21 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:02:21 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:02:21 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:02:21 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:02:21 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:02:21 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:02:21 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecc2e555-42ac-4e87-b226-ef708dc26627 could not be found. Apr 19 15:02:21 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 15:02:21 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:02:21 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 15:02:21 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:02:21 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:02:21 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:02:21 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:02:21 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:02:21 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:02:21 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:02:21 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 15:02:21 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 15:02:21 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:02:21 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:02:21 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:02:21 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:02:21 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecc2e555-42ac-4e87-b226-ef708dc26627 could not be found. Apr 19 15:02:21 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 15:02:21 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:02:21 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 15:02:21 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:02:21 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:02:21 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:02:21 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:02:21 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:02:21 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecc2e555-42ac-4e87-b226-ef708dc26627 could not be found. Apr 19 15:02:21 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 15:02:21 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-502cae25-2640-4d0f-9942-5980719bebc9 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Returning 404 to user: Instance ecc2e555-42ac-4e87-b226-ef708dc26627 could not be found. {{(pid=61253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:02:21 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-502cae25-2640-4d0f-9942-5980719bebc9 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ecc2e555-42ac-4e87-b226-ef708dc26627" status: 404 len: 111 microversion: 2.1 time: 0.036130 Apr 19 15:02:21 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 133/398] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:02:21 2023] GET /compute/v2.1/servers/ecc2e555-42ac-4e87-b226-ef708dc26627 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 15:02:21 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell0:SELECT=2 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:02:21 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_api:SELECT=6 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:02:21 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell1:SELECT=2 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:02:21 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-40a5b1d9-596e-4008-8608-1f0345e80872 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Calling method '.version_select at 0x7f3cfa9c2170>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:02:21 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-40a5b1d9-596e-4008-8608-1f0345e80872 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-513937092" status: 202 len: 0 microversion: 2.1 time: 0.028049 Apr 19 15:02:21 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 135/399] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 19 15:02:21 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-513937092 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 15:02:22 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-923dd4a4-2f82-4d2f-bca0-ccf22f4e73f5 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:02:22 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-923dd4a4-2f82-4d2f-bca0-ccf22f4e73f5 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] [instance: ecc2e555-42ac-4e87-b226-ef708dc26627] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:02:22 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_api:SELECT=4 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:02:22 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell1:SELECT=8 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:02:22 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-923dd4a4-2f82-4d2f-bca0-ccf22f4e73f5 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:02:22 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-923dd4a4-2f82-4d2f-bca0-ccf22f4e73f5 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:02:22 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-923dd4a4-2f82-4d2f-bca0-ccf22f4e73f5 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:02:22 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-923dd4a4-2f82-4d2f-bca0-ccf22f4e73f5 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:02:22 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-923dd4a4-2f82-4d2f-bca0-ccf22f4e73f5 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:02:22 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-923dd4a4-2f82-4d2f-bca0-ccf22f4e73f5 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:02:22 user devstack@n-api.service[61254]: INFO nova.api.openstack.wsgi [None req-923dd4a4-2f82-4d2f-bca0-ccf22f4e73f5 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] HTTP exception thrown: Instance ecc2e555-42ac-4e87-b226-ef708dc26627 could not be found. Apr 19 15:02:22 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-923dd4a4-2f82-4d2f-bca0-ccf22f4e73f5 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Request method failure captured: Apr 19 15:02:22 user devstack@n-api.service[61254]: request: DELETE /compute/v2.1/servers/ecc2e555-42ac-4e87-b226-ef708dc26627 HTTP/1.1 Apr 19 15:02:22 user devstack@n-api.service[61254]: Accept: application/json Apr 19 15:02:22 user devstack@n-api.service[61254]: Accept-Encoding: identity Apr 19 15:02:22 user devstack@n-api.service[61254]: Connection: close Apr 19 15:02:22 user devstack@n-api.service[61254]: Content-Length: 0 Apr 19 15:02:22 user devstack@n-api.service[61254]: Content-Type: application/json Apr 19 15:02:22 user devstack@n-api.service[61254]: Host: 10.0.0.210 Apr 19 15:02:22 user devstack@n-api.service[61254]: Openstack-System-Scope: None Apr 19 15:02:22 user devstack@n-api.service[61254]: User-Agent: python-urllib3/1.26.15 Apr 19 15:02:22 user devstack@n-api.service[61254]: X-Auth-Token: gAAAAABkQACJPl0P3yXKrMRibG79Hqp658in8va3b56MSx-w2zVdHzowg8aIK2QJzNaAu2nYCKOP0EC45n1JzRmkaqYpH8h-BaJQguDeBnVkMVS-0kmTwe8oxShNFbvWV7tvu9Eck7mAYMIZN8Q8WAD_N1YEUOjIIrn9-SU9eVgT8lsH3ldOGl4 Apr 19 15:02:22 user devstack@n-api.service[61254]: X-Domain-Id: None Apr 19 15:02:22 user devstack@n-api.service[61254]: X-Domain-Name: None Apr 19 15:02:22 user devstack@n-api.service[61254]: X-Identity-Status: Confirmed Apr 19 15:02:22 user devstack@n-api.service[61254]: X-Is-Admin-Project: True Apr 19 15:02:22 user devstack@n-api.service[61254]: X-Project-Domain-Id: default Apr 19 15:02:22 user devstack@n-api.service[61254]: X-Project-Domain-Name: Default Apr 19 15:02:22 user devstack@n-api.service[61254]: X-Project-Id: 9a5079ce8a52417fb2b8b8122bfeaa5e Apr 19 15:02:22 user devstack@n-api.service[61254]: X-Project-Name: tempest-AttachVolumeNegativeTest-68783932 Apr 19 15:02:22 user devstack@n-api.service[61254]: X-Role: member,reader Apr 19 15:02:22 user devstack@n-api.service[61254]: X-Roles: member,reader Apr 19 15:02:22 user devstack@n-api.service[61254]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9a5079ce8a52417fb2b8b8122bfeaa5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9a5079ce8a52417fb2b8b8122bfeaa5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9a5079ce8a52417fb2b8b8122bfeaa5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 15:02:22 user devstack@n-api.service[61254]: X-Tenant: tempest-AttachVolumeNegativeTest-68783932 Apr 19 15:02:22 user devstack@n-api.service[61254]: X-Tenant-Id: 9a5079ce8a52417fb2b8b8122bfeaa5e Apr 19 15:02:22 user devstack@n-api.service[61254]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-68783932 Apr 19 15:02:22 user devstack@n-api.service[61254]: X-User: tempest-AttachVolumeNegativeTest-68783932-project-member Apr 19 15:02:22 user devstack@n-api.service[61254]: X-User-Domain-Id: default Apr 19 15:02:22 user devstack@n-api.service[61254]: X-User-Domain-Name: Default Apr 19 15:02:22 user devstack@n-api.service[61254]: X-User-Id: 35b23f0d7300496990e74b2fb4945c15 Apr 19 15:02:22 user devstack@n-api.service[61254]: X-User-Name: tempest-AttachVolumeNegativeTest-68783932-project-member Apr 19 15:02:22 user devstack@n-api.service[61254]: method: > Apr 19 15:02:22 user devstack@n-api.service[61254]: exception: Instance ecc2e555-42ac-4e87-b226-ef708dc26627 could not be found. Apr 19 15:02:22 user devstack@n-api.service[61254]: action_args: {'id': 'ecc2e555-42ac-4e87-b226-ef708dc26627'} Apr 19 15:02:22 user devstack@n-api.service[61254]: {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecc2e555-42ac-4e87-b226-ef708dc26627 could not be found. Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecc2e555-42ac-4e87-b226-ef708dc26627 could not be found. Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecc2e555-42ac-4e87-b226-ef708dc26627 could not be found. Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 15:02:22 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-923dd4a4-2f82-4d2f-bca0-ccf22f4e73f5 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Returning 404 to user: Instance ecc2e555-42ac-4e87-b226-ef708dc26627 could not be found. {{(pid=61254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:02:22 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-923dd4a4-2f82-4d2f-bca0-ccf22f4e73f5 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ecc2e555-42ac-4e87-b226-ef708dc26627" status: 404 len: 111 microversion: 2.1 time: 0.033551 Apr 19 15:02:22 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 132/400] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 15:02:22 2023] DELETE /compute/v2.1/servers/ecc2e555-42ac-4e87-b226-ef708dc26627 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 15:02:22 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-4e740749-d4a2-4872-8c87-23dcbe0622bf tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:02:22 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-4e740749-d4a2-4872-8c87-23dcbe0622bf tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] [instance: ecc2e555-42ac-4e87-b226-ef708dc26627] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:02:22 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-4e740749-d4a2-4872-8c87-23dcbe0622bf tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:02:22 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-4e740749-d4a2-4872-8c87-23dcbe0622bf tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:02:22 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-4e740749-d4a2-4872-8c87-23dcbe0622bf tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:02:22 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-4e740749-d4a2-4872-8c87-23dcbe0622bf tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:02:22 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-4e740749-d4a2-4872-8c87-23dcbe0622bf tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:02:22 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-4e740749-d4a2-4872-8c87-23dcbe0622bf tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:02:22 user devstack@n-api.service[61253]: INFO nova.api.openstack.wsgi [None req-4e740749-d4a2-4872-8c87-23dcbe0622bf tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] HTTP exception thrown: Instance ecc2e555-42ac-4e87-b226-ef708dc26627 could not be found. Apr 19 15:02:22 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-4e740749-d4a2-4872-8c87-23dcbe0622bf tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Request method failure captured: Apr 19 15:02:22 user devstack@n-api.service[61253]: request: GET /compute/v2.1/servers/ecc2e555-42ac-4e87-b226-ef708dc26627 HTTP/1.1 Apr 19 15:02:22 user devstack@n-api.service[61253]: Accept: application/json Apr 19 15:02:22 user devstack@n-api.service[61253]: Accept-Encoding: identity Apr 19 15:02:22 user devstack@n-api.service[61253]: Connection: close Apr 19 15:02:22 user devstack@n-api.service[61253]: Content-Length: 0 Apr 19 15:02:22 user devstack@n-api.service[61253]: Content-Type: application/json Apr 19 15:02:22 user devstack@n-api.service[61253]: Host: 10.0.0.210 Apr 19 15:02:22 user devstack@n-api.service[61253]: Openstack-System-Scope: None Apr 19 15:02:22 user devstack@n-api.service[61253]: User-Agent: python-urllib3/1.26.15 Apr 19 15:02:22 user devstack@n-api.service[61253]: X-Auth-Token: gAAAAABkQACJPl0P3yXKrMRibG79Hqp658in8va3b56MSx-w2zVdHzowg8aIK2QJzNaAu2nYCKOP0EC45n1JzRmkaqYpH8h-BaJQguDeBnVkMVS-0kmTwe8oxShNFbvWV7tvu9Eck7mAYMIZN8Q8WAD_N1YEUOjIIrn9-SU9eVgT8lsH3ldOGl4 Apr 19 15:02:22 user devstack@n-api.service[61253]: X-Domain-Id: None Apr 19 15:02:22 user devstack@n-api.service[61253]: X-Domain-Name: None Apr 19 15:02:22 user devstack@n-api.service[61253]: X-Identity-Status: Confirmed Apr 19 15:02:22 user devstack@n-api.service[61253]: X-Is-Admin-Project: True Apr 19 15:02:22 user devstack@n-api.service[61253]: X-Project-Domain-Id: default Apr 19 15:02:22 user devstack@n-api.service[61253]: X-Project-Domain-Name: Default Apr 19 15:02:22 user devstack@n-api.service[61253]: X-Project-Id: 9a5079ce8a52417fb2b8b8122bfeaa5e Apr 19 15:02:22 user devstack@n-api.service[61253]: X-Project-Name: tempest-AttachVolumeNegativeTest-68783932 Apr 19 15:02:22 user devstack@n-api.service[61253]: X-Role: member,reader Apr 19 15:02:22 user devstack@n-api.service[61253]: X-Roles: member,reader Apr 19 15:02:22 user devstack@n-api.service[61253]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9a5079ce8a52417fb2b8b8122bfeaa5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9a5079ce8a52417fb2b8b8122bfeaa5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9a5079ce8a52417fb2b8b8122bfeaa5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 15:02:22 user devstack@n-api.service[61253]: X-Tenant: tempest-AttachVolumeNegativeTest-68783932 Apr 19 15:02:22 user devstack@n-api.service[61253]: X-Tenant-Id: 9a5079ce8a52417fb2b8b8122bfeaa5e Apr 19 15:02:22 user devstack@n-api.service[61253]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-68783932 Apr 19 15:02:22 user devstack@n-api.service[61253]: X-User: tempest-AttachVolumeNegativeTest-68783932-project-member Apr 19 15:02:22 user devstack@n-api.service[61253]: X-User-Domain-Id: default Apr 19 15:02:22 user devstack@n-api.service[61253]: X-User-Domain-Name: Default Apr 19 15:02:22 user devstack@n-api.service[61253]: X-User-Id: 35b23f0d7300496990e74b2fb4945c15 Apr 19 15:02:22 user devstack@n-api.service[61253]: X-User-Name: tempest-AttachVolumeNegativeTest-68783932-project-member Apr 19 15:02:22 user devstack@n-api.service[61253]: method: > Apr 19 15:02:22 user devstack@n-api.service[61253]: exception: Instance ecc2e555-42ac-4e87-b226-ef708dc26627 could not be found. Apr 19 15:02:22 user devstack@n-api.service[61253]: action_args: {'id': 'ecc2e555-42ac-4e87-b226-ef708dc26627'} Apr 19 15:02:22 user devstack@n-api.service[61253]: {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecc2e555-42ac-4e87-b226-ef708dc26627 could not be found. Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecc2e555-42ac-4e87-b226-ef708dc26627 could not be found. Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecc2e555-42ac-4e87-b226-ef708dc26627 could not be found. Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 15:02:22 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-4e740749-d4a2-4872-8c87-23dcbe0622bf tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Returning 404 to user: Instance ecc2e555-42ac-4e87-b226-ef708dc26627 could not be found. {{(pid=61253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:02:22 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-4e740749-d4a2-4872-8c87-23dcbe0622bf tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ecc2e555-42ac-4e87-b226-ef708dc26627" status: 404 len: 111 microversion: 2.1 time: 0.028636 Apr 19 15:02:22 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 134/401] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:02:22 2023] GET /compute/v2.1/servers/ecc2e555-42ac-4e87-b226-ef708dc26627 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 15:02:22 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-de53f2e1-ec7e-48f6-bb43-169a4dfdcac3 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:02:22 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-de53f2e1-ec7e-48f6-bb43-169a4dfdcac3 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] [instance: 25a11d52-4c81-46e5-925d-ba88df6dfdff] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:02:22 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-de53f2e1-ec7e-48f6-bb43-169a4dfdcac3 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:02:22 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-de53f2e1-ec7e-48f6-bb43-169a4dfdcac3 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:02:22 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-de53f2e1-ec7e-48f6-bb43-169a4dfdcac3 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:02:22 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-de53f2e1-ec7e-48f6-bb43-169a4dfdcac3 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:02:22 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-de53f2e1-ec7e-48f6-bb43-169a4dfdcac3 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:02:22 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-de53f2e1-ec7e-48f6-bb43-169a4dfdcac3 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:02:22 user devstack@n-api.service[61255]: INFO nova.api.openstack.wsgi [None req-de53f2e1-ec7e-48f6-bb43-169a4dfdcac3 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] HTTP exception thrown: Instance 25a11d52-4c81-46e5-925d-ba88df6dfdff could not be found. Apr 19 15:02:22 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-de53f2e1-ec7e-48f6-bb43-169a4dfdcac3 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Request method failure captured: Apr 19 15:02:22 user devstack@n-api.service[61255]: request: DELETE /compute/v2.1/servers/25a11d52-4c81-46e5-925d-ba88df6dfdff HTTP/1.1 Apr 19 15:02:22 user devstack@n-api.service[61255]: Accept: application/json Apr 19 15:02:22 user devstack@n-api.service[61255]: Accept-Encoding: identity Apr 19 15:02:22 user devstack@n-api.service[61255]: Connection: close Apr 19 15:02:22 user devstack@n-api.service[61255]: Content-Length: 0 Apr 19 15:02:22 user devstack@n-api.service[61255]: Content-Type: application/json Apr 19 15:02:22 user devstack@n-api.service[61255]: Host: 10.0.0.210 Apr 19 15:02:22 user devstack@n-api.service[61255]: Openstack-System-Scope: None Apr 19 15:02:22 user devstack@n-api.service[61255]: User-Agent: python-urllib3/1.26.15 Apr 19 15:02:22 user devstack@n-api.service[61255]: X-Auth-Token: gAAAAABkQACJPl0P3yXKrMRibG79Hqp658in8va3b56MSx-w2zVdHzowg8aIK2QJzNaAu2nYCKOP0EC45n1JzRmkaqYpH8h-BaJQguDeBnVkMVS-0kmTwe8oxShNFbvWV7tvu9Eck7mAYMIZN8Q8WAD_N1YEUOjIIrn9-SU9eVgT8lsH3ldOGl4 Apr 19 15:02:22 user devstack@n-api.service[61255]: X-Domain-Id: None Apr 19 15:02:22 user devstack@n-api.service[61255]: X-Domain-Name: None Apr 19 15:02:22 user devstack@n-api.service[61255]: X-Identity-Status: Confirmed Apr 19 15:02:22 user devstack@n-api.service[61255]: X-Is-Admin-Project: True Apr 19 15:02:22 user devstack@n-api.service[61255]: X-Project-Domain-Id: default Apr 19 15:02:22 user devstack@n-api.service[61255]: X-Project-Domain-Name: Default Apr 19 15:02:22 user devstack@n-api.service[61255]: X-Project-Id: 9a5079ce8a52417fb2b8b8122bfeaa5e Apr 19 15:02:22 user devstack@n-api.service[61255]: X-Project-Name: tempest-AttachVolumeNegativeTest-68783932 Apr 19 15:02:22 user devstack@n-api.service[61255]: X-Role: member,reader Apr 19 15:02:22 user devstack@n-api.service[61255]: X-Roles: member,reader Apr 19 15:02:22 user devstack@n-api.service[61255]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9a5079ce8a52417fb2b8b8122bfeaa5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9a5079ce8a52417fb2b8b8122bfeaa5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9a5079ce8a52417fb2b8b8122bfeaa5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 15:02:22 user devstack@n-api.service[61255]: X-Tenant: tempest-AttachVolumeNegativeTest-68783932 Apr 19 15:02:22 user devstack@n-api.service[61255]: X-Tenant-Id: 9a5079ce8a52417fb2b8b8122bfeaa5e Apr 19 15:02:22 user devstack@n-api.service[61255]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-68783932 Apr 19 15:02:22 user devstack@n-api.service[61255]: X-User: tempest-AttachVolumeNegativeTest-68783932-project-member Apr 19 15:02:22 user devstack@n-api.service[61255]: X-User-Domain-Id: default Apr 19 15:02:22 user devstack@n-api.service[61255]: X-User-Domain-Name: Default Apr 19 15:02:22 user devstack@n-api.service[61255]: X-User-Id: 35b23f0d7300496990e74b2fb4945c15 Apr 19 15:02:22 user devstack@n-api.service[61255]: X-User-Name: tempest-AttachVolumeNegativeTest-68783932-project-member Apr 19 15:02:22 user devstack@n-api.service[61255]: method: > Apr 19 15:02:22 user devstack@n-api.service[61255]: exception: Instance 25a11d52-4c81-46e5-925d-ba88df6dfdff could not be found. Apr 19 15:02:22 user devstack@n-api.service[61255]: action_args: {'id': '25a11d52-4c81-46e5-925d-ba88df6dfdff'} Apr 19 15:02:22 user devstack@n-api.service[61255]: {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25a11d52-4c81-46e5-925d-ba88df6dfdff could not be found. Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25a11d52-4c81-46e5-925d-ba88df6dfdff could not be found. Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25a11d52-4c81-46e5-925d-ba88df6dfdff could not be found. Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 15:02:22 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-de53f2e1-ec7e-48f6-bb43-169a4dfdcac3 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Returning 404 to user: Instance 25a11d52-4c81-46e5-925d-ba88df6dfdff could not be found. {{(pid=61255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:02:22 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-de53f2e1-ec7e-48f6-bb43-169a4dfdcac3 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/25a11d52-4c81-46e5-925d-ba88df6dfdff" status: 404 len: 111 microversion: 2.1 time: 0.029154 Apr 19 15:02:22 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 136/402] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 15:02:22 2023] DELETE /compute/v2.1/servers/25a11d52-4c81-46e5-925d-ba88df6dfdff => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 15:02:22 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-3d62dc08-cddf-47a6-802b-3fb702214c84 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:02:22 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-3d62dc08-cddf-47a6-802b-3fb702214c84 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] [instance: 25a11d52-4c81-46e5-925d-ba88df6dfdff] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:02:22 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-3d62dc08-cddf-47a6-802b-3fb702214c84 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:02:22 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-3d62dc08-cddf-47a6-802b-3fb702214c84 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:02:22 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-3d62dc08-cddf-47a6-802b-3fb702214c84 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:02:22 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-3d62dc08-cddf-47a6-802b-3fb702214c84 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:02:22 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-3d62dc08-cddf-47a6-802b-3fb702214c84 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:02:22 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-3d62dc08-cddf-47a6-802b-3fb702214c84 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:02:22 user devstack@n-api.service[61254]: INFO nova.api.openstack.wsgi [None req-3d62dc08-cddf-47a6-802b-3fb702214c84 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] HTTP exception thrown: Instance 25a11d52-4c81-46e5-925d-ba88df6dfdff could not be found. Apr 19 15:02:22 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-3d62dc08-cddf-47a6-802b-3fb702214c84 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Request method failure captured: Apr 19 15:02:22 user devstack@n-api.service[61254]: request: GET /compute/v2.1/servers/25a11d52-4c81-46e5-925d-ba88df6dfdff HTTP/1.1 Apr 19 15:02:22 user devstack@n-api.service[61254]: Accept: application/json Apr 19 15:02:22 user devstack@n-api.service[61254]: Accept-Encoding: identity Apr 19 15:02:22 user devstack@n-api.service[61254]: Connection: close Apr 19 15:02:22 user devstack@n-api.service[61254]: Content-Length: 0 Apr 19 15:02:22 user devstack@n-api.service[61254]: Content-Type: application/json Apr 19 15:02:22 user devstack@n-api.service[61254]: Host: 10.0.0.210 Apr 19 15:02:22 user devstack@n-api.service[61254]: Openstack-System-Scope: None Apr 19 15:02:22 user devstack@n-api.service[61254]: User-Agent: python-urllib3/1.26.15 Apr 19 15:02:22 user devstack@n-api.service[61254]: X-Auth-Token: gAAAAABkQACJPl0P3yXKrMRibG79Hqp658in8va3b56MSx-w2zVdHzowg8aIK2QJzNaAu2nYCKOP0EC45n1JzRmkaqYpH8h-BaJQguDeBnVkMVS-0kmTwe8oxShNFbvWV7tvu9Eck7mAYMIZN8Q8WAD_N1YEUOjIIrn9-SU9eVgT8lsH3ldOGl4 Apr 19 15:02:22 user devstack@n-api.service[61254]: X-Domain-Id: None Apr 19 15:02:22 user devstack@n-api.service[61254]: X-Domain-Name: None Apr 19 15:02:22 user devstack@n-api.service[61254]: X-Identity-Status: Confirmed Apr 19 15:02:22 user devstack@n-api.service[61254]: X-Is-Admin-Project: True Apr 19 15:02:22 user devstack@n-api.service[61254]: X-Project-Domain-Id: default Apr 19 15:02:22 user devstack@n-api.service[61254]: X-Project-Domain-Name: Default Apr 19 15:02:22 user devstack@n-api.service[61254]: X-Project-Id: 9a5079ce8a52417fb2b8b8122bfeaa5e Apr 19 15:02:22 user devstack@n-api.service[61254]: X-Project-Name: tempest-AttachVolumeNegativeTest-68783932 Apr 19 15:02:22 user devstack@n-api.service[61254]: X-Role: member,reader Apr 19 15:02:22 user devstack@n-api.service[61254]: X-Roles: member,reader Apr 19 15:02:22 user devstack@n-api.service[61254]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9a5079ce8a52417fb2b8b8122bfeaa5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9a5079ce8a52417fb2b8b8122bfeaa5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9a5079ce8a52417fb2b8b8122bfeaa5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 15:02:22 user devstack@n-api.service[61254]: X-Tenant: tempest-AttachVolumeNegativeTest-68783932 Apr 19 15:02:22 user devstack@n-api.service[61254]: X-Tenant-Id: 9a5079ce8a52417fb2b8b8122bfeaa5e Apr 19 15:02:22 user devstack@n-api.service[61254]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-68783932 Apr 19 15:02:22 user devstack@n-api.service[61254]: X-User: tempest-AttachVolumeNegativeTest-68783932-project-member Apr 19 15:02:22 user devstack@n-api.service[61254]: X-User-Domain-Id: default Apr 19 15:02:22 user devstack@n-api.service[61254]: X-User-Domain-Name: Default Apr 19 15:02:22 user devstack@n-api.service[61254]: X-User-Id: 35b23f0d7300496990e74b2fb4945c15 Apr 19 15:02:22 user devstack@n-api.service[61254]: X-User-Name: tempest-AttachVolumeNegativeTest-68783932-project-member Apr 19 15:02:22 user devstack@n-api.service[61254]: method: > Apr 19 15:02:22 user devstack@n-api.service[61254]: exception: Instance 25a11d52-4c81-46e5-925d-ba88df6dfdff could not be found. Apr 19 15:02:22 user devstack@n-api.service[61254]: action_args: {'id': '25a11d52-4c81-46e5-925d-ba88df6dfdff'} Apr 19 15:02:22 user devstack@n-api.service[61254]: {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25a11d52-4c81-46e5-925d-ba88df6dfdff could not be found. Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25a11d52-4c81-46e5-925d-ba88df6dfdff could not be found. Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25a11d52-4c81-46e5-925d-ba88df6dfdff could not be found. Apr 19 15:02:22 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 15:02:22 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-3d62dc08-cddf-47a6-802b-3fb702214c84 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Returning 404 to user: Instance 25a11d52-4c81-46e5-925d-ba88df6dfdff could not be found. {{(pid=61254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:02:22 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-3d62dc08-cddf-47a6-802b-3fb702214c84 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25a11d52-4c81-46e5-925d-ba88df6dfdff" status: 404 len: 111 microversion: 2.1 time: 0.025805 Apr 19 15:02:22 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 133/403] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:02:22 2023] GET /compute/v2.1/servers/25a11d52-4c81-46e5-925d-ba88df6dfdff => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 15:02:22 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-adac7e71-c560-41fe-b5fa-fafec3a6ffe2 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:02:22 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-adac7e71-c560-41fe-b5fa-fafec3a6ffe2 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] [instance: ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:02:22 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-adac7e71-c560-41fe-b5fa-fafec3a6ffe2 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:02:22 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-adac7e71-c560-41fe-b5fa-fafec3a6ffe2 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:02:22 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-adac7e71-c560-41fe-b5fa-fafec3a6ffe2 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:02:22 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-adac7e71-c560-41fe-b5fa-fafec3a6ffe2 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:02:22 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-adac7e71-c560-41fe-b5fa-fafec3a6ffe2 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:02:22 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-adac7e71-c560-41fe-b5fa-fafec3a6ffe2 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:02:22 user devstack@n-api.service[61253]: INFO nova.api.openstack.wsgi [None req-adac7e71-c560-41fe-b5fa-fafec3a6ffe2 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] HTTP exception thrown: Instance ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084 could not be found. Apr 19 15:02:22 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-adac7e71-c560-41fe-b5fa-fafec3a6ffe2 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Request method failure captured: Apr 19 15:02:22 user devstack@n-api.service[61253]: request: DELETE /compute/v2.1/servers/ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084 HTTP/1.1 Apr 19 15:02:22 user devstack@n-api.service[61253]: Accept: application/json Apr 19 15:02:22 user devstack@n-api.service[61253]: Accept-Encoding: identity Apr 19 15:02:22 user devstack@n-api.service[61253]: Connection: close Apr 19 15:02:22 user devstack@n-api.service[61253]: Content-Length: 0 Apr 19 15:02:22 user devstack@n-api.service[61253]: Content-Type: application/json Apr 19 15:02:22 user devstack@n-api.service[61253]: Host: 10.0.0.210 Apr 19 15:02:22 user devstack@n-api.service[61253]: Openstack-System-Scope: None Apr 19 15:02:22 user devstack@n-api.service[61253]: User-Agent: python-urllib3/1.26.15 Apr 19 15:02:22 user devstack@n-api.service[61253]: X-Auth-Token: gAAAAABkQACJPl0P3yXKrMRibG79Hqp658in8va3b56MSx-w2zVdHzowg8aIK2QJzNaAu2nYCKOP0EC45n1JzRmkaqYpH8h-BaJQguDeBnVkMVS-0kmTwe8oxShNFbvWV7tvu9Eck7mAYMIZN8Q8WAD_N1YEUOjIIrn9-SU9eVgT8lsH3ldOGl4 Apr 19 15:02:22 user devstack@n-api.service[61253]: X-Domain-Id: None Apr 19 15:02:22 user devstack@n-api.service[61253]: X-Domain-Name: None Apr 19 15:02:22 user devstack@n-api.service[61253]: X-Identity-Status: Confirmed Apr 19 15:02:22 user devstack@n-api.service[61253]: X-Is-Admin-Project: True Apr 19 15:02:22 user devstack@n-api.service[61253]: X-Project-Domain-Id: default Apr 19 15:02:22 user devstack@n-api.service[61253]: X-Project-Domain-Name: Default Apr 19 15:02:22 user devstack@n-api.service[61253]: X-Project-Id: 9a5079ce8a52417fb2b8b8122bfeaa5e Apr 19 15:02:22 user devstack@n-api.service[61253]: X-Project-Name: tempest-AttachVolumeNegativeTest-68783932 Apr 19 15:02:22 user devstack@n-api.service[61253]: X-Role: member,reader Apr 19 15:02:22 user devstack@n-api.service[61253]: X-Roles: member,reader Apr 19 15:02:22 user devstack@n-api.service[61253]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9a5079ce8a52417fb2b8b8122bfeaa5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9a5079ce8a52417fb2b8b8122bfeaa5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9a5079ce8a52417fb2b8b8122bfeaa5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 15:02:22 user devstack@n-api.service[61253]: X-Tenant: tempest-AttachVolumeNegativeTest-68783932 Apr 19 15:02:22 user devstack@n-api.service[61253]: X-Tenant-Id: 9a5079ce8a52417fb2b8b8122bfeaa5e Apr 19 15:02:22 user devstack@n-api.service[61253]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-68783932 Apr 19 15:02:22 user devstack@n-api.service[61253]: X-User: tempest-AttachVolumeNegativeTest-68783932-project-member Apr 19 15:02:22 user devstack@n-api.service[61253]: X-User-Domain-Id: default Apr 19 15:02:22 user devstack@n-api.service[61253]: X-User-Domain-Name: Default Apr 19 15:02:22 user devstack@n-api.service[61253]: X-User-Id: 35b23f0d7300496990e74b2fb4945c15 Apr 19 15:02:22 user devstack@n-api.service[61253]: X-User-Name: tempest-AttachVolumeNegativeTest-68783932-project-member Apr 19 15:02:22 user devstack@n-api.service[61253]: method: > Apr 19 15:02:22 user devstack@n-api.service[61253]: exception: Instance ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084 could not be found. Apr 19 15:02:22 user devstack@n-api.service[61253]: action_args: {'id': 'ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084'} Apr 19 15:02:22 user devstack@n-api.service[61253]: {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084 could not be found. Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084 could not be found. Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084 could not be found. Apr 19 15:02:22 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 15:02:22 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-adac7e71-c560-41fe-b5fa-fafec3a6ffe2 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Returning 404 to user: Instance ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084 could not be found. {{(pid=61253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:02:22 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-adac7e71-c560-41fe-b5fa-fafec3a6ffe2 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084" status: 404 len: 111 microversion: 2.1 time: 0.034662 Apr 19 15:02:22 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 135/404] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 15:02:22 2023] DELETE /compute/v2.1/servers/ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 15:02:22 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-38b2f6af-7f40-4919-9bd3-3a444fefcda6 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:02:22 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-38b2f6af-7f40-4919-9bd3-3a444fefcda6 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] [instance: ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:02:22 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-38b2f6af-7f40-4919-9bd3-3a444fefcda6 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:02:22 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-38b2f6af-7f40-4919-9bd3-3a444fefcda6 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:02:22 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-38b2f6af-7f40-4919-9bd3-3a444fefcda6 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:02:22 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-38b2f6af-7f40-4919-9bd3-3a444fefcda6 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:02:22 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-38b2f6af-7f40-4919-9bd3-3a444fefcda6 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:02:22 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-38b2f6af-7f40-4919-9bd3-3a444fefcda6 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:02:22 user devstack@n-api.service[61255]: INFO nova.api.openstack.wsgi [None req-38b2f6af-7f40-4919-9bd3-3a444fefcda6 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] HTTP exception thrown: Instance ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084 could not be found. Apr 19 15:02:22 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-38b2f6af-7f40-4919-9bd3-3a444fefcda6 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Request method failure captured: Apr 19 15:02:22 user devstack@n-api.service[61255]: request: GET /compute/v2.1/servers/ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084 HTTP/1.1 Apr 19 15:02:22 user devstack@n-api.service[61255]: Accept: application/json Apr 19 15:02:22 user devstack@n-api.service[61255]: Accept-Encoding: identity Apr 19 15:02:22 user devstack@n-api.service[61255]: Connection: close Apr 19 15:02:22 user devstack@n-api.service[61255]: Content-Length: 0 Apr 19 15:02:22 user devstack@n-api.service[61255]: Content-Type: application/json Apr 19 15:02:22 user devstack@n-api.service[61255]: Host: 10.0.0.210 Apr 19 15:02:22 user devstack@n-api.service[61255]: Openstack-System-Scope: None Apr 19 15:02:22 user devstack@n-api.service[61255]: User-Agent: python-urllib3/1.26.15 Apr 19 15:02:22 user devstack@n-api.service[61255]: X-Auth-Token: gAAAAABkQACJPl0P3yXKrMRibG79Hqp658in8va3b56MSx-w2zVdHzowg8aIK2QJzNaAu2nYCKOP0EC45n1JzRmkaqYpH8h-BaJQguDeBnVkMVS-0kmTwe8oxShNFbvWV7tvu9Eck7mAYMIZN8Q8WAD_N1YEUOjIIrn9-SU9eVgT8lsH3ldOGl4 Apr 19 15:02:22 user devstack@n-api.service[61255]: X-Domain-Id: None Apr 19 15:02:22 user devstack@n-api.service[61255]: X-Domain-Name: None Apr 19 15:02:22 user devstack@n-api.service[61255]: X-Identity-Status: Confirmed Apr 19 15:02:22 user devstack@n-api.service[61255]: X-Is-Admin-Project: True Apr 19 15:02:22 user devstack@n-api.service[61255]: X-Project-Domain-Id: default Apr 19 15:02:22 user devstack@n-api.service[61255]: X-Project-Domain-Name: Default Apr 19 15:02:22 user devstack@n-api.service[61255]: X-Project-Id: 9a5079ce8a52417fb2b8b8122bfeaa5e Apr 19 15:02:22 user devstack@n-api.service[61255]: X-Project-Name: tempest-AttachVolumeNegativeTest-68783932 Apr 19 15:02:22 user devstack@n-api.service[61255]: X-Role: member,reader Apr 19 15:02:22 user devstack@n-api.service[61255]: X-Roles: member,reader Apr 19 15:02:22 user devstack@n-api.service[61255]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9a5079ce8a52417fb2b8b8122bfeaa5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9a5079ce8a52417fb2b8b8122bfeaa5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9a5079ce8a52417fb2b8b8122bfeaa5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 15:02:22 user devstack@n-api.service[61255]: X-Tenant: tempest-AttachVolumeNegativeTest-68783932 Apr 19 15:02:22 user devstack@n-api.service[61255]: X-Tenant-Id: 9a5079ce8a52417fb2b8b8122bfeaa5e Apr 19 15:02:22 user devstack@n-api.service[61255]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-68783932 Apr 19 15:02:22 user devstack@n-api.service[61255]: X-User: tempest-AttachVolumeNegativeTest-68783932-project-member Apr 19 15:02:22 user devstack@n-api.service[61255]: X-User-Domain-Id: default Apr 19 15:02:22 user devstack@n-api.service[61255]: X-User-Domain-Name: Default Apr 19 15:02:22 user devstack@n-api.service[61255]: X-User-Id: 35b23f0d7300496990e74b2fb4945c15 Apr 19 15:02:22 user devstack@n-api.service[61255]: X-User-Name: tempest-AttachVolumeNegativeTest-68783932-project-member Apr 19 15:02:22 user devstack@n-api.service[61255]: method: > Apr 19 15:02:22 user devstack@n-api.service[61255]: exception: Instance ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084 could not be found. Apr 19 15:02:22 user devstack@n-api.service[61255]: action_args: {'id': 'ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084'} Apr 19 15:02:22 user devstack@n-api.service[61255]: {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084 could not be found. Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084 could not be found. Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084 could not be found. Apr 19 15:02:22 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 15:02:22 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-38b2f6af-7f40-4919-9bd3-3a444fefcda6 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] Returning 404 to user: Instance ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084 could not be found. {{(pid=61255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:02:22 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-38b2f6af-7f40-4919-9bd3-3a444fefcda6 tempest-AttachVolumeNegativeTest-68783932 tempest-AttachVolumeNegativeTest-68783932-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084" status: 404 len: 111 microversion: 2.1 time: 0.027145 Apr 19 15:02:22 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 137/405] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:02:22 2023] GET /compute/v2.1/servers/ae82f12b-7fc9-4eb0-a0f2-f087fd2c5084 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 15:02:27 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-45f2b91b-9625-4b50-9c86-eab4a36c0819 tempest-VolumesSnapshotsTestJSON-583238280 tempest-VolumesSnapshotsTestJSON-583238280-project-member] Action: 'create', calling method: .version_select at 0x7f3cfa8c5f30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-319183453"}} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:02:27 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-45f2b91b-9625-4b50-9c86-eab4a36c0819 tempest-VolumesSnapshotsTestJSON-583238280 tempest-VolumesSnapshotsTestJSON-583238280-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.444972 Apr 19 15:02:27 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 134/406] 10.0.0.210 () {64 vars in 1232 bytes} [Wed Apr 19 15:02:27 2023] POST /compute/v2.1/os-volumes => generated 344 bytes in 446 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 19 15:02:27 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-0a1bcc8c-3738-421a-ac59-6ddb8fe31524 tempest-VolumesSnapshotsTestJSON-583238280 tempest-VolumesSnapshotsTestJSON-583238280-project-member] Calling method '.version_select at 0x7f3cfa8b6b00>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:02:27 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-0a1bcc8c-3738-421a-ac59-6ddb8fe31524 tempest-VolumesSnapshotsTestJSON-583238280 tempest-VolumesSnapshotsTestJSON-583238280-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e6ef8f89-b94b-4cdc-b196-2a9c55eee5de" status: 200 len: 344 microversion: 2.1 time: 0.069650 Apr 19 15:02:27 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 136/407] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 19 15:02:27 2023] GET /compute/v2.1/os-volumes/e6ef8f89-b94b-4cdc-b196-2a9c55eee5de => generated 344 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:02:28 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-d05e45fd-c5c9-496b-8537-c2b0ea9a511f tempest-VolumesSnapshotsTestJSON-583238280 tempest-VolumesSnapshotsTestJSON-583238280-project-member] Calling method '.version_select at 0x7f3cfa9c1a20>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:02:29 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-d05e45fd-c5c9-496b-8537-c2b0ea9a511f tempest-VolumesSnapshotsTestJSON-583238280 tempest-VolumesSnapshotsTestJSON-583238280-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e6ef8f89-b94b-4cdc-b196-2a9c55eee5de" status: 200 len: 341 microversion: 2.1 time: 0.054070 Apr 19 15:02:29 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 138/408] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 19 15:02:28 2023] GET /compute/v2.1/os-volumes/e6ef8f89-b94b-4cdc-b196-2a9c55eee5de => generated 341 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:02:29 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-f0bade92-a89b-493b-bad1-d3b4619cdfb5 tempest-VolumesSnapshotsTestJSON-583238280 tempest-VolumesSnapshotsTestJSON-583238280-project-member] Calling method '.version_select at 0x7f3cfa8c4a60>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:02:29 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-f0bade92-a89b-493b-bad1-d3b4619cdfb5 tempest-VolumesSnapshotsTestJSON-583238280 tempest-VolumesSnapshotsTestJSON-583238280-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/e6ef8f89-b94b-4cdc-b196-2a9c55eee5de" status: 202 len: 0 microversion: 2.1 time: 0.143826 Apr 19 15:02:29 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 135/409] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 19 15:02:29 2023] DELETE /compute/v2.1/os-volumes/e6ef8f89-b94b-4cdc-b196-2a9c55eee5de => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 15:02:29 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-93eab7f1-5480-4062-89e6-61ce28759eae tempest-VolumesSnapshotsTestJSON-583238280 tempest-VolumesSnapshotsTestJSON-583238280-project-member] Calling method '.version_select at 0x7f3cfa8b5bd0>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:02:29 user devstack@n-api.service[61253]: INFO nova.api.openstack.wsgi [None req-93eab7f1-5480-4062-89e6-61ce28759eae tempest-VolumesSnapshotsTestJSON-583238280 tempest-VolumesSnapshotsTestJSON-583238280-project-member] HTTP exception thrown: Volume e6ef8f89-b94b-4cdc-b196-2a9c55eee5de could not be found. Apr 19 15:02:29 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-93eab7f1-5480-4062-89e6-61ce28759eae tempest-VolumesSnapshotsTestJSON-583238280 tempest-VolumesSnapshotsTestJSON-583238280-project-member] Request method failure captured: Apr 19 15:02:29 user devstack@n-api.service[61253]: request: GET /compute/v2.1/os-volumes/e6ef8f89-b94b-4cdc-b196-2a9c55eee5de HTTP/1.1 Apr 19 15:02:29 user devstack@n-api.service[61253]: Accept: application/json Apr 19 15:02:29 user devstack@n-api.service[61253]: Accept-Encoding: identity Apr 19 15:02:29 user devstack@n-api.service[61253]: Connection: close Apr 19 15:02:29 user devstack@n-api.service[61253]: Content-Length: 0 Apr 19 15:02:29 user devstack@n-api.service[61253]: Content-Type: application/json Apr 19 15:02:29 user devstack@n-api.service[61253]: Host: 10.0.0.210 Apr 19 15:02:29 user devstack@n-api.service[61253]: Openstack-System-Scope: None Apr 19 15:02:29 user devstack@n-api.service[61253]: User-Agent: python-urllib3/1.26.15 Apr 19 15:02:29 user devstack@n-api.service[61253]: X-Auth-Token: gAAAAABkQAKDXiM2rsKyx8o9APui8NQS-Nt0mdsiSUz09uU2DVaoUDRdQtSgCX4ML-YZsBJZxMTi7Nb0KyKdLu1aX4tkzRFVe0VbjmNfio2FmZP9p013D01AEvMBqYPNdcVEp9wGLyITgU2RW3Zgq46IhID9yQ7k7cBN-2OVk4wkwONdO5WIjmA Apr 19 15:02:29 user devstack@n-api.service[61253]: X-Domain-Id: None Apr 19 15:02:29 user devstack@n-api.service[61253]: X-Domain-Name: None Apr 19 15:02:29 user devstack@n-api.service[61253]: X-Identity-Status: Confirmed Apr 19 15:02:29 user devstack@n-api.service[61253]: X-Is-Admin-Project: True Apr 19 15:02:29 user devstack@n-api.service[61253]: X-Project-Domain-Id: default Apr 19 15:02:29 user devstack@n-api.service[61253]: X-Project-Domain-Name: Default Apr 19 15:02:29 user devstack@n-api.service[61253]: X-Project-Id: 181f46097d6d4039bddea52734fb8497 Apr 19 15:02:29 user devstack@n-api.service[61253]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-583238280 Apr 19 15:02:29 user devstack@n-api.service[61253]: X-Role: member,reader Apr 19 15:02:29 user devstack@n-api.service[61253]: X-Roles: member,reader Apr 19 15:02:29 user devstack@n-api.service[61253]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/181f46097d6d4039bddea52734fb8497"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/181f46097d6d4039bddea52734fb8497"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/181f46097d6d4039bddea52734fb8497"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 15:02:29 user devstack@n-api.service[61253]: X-Tenant: tempest-VolumesSnapshotsTestJSON-583238280 Apr 19 15:02:29 user devstack@n-api.service[61253]: X-Tenant-Id: 181f46097d6d4039bddea52734fb8497 Apr 19 15:02:29 user devstack@n-api.service[61253]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-583238280 Apr 19 15:02:29 user devstack@n-api.service[61253]: X-User: tempest-VolumesSnapshotsTestJSON-583238280-project-member Apr 19 15:02:29 user devstack@n-api.service[61253]: X-User-Domain-Id: default Apr 19 15:02:29 user devstack@n-api.service[61253]: X-User-Domain-Name: Default Apr 19 15:02:29 user devstack@n-api.service[61253]: X-User-Id: cbb8a7268326420f9d8fb95317060259 Apr 19 15:02:29 user devstack@n-api.service[61253]: X-User-Name: tempest-VolumesSnapshotsTestJSON-583238280-project-member Apr 19 15:02:29 user devstack@n-api.service[61253]: method: Apr 19 15:02:29 user devstack@n-api.service[61253]: exception: Volume e6ef8f89-b94b-4cdc-b196-2a9c55eee5de could not be found. Apr 19 15:02:29 user devstack@n-api.service[61253]: action_args: {'id': 'e6ef8f89-b94b-4cdc-b196-2a9c55eee5de'} Apr 19 15:02:29 user devstack@n-api.service[61253]: {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e6ef8f89-b94b-4cdc-b196-2a9c55eee5de could not be found. (HTTP 404) (Request-ID: req-b405f9fa-4679-4d1c-99e1-224207d7229c) Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e6ef8f89-b94b-4cdc-b196-2a9c55eee5de could not be found. Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e6ef8f89-b94b-4cdc-b196-2a9c55eee5de could not be found. Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e6ef8f89-b94b-4cdc-b196-2a9c55eee5de could not be found. Apr 19 15:02:29 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 15:02:29 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-93eab7f1-5480-4062-89e6-61ce28759eae tempest-VolumesSnapshotsTestJSON-583238280 tempest-VolumesSnapshotsTestJSON-583238280-project-member] Returning 404 to user: Volume e6ef8f89-b94b-4cdc-b196-2a9c55eee5de could not be found. {{(pid=61253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:02:29 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-93eab7f1-5480-4062-89e6-61ce28759eae tempest-VolumesSnapshotsTestJSON-583238280 tempest-VolumesSnapshotsTestJSON-583238280-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e6ef8f89-b94b-4cdc-b196-2a9c55eee5de" status: 404 len: 109 microversion: 2.1 time: 0.040569 Apr 19 15:02:29 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 137/410] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 19 15:02:29 2023] GET /compute/v2.1/os-volumes/e6ef8f89-b94b-4cdc-b196-2a9c55eee5de => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 15:02:48 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-9ae8f2a3-48aa-41de-8b3e-cc7290d0f87e tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:02:48 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-9ae8f2a3-48aa-41de-8b3e-cc7290d0f87e tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] [instance: 6e7ecd24-b21a-40f1-aea3-e87104f260bf] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:02:48 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:02:48 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell1:SELECT=4 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:02:48 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-9ae8f2a3-48aa-41de-8b3e-cc7290d0f87e tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:02:48 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-9ae8f2a3-48aa-41de-8b3e-cc7290d0f87e tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:02:48 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-9ae8f2a3-48aa-41de-8b3e-cc7290d0f87e tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:02:48 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-9ae8f2a3-48aa-41de-8b3e-cc7290d0f87e tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:02:48 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-9ae8f2a3-48aa-41de-8b3e-cc7290d0f87e tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:02:48 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-9ae8f2a3-48aa-41de-8b3e-cc7290d0f87e tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:02:48 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-9ae8f2a3-48aa-41de-8b3e-cc7290d0f87e tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cac3222b6a46af94d475533efdb6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b55a0da17744d83b432ad3994d1a4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:02:48 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-9ae8f2a3-48aa-41de-8b3e-cc7290d0f87e tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e7ecd24-b21a-40f1-aea3-e87104f260bf" status: 200 len: 1495 microversion: 2.1 time: 0.253195 Apr 19 15:02:48 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 139/411] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:02:48 2023] GET /compute/v2.1/servers/6e7ecd24-b21a-40f1-aea3-e87104f260bf => generated 1495 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:03:09 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_api:SELECT=4 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:03:09 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell1:SELECT=4 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:03:09 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-d30dd032-4cae-46b8-9a26-66ca10cdebe0 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:03:09 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-d30dd032-4cae-46b8-9a26-66ca10cdebe0 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] [instance: b0637e45-4a13-4970-b933-7c5fc5b84fff] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:03:09 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-d30dd032-4cae-46b8-9a26-66ca10cdebe0 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:03:09 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-d30dd032-4cae-46b8-9a26-66ca10cdebe0 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:03:09 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-d30dd032-4cae-46b8-9a26-66ca10cdebe0 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:03:09 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-d30dd032-4cae-46b8-9a26-66ca10cdebe0 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:03:09 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-d30dd032-4cae-46b8-9a26-66ca10cdebe0 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:03:09 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-d30dd032-4cae-46b8-9a26-66ca10cdebe0 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:03:10 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-d30dd032-4cae-46b8-9a26-66ca10cdebe0 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0637e45-4a13-4970-b933-7c5fc5b84fff/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.183793 Apr 19 15:03:10 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 136/412] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 19 15:03:09 2023] GET /compute/v2.1/servers/b0637e45-4a13-4970-b933-7c5fc5b84fff/os-interface => generated 282 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 15:03:10 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_api:SELECT=6 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:03:10 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell1:SELECT=6 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:03:10 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-fdca1c57-6beb-4f96-8ff7-15a1600ebca9 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:03:10 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-fdca1c57-6beb-4f96-8ff7-15a1600ebca9 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] [instance: b0637e45-4a13-4970-b933-7c5fc5b84fff] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:03:10 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_api:SELECT=2 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:03:10 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell1:SELECT=6 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:03:10 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-fdca1c57-6beb-4f96-8ff7-15a1600ebca9 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:03:10 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-fdca1c57-6beb-4f96-8ff7-15a1600ebca9 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:03:10 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-fdca1c57-6beb-4f96-8ff7-15a1600ebca9 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:03:10 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-fdca1c57-6beb-4f96-8ff7-15a1600ebca9 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:03:10 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-fdca1c57-6beb-4f96-8ff7-15a1600ebca9 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:03:10 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-fdca1c57-6beb-4f96-8ff7-15a1600ebca9 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:03:10 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-fdca1c57-6beb-4f96-8ff7-15a1600ebca9 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0637e45-4a13-4970-b933-7c5fc5b84fff/ips" status: 200 len: 110 microversion: 2.20 time: 0.045501 Apr 19 15:03:10 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 140/413] 10.0.0.210 () {64 vars in 1366 bytes} [Wed Apr 19 15:03:10 2023] GET /compute/v2.1/servers/b0637e45-4a13-4970-b933-7c5fc5b84fff/ips => generated 110 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 15:03:11 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [req-6b57b63b-3347-409b-bd39-3231ac650942 req-a58c63b0-72f5-4808-90f9-833a8f27a5eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0637e45-4a13-4970-b933-7c5fc5b84fff", "tag": "8e93daaa-f7d2-4e80-8f8a-090c3d859877"}]} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:03:11 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-6b57b63b-3347-409b-bd39-3231ac650942 req-a58c63b0-72f5-4808-90f9-833a8f27a5eb service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:03:11 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-6b57b63b-3347-409b-bd39-3231ac650942 req-a58c63b0-72f5-4808-90f9-833a8f27a5eb service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:03:11 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-6b57b63b-3347-409b-bd39-3231ac650942 req-a58c63b0-72f5-4808-90f9-833a8f27a5eb service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:03:11 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-6b57b63b-3347-409b-bd39-3231ac650942 req-a58c63b0-72f5-4808-90f9-833a8f27a5eb service nova] Creating event network-changed:8e93daaa-f7d2-4e80-8f8a-090c3d859877 for instance b0637e45-4a13-4970-b933-7c5fc5b84fff on user Apr 19 15:03:11 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [req-6b57b63b-3347-409b-bd39-3231ac650942 req-a58c63b0-72f5-4808-90f9-833a8f27a5eb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.226046 Apr 19 15:03:11 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 138/414] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:03:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:03:12 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-458711c8-3dd7-4c34-85ef-9442f5e8bd4c tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:03:12 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-458711c8-3dd7-4c34-85ef-9442f5e8bd4c tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] [instance: b0637e45-4a13-4970-b933-7c5fc5b84fff] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:03:12 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-458711c8-3dd7-4c34-85ef-9442f5e8bd4c tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:03:12 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-458711c8-3dd7-4c34-85ef-9442f5e8bd4c tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:03:12 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-458711c8-3dd7-4c34-85ef-9442f5e8bd4c tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:03:12 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-458711c8-3dd7-4c34-85ef-9442f5e8bd4c tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:03:12 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-458711c8-3dd7-4c34-85ef-9442f5e8bd4c tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:03:12 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-458711c8-3dd7-4c34-85ef-9442f5e8bd4c tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:03:12 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-458711c8-3dd7-4c34-85ef-9442f5e8bd4c tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] [instance: b0637e45-4a13-4970-b933-7c5fc5b84fff] Going to try to terminate instance {{(pid=61254) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 15:03:12 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-458711c8-3dd7-4c34-85ef-9442f5e8bd4c tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b0637e45-4a13-4970-b933-7c5fc5b84fff" status: 204 len: 0 microversion: 2.20 time: 0.110496 Apr 19 15:03:12 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 137/415] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 19 15:03:12 2023] DELETE /compute/v2.1/servers/b0637e45-4a13-4970-b933-7c5fc5b84fff => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 19 15:03:12 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-335279da-dad7-4aa7-85dd-451975014068 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:03:12 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-335279da-dad7-4aa7-85dd-451975014068 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] [instance: b0637e45-4a13-4970-b933-7c5fc5b84fff] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:03:12 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-335279da-dad7-4aa7-85dd-451975014068 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:03:12 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-335279da-dad7-4aa7-85dd-451975014068 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:03:12 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-335279da-dad7-4aa7-85dd-451975014068 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:03:12 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-335279da-dad7-4aa7-85dd-451975014068 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:03:12 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-335279da-dad7-4aa7-85dd-451975014068 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:03:12 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-335279da-dad7-4aa7-85dd-451975014068 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:03:12 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-335279da-dad7-4aa7-85dd-451975014068 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f765d12fe234d0a9df2aa1f12e71b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc36f2d52844dc090a6c23e0f14d9a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:03:12 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-335279da-dad7-4aa7-85dd-451975014068 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f765d12fe234d0a9df2aa1f12e71b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc36f2d52844dc090a6c23e0f14d9a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:03:12 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-335279da-dad7-4aa7-85dd-451975014068 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f765d12fe234d0a9df2aa1f12e71b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc36f2d52844dc090a6c23e0f14d9a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:03:12 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-335279da-dad7-4aa7-85dd-451975014068 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0637e45-4a13-4970-b933-7c5fc5b84fff" status: 200 len: 1710 microversion: 2.20 time: 0.246998 Apr 19 15:03:12 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 141/416] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 15:03:12 2023] GET /compute/v2.1/servers/b0637e45-4a13-4970-b933-7c5fc5b84fff => generated 1710 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 15:03:13 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [req-d9637c14-3207-457b-91e2-7f42134b675b req-976ea772-0408-4990-a25e-bf88e652a168 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0637e45-4a13-4970-b933-7c5fc5b84fff", "name": "network-vif-unplugged", "status": "completed", "tag": "8e93daaa-f7d2-4e80-8f8a-090c3d859877"}, {"server_uuid": "b0637e45-4a13-4970-b933-7c5fc5b84fff", "name": "network-vif-plugged", "status": "completed", "tag": "8e93daaa-f7d2-4e80-8f8a-090c3d859877"}]} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:03:13 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-d9637c14-3207-457b-91e2-7f42134b675b req-976ea772-0408-4990-a25e-bf88e652a168 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:03:13 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-d9637c14-3207-457b-91e2-7f42134b675b req-976ea772-0408-4990-a25e-bf88e652a168 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:03:13 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-d9637c14-3207-457b-91e2-7f42134b675b req-976ea772-0408-4990-a25e-bf88e652a168 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:03:13 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-d9637c14-3207-457b-91e2-7f42134b675b req-976ea772-0408-4990-a25e-bf88e652a168 service nova] Creating event network-vif-unplugged:8e93daaa-f7d2-4e80-8f8a-090c3d859877 for instance b0637e45-4a13-4970-b933-7c5fc5b84fff on user Apr 19 15:03:13 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-d9637c14-3207-457b-91e2-7f42134b675b req-976ea772-0408-4990-a25e-bf88e652a168 service nova] Creating event network-vif-plugged:8e93daaa-f7d2-4e80-8f8a-090c3d859877 for instance b0637e45-4a13-4970-b933-7c5fc5b84fff on user Apr 19 15:03:13 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [req-d9637c14-3207-457b-91e2-7f42134b675b req-976ea772-0408-4990-a25e-bf88e652a168 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.028310 Apr 19 15:03:13 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 139/417] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:03:13 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:03:13 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [req-e435abc6-b037-4d76-ab5b-7ea9c98e8b38 req-43d46cef-ea55-482c-8434-6b9ffda2ce9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0637e45-4a13-4970-b933-7c5fc5b84fff", "name": "network-vif-deleted", "tag": "8e93daaa-f7d2-4e80-8f8a-090c3d859877"}]} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:03:13 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-e435abc6-b037-4d76-ab5b-7ea9c98e8b38 req-43d46cef-ea55-482c-8434-6b9ffda2ce9b service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:03:13 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-e435abc6-b037-4d76-ab5b-7ea9c98e8b38 req-43d46cef-ea55-482c-8434-6b9ffda2ce9b service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:03:13 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-e435abc6-b037-4d76-ab5b-7ea9c98e8b38 req-43d46cef-ea55-482c-8434-6b9ffda2ce9b service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:03:14 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-e435abc6-b037-4d76-ab5b-7ea9c98e8b38 req-43d46cef-ea55-482c-8434-6b9ffda2ce9b service nova] Creating event network-vif-deleted:8e93daaa-f7d2-4e80-8f8a-090c3d859877 for instance b0637e45-4a13-4970-b933-7c5fc5b84fff on user Apr 19 15:03:14 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [req-e435abc6-b037-4d76-ab5b-7ea9c98e8b38 req-43d46cef-ea55-482c-8434-6b9ffda2ce9b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030028 Apr 19 15:03:14 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 138/418] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:03:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:03:48 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-1574937f-df9e-48e4-bf4f-02ccc6975698 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:03:48 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-1574937f-df9e-48e4-bf4f-02ccc6975698 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] [instance: 6e7ecd24-b21a-40f1-aea3-e87104f260bf] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:03:48 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_api:SELECT=4 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:03:48 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell1:SELECT=10 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:03:48 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-1574937f-df9e-48e4-bf4f-02ccc6975698 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:03:48 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-1574937f-df9e-48e4-bf4f-02ccc6975698 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:03:48 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-1574937f-df9e-48e4-bf4f-02ccc6975698 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:03:48 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-1574937f-df9e-48e4-bf4f-02ccc6975698 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:03:48 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-1574937f-df9e-48e4-bf4f-02ccc6975698 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:03:48 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-1574937f-df9e-48e4-bf4f-02ccc6975698 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:03:48 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-1574937f-df9e-48e4-bf4f-02ccc6975698 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] [instance: 6e7ecd24-b21a-40f1-aea3-e87104f260bf] Going to try to terminate instance {{(pid=61255) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 15:03:48 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-1574937f-df9e-48e4-bf4f-02ccc6975698 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6e7ecd24-b21a-40f1-aea3-e87104f260bf" status: 204 len: 0 microversion: 2.1 time: 0.108011 Apr 19 15:03:48 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 142/419] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 15:03:48 2023] DELETE /compute/v2.1/servers/6e7ecd24-b21a-40f1-aea3-e87104f260bf => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 15:03:48 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_api:SELECT=4 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:03:48 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell1:SELECT=4 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:03:48 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-273593d8-de9a-4173-8c76-eef084642cba tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:03:48 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-273593d8-de9a-4173-8c76-eef084642cba tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] [instance: 6e7ecd24-b21a-40f1-aea3-e87104f260bf] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:03:48 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-273593d8-de9a-4173-8c76-eef084642cba tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:03:48 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-273593d8-de9a-4173-8c76-eef084642cba tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:03:48 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-273593d8-de9a-4173-8c76-eef084642cba tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:03:48 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-273593d8-de9a-4173-8c76-eef084642cba tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:03:48 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-273593d8-de9a-4173-8c76-eef084642cba tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:03:48 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-273593d8-de9a-4173-8c76-eef084642cba tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:03:49 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:03:49 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:03:49 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [req-7673aca0-70af-4832-a3e6-742bd98c0488 req-6e0da567-9337-4288-98b5-fb0faca03b34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e7ecd24-b21a-40f1-aea3-e87104f260bf", "name": "network-vif-unplugged", "status": "completed", "tag": "380f6e57-62e7-4c8e-ae8a-4a08584a4070"}]} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:03:49 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-7673aca0-70af-4832-a3e6-742bd98c0488 req-6e0da567-9337-4288-98b5-fb0faca03b34 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:03:49 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-7673aca0-70af-4832-a3e6-742bd98c0488 req-6e0da567-9337-4288-98b5-fb0faca03b34 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:03:49 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-7673aca0-70af-4832-a3e6-742bd98c0488 req-6e0da567-9337-4288-98b5-fb0faca03b34 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:03:49 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-7673aca0-70af-4832-a3e6-742bd98c0488 req-6e0da567-9337-4288-98b5-fb0faca03b34 service nova] Creating event network-vif-unplugged:380f6e57-62e7-4c8e-ae8a-4a08584a4070 for instance 6e7ecd24-b21a-40f1-aea3-e87104f260bf on user Apr 19 15:03:49 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [req-7673aca0-70af-4832-a3e6-742bd98c0488 req-6e0da567-9337-4288-98b5-fb0faca03b34 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037420 Apr 19 15:03:49 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 139/420] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:03:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:03:49 user devstack@n-api.service[61253]: DEBUG nova.policy [None req-273593d8-de9a-4173-8c76-eef084642cba tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cac3222b6a46af94d475533efdb6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b55a0da17744d83b432ad3994d1a4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61253) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:03:49 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-273593d8-de9a-4173-8c76-eef084642cba tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e7ecd24-b21a-40f1-aea3-e87104f260bf" status: 200 len: 1501 microversion: 2.1 time: 0.458758 Apr 19 15:03:49 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 140/421] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:03:48 2023] GET /compute/v2.1/servers/6e7ecd24-b21a-40f1-aea3-e87104f260bf => generated 1501 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:03:50 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-fbff4a00-f2d9-4171-94a4-a48ae9c0513b req-ed60a968-cf39-417a-8052-d85c6b2e02c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e7ecd24-b21a-40f1-aea3-e87104f260bf", "name": "network-vif-deleted", "tag": "380f6e57-62e7-4c8e-ae8a-4a08584a4070"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:03:50 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-fbff4a00-f2d9-4171-94a4-a48ae9c0513b req-ed60a968-cf39-417a-8052-d85c6b2e02c5 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:03:50 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-fbff4a00-f2d9-4171-94a4-a48ae9c0513b req-ed60a968-cf39-417a-8052-d85c6b2e02c5 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:03:50 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-fbff4a00-f2d9-4171-94a4-a48ae9c0513b req-ed60a968-cf39-417a-8052-d85c6b2e02c5 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:03:50 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-fbff4a00-f2d9-4171-94a4-a48ae9c0513b req-ed60a968-cf39-417a-8052-d85c6b2e02c5 service nova] Creating event network-vif-deleted:380f6e57-62e7-4c8e-ae8a-4a08584a4070 for instance 6e7ecd24-b21a-40f1-aea3-e87104f260bf on user Apr 19 15:03:50 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [req-fbff4a00-f2d9-4171-94a4-a48ae9c0513b req-ed60a968-cf39-417a-8052-d85c6b2e02c5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032418 Apr 19 15:03:50 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 143/422] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:03:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:03:51 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [req-ee61347a-7667-48d9-b37a-78e279024f34 req-a4d777fc-621c-4925-bee1-a0d8fd6deabc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e7ecd24-b21a-40f1-aea3-e87104f260bf", "name": "network-vif-plugged", "status": "completed", "tag": "380f6e57-62e7-4c8e-ae8a-4a08584a4070"}]} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:03:51 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-ee61347a-7667-48d9-b37a-78e279024f34 req-a4d777fc-621c-4925-bee1-a0d8fd6deabc service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:03:51 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-ee61347a-7667-48d9-b37a-78e279024f34 req-a4d777fc-621c-4925-bee1-a0d8fd6deabc service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:03:51 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-ee61347a-7667-48d9-b37a-78e279024f34 req-a4d777fc-621c-4925-bee1-a0d8fd6deabc service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:03:51 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-ee61347a-7667-48d9-b37a-78e279024f34 req-a4d777fc-621c-4925-bee1-a0d8fd6deabc service nova] Creating event network-vif-plugged:380f6e57-62e7-4c8e-ae8a-4a08584a4070 for instance 6e7ecd24-b21a-40f1-aea3-e87104f260bf on user Apr 19 15:03:51 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [req-ee61347a-7667-48d9-b37a-78e279024f34 req-a4d777fc-621c-4925-bee1-a0d8fd6deabc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028111 Apr 19 15:03:51 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 140/423] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:03:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:04:02 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_api:SELECT=2 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:04:02 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell1:SELECT=6 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:04:02 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-3bc26c4b-f94e-46fc-a048-39a59dd68674 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:04:02 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-3bc26c4b-f94e-46fc-a048-39a59dd68674 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] [instance: b0637e45-4a13-4970-b933-7c5fc5b84fff] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:04:02 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-3bc26c4b-f94e-46fc-a048-39a59dd68674 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:04:02 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-3bc26c4b-f94e-46fc-a048-39a59dd68674 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:04:02 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-3bc26c4b-f94e-46fc-a048-39a59dd68674 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:04:02 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-3bc26c4b-f94e-46fc-a048-39a59dd68674 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:04:02 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-3bc26c4b-f94e-46fc-a048-39a59dd68674 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:04:02 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-3bc26c4b-f94e-46fc-a048-39a59dd68674 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:04:02 user devstack@n-api.service[61253]: INFO nova.api.openstack.wsgi [None req-3bc26c4b-f94e-46fc-a048-39a59dd68674 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] HTTP exception thrown: Instance b0637e45-4a13-4970-b933-7c5fc5b84fff could not be found. Apr 19 15:04:02 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-3bc26c4b-f94e-46fc-a048-39a59dd68674 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Request method failure captured: Apr 19 15:04:02 user devstack@n-api.service[61253]: request: GET /compute/v2.1/servers/b0637e45-4a13-4970-b933-7c5fc5b84fff HTTP/1.1 Apr 19 15:04:02 user devstack@n-api.service[61253]: Accept: application/json Apr 19 15:04:02 user devstack@n-api.service[61253]: Accept-Encoding: identity Apr 19 15:04:02 user devstack@n-api.service[61253]: Connection: close Apr 19 15:04:02 user devstack@n-api.service[61253]: Content-Length: 0 Apr 19 15:04:02 user devstack@n-api.service[61253]: Content-Type: application/json Apr 19 15:04:02 user devstack@n-api.service[61253]: Host: 10.0.0.210 Apr 19 15:04:02 user devstack@n-api.service[61253]: Openstack-System-Scope: None Apr 19 15:04:02 user devstack@n-api.service[61253]: User-Agent: python-urllib3/1.26.15 Apr 19 15:04:02 user devstack@n-api.service[61253]: X-Auth-Token: gAAAAABkQAI8_De3m8i4MMbROun7tITHVSEDr6P7gwhCfyS6Xu_dj-bYjagGc5LfxmKGmLzBdYtfsRgeiDTeAYOze9Vh83Wmb5CbpJJq-dZ8gSsMusfNckclBz9rDsojo8ZbXByRHjg1ByUo5KL5QO66tVhKzm7qlX-d0Zd42EmMyFFqGK618gI Apr 19 15:04:02 user devstack@n-api.service[61253]: X-Domain-Id: None Apr 19 15:04:02 user devstack@n-api.service[61253]: X-Domain-Name: None Apr 19 15:04:02 user devstack@n-api.service[61253]: X-Identity-Status: Confirmed Apr 19 15:04:02 user devstack@n-api.service[61253]: X-Is-Admin-Project: True Apr 19 15:04:02 user devstack@n-api.service[61253]: X-Openstack-Nova-Api-Version: 2.20 Apr 19 15:04:02 user devstack@n-api.service[61253]: X-Project-Domain-Id: default Apr 19 15:04:02 user devstack@n-api.service[61253]: X-Project-Domain-Name: Default Apr 19 15:04:02 user devstack@n-api.service[61253]: X-Project-Id: ccc36f2d52844dc090a6c23e0f14d9a9 Apr 19 15:04:02 user devstack@n-api.service[61253]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2044517699 Apr 19 15:04:02 user devstack@n-api.service[61253]: X-Role: member,reader Apr 19 15:04:02 user devstack@n-api.service[61253]: X-Roles: member,reader Apr 19 15:04:02 user devstack@n-api.service[61253]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ccc36f2d52844dc090a6c23e0f14d9a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ccc36f2d52844dc090a6c23e0f14d9a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ccc36f2d52844dc090a6c23e0f14d9a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 15:04:02 user devstack@n-api.service[61253]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2044517699 Apr 19 15:04:02 user devstack@n-api.service[61253]: X-Tenant-Id: ccc36f2d52844dc090a6c23e0f14d9a9 Apr 19 15:04:02 user devstack@n-api.service[61253]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2044517699 Apr 19 15:04:02 user devstack@n-api.service[61253]: X-User: tempest-AttachVolumeShelveTestJSON-2044517699-project-member Apr 19 15:04:02 user devstack@n-api.service[61253]: X-User-Domain-Id: default Apr 19 15:04:02 user devstack@n-api.service[61253]: X-User-Domain-Name: Default Apr 19 15:04:02 user devstack@n-api.service[61253]: X-User-Id: 6f765d12fe234d0a9df2aa1f12e71b9d Apr 19 15:04:02 user devstack@n-api.service[61253]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2044517699-project-member Apr 19 15:04:02 user devstack@n-api.service[61253]: method: > Apr 19 15:04:02 user devstack@n-api.service[61253]: exception: Instance b0637e45-4a13-4970-b933-7c5fc5b84fff could not be found. Apr 19 15:04:02 user devstack@n-api.service[61253]: action_args: {'id': 'b0637e45-4a13-4970-b933-7c5fc5b84fff'} Apr 19 15:04:02 user devstack@n-api.service[61253]: {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:04:02 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:04:02 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:04:02 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:04:02 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:04:02 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:04:02 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:04:02 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:04:02 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:04:02 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:04:02 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0637e45-4a13-4970-b933-7c5fc5b84fff could not be found. Apr 19 15:04:02 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 15:04:02 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:04:02 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 15:04:02 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:04:02 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:04:02 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:04:02 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:04:02 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:04:02 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:04:02 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:04:02 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 15:04:02 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 15:04:02 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:04:02 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:04:02 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:04:02 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:04:02 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0637e45-4a13-4970-b933-7c5fc5b84fff could not be found. Apr 19 15:04:02 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 15:04:02 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:04:02 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 15:04:02 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:04:02 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:04:02 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:04:02 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:04:02 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:04:02 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0637e45-4a13-4970-b933-7c5fc5b84fff could not be found. Apr 19 15:04:02 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 15:04:02 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-3bc26c4b-f94e-46fc-a048-39a59dd68674 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Returning 404 to user: Instance b0637e45-4a13-4970-b933-7c5fc5b84fff could not be found. {{(pid=61253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:04:02 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-3bc26c4b-f94e-46fc-a048-39a59dd68674 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0637e45-4a13-4970-b933-7c5fc5b84fff" status: 404 len: 111 microversion: 2.20 time: 0.031903 Apr 19 15:04:02 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 141/424] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 15:04:02 2023] GET /compute/v2.1/servers/b0637e45-4a13-4970-b933-7c5fc5b84fff => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 15:04:02 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:04:02 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:04:02 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-eda23bdf-004f-4b8b-acc5-7f0ae395de91 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Calling method '.version_select at 0x7f3cfa9c3370>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:04:02 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-eda23bdf-004f-4b8b-acc5-7f0ae395de91 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-677154477" status: 204 len: 0 microversion: 2.20 time: 0.028720 Apr 19 15:04:02 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 144/425] 10.0.0.210 () {64 vars in 1336 bytes} [Wed Apr 19 15:04:02 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-677154477 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 19 15:04:03 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_api:SELECT=4 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:04:03 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell1:SELECT=4 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:04:03 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-1b26fdb3-88b7-4a24-851f-f4e3ee33b3ff tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Action: 'create', calling method: .version_select at 0x7f3cfa8c6830>, body: {"keypair": {"name": "tempest-keypair-161065607", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGaZX/YMGRTrYT2lltHzILe5UmW0YL6lJwfpOPoMl84VT28nIwnGig2Av0ysZHHyMS8/Js2PW4lfscYQvW5i3aE/fBb3YE+OiyqWH94EXVF1IFOkQvAiMAI3fac6cSYyQ=="}} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:04:03 user devstack@n-api.service[61254]: DEBUG nova.quota [None req-1b26fdb3-88b7-4a24-851f-f4e3ee33b3ff tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Getting quotas for project ccc36f2d52844dc090a6c23e0f14d9a9. Resources: {'key_pairs'} {{(pid=61254) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:04:03 user devstack@n-api.service[61254]: DEBUG nova.quota [None req-1b26fdb3-88b7-4a24-851f-f4e3ee33b3ff tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Getting quotas for user 6f765d12fe234d0a9df2aa1f12e71b9d and project ccc36f2d52844dc090a6c23e0f14d9a9. Resources: {'key_pairs'} {{(pid=61254) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:04:03 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-1b26fdb3-88b7-4a24-851f-f4e3ee33b3ff tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.049499 Apr 19 15:04:03 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 141/426] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 19 15:04:03 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 19 15:04:05 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-59d6aaf9-42cb-4eac-b732-9fe013b21880 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1012283545", "imageRef": "283dcfe8-75fd-4917-902e-1b940387187c", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "755c650f-2b5a-4ab1-bd77-7ba3366afde4"}], "security_groups": [{"name": "tempest-securitygroup--448845345"}], "key_name": "tempest-keypair-161065607", "user_data": "}} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:04:05 user devstack@n-api.service[61253]: DEBUG nova.network.neutron [None req-59d6aaf9-42cb-4eac-b732-9fe013b21880 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] validate_networks() for [('755c650f-2b5a-4ab1-bd77-7ba3366afde4', None, None, None, None, None)] {{(pid=61253) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 15:04:06 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-59d6aaf9-42cb-4eac-b732-9fe013b21880 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Flavor limits 0:0:0 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 15:04:06 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-59d6aaf9-42cb-4eac-b732-9fe013b21880 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Image limits 0:0:0 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 15:04:06 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-59d6aaf9-42cb-4eac-b732-9fe013b21880 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Flavor pref 0:0:0 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 15:04:06 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-59d6aaf9-42cb-4eac-b732-9fe013b21880 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Image pref 0:0:0 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 15:04:06 user devstack@n-api.service[61253]: DEBUG nova.virt.hardware [None req-59d6aaf9-42cb-4eac-b732-9fe013b21880 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 15:04:06 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-59d6aaf9-42cb-4eac-b732-9fe013b21880 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:04:06 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-59d6aaf9-42cb-4eac-b732-9fe013b21880 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:04:06 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-59d6aaf9-42cb-4eac-b732-9fe013b21880 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:04:06 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-59d6aaf9-42cb-4eac-b732-9fe013b21880 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:04:06 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-59d6aaf9-42cb-4eac-b732-9fe013b21880 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:04:06 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-59d6aaf9-42cb-4eac-b732-9fe013b21880 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:04:06 user devstack@n-api.service[61253]: DEBUG nova.quota [None req-59d6aaf9-42cb-4eac-b732-9fe013b21880 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Getting quotas for project ccc36f2d52844dc090a6c23e0f14d9a9. Resources: {'ram', 'instances', 'cores'} {{(pid=61253) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:04:06 user devstack@n-api.service[61253]: DEBUG nova.quota [None req-59d6aaf9-42cb-4eac-b732-9fe013b21880 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Getting quotas for user 6f765d12fe234d0a9df2aa1f12e71b9d and project ccc36f2d52844dc090a6c23e0f14d9a9. Resources: {'ram', 'instances', 'cores'} {{(pid=61253) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:04:06 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-59d6aaf9-42cb-4eac-b732-9fe013b21880 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Going to run 1 instances... {{(pid=61253) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 15:04:06 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-59d6aaf9-42cb-4eac-b732-9fe013b21880 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] [instance: 19e2d593-f78d-481a-981b-56a156923303] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='283dcfe8-75fd-4917-902e-1b940387187c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61253) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 15:04:06 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-59d6aaf9-42cb-4eac-b732-9fe013b21880 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.758058 Apr 19 15:04:06 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 142/427] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 19 15:04:05 2023] POST /compute/v2.1/servers => generated 399 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 19 15:04:06 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-2616bc4b-5e69-426d-8183-3e2fa3ca736a tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:04:06 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-2616bc4b-5e69-426d-8183-3e2fa3ca736a tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] [instance: 19e2d593-f78d-481a-981b-56a156923303] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:04:06 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-2616bc4b-5e69-426d-8183-3e2fa3ca736a tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f765d12fe234d0a9df2aa1f12e71b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc36f2d52844dc090a6c23e0f14d9a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:04:06 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-2616bc4b-5e69-426d-8183-3e2fa3ca736a tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f765d12fe234d0a9df2aa1f12e71b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc36f2d52844dc090a6c23e0f14d9a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:04:06 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-2616bc4b-5e69-426d-8183-3e2fa3ca736a tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f765d12fe234d0a9df2aa1f12e71b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc36f2d52844dc090a6c23e0f14d9a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:04:06 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-2616bc4b-5e69-426d-8183-3e2fa3ca736a tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19e2d593-f78d-481a-981b-56a156923303" status: 200 len: 1275 microversion: 2.20 time: 0.061931 Apr 19 15:04:06 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 145/428] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 15:04:06 2023] GET /compute/v2.1/servers/19e2d593-f78d-481a-981b-56a156923303 => generated 1275 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 15:04:08 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [req-ce2f9855-1766-4711-b426-5e46916b8b12 req-93ab10e1-7e07-4751-866c-88bd46db376e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19e2d593-f78d-481a-981b-56a156923303", "tag": "d08d185e-1268-4122-a84c-798bb55e844f"}]} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:04:08 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-ce2f9855-1766-4711-b426-5e46916b8b12 req-93ab10e1-7e07-4751-866c-88bd46db376e service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:04:08 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-ce2f9855-1766-4711-b426-5e46916b8b12 req-93ab10e1-7e07-4751-866c-88bd46db376e service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:04:08 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-ce2f9855-1766-4711-b426-5e46916b8b12 req-93ab10e1-7e07-4751-866c-88bd46db376e service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:04:08 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-ce2f9855-1766-4711-b426-5e46916b8b12 req-93ab10e1-7e07-4751-866c-88bd46db376e service nova] Creating event network-changed:d08d185e-1268-4122-a84c-798bb55e844f for instance 19e2d593-f78d-481a-981b-56a156923303 on user Apr 19 15:04:08 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [req-ce2f9855-1766-4711-b426-5e46916b8b12 req-93ab10e1-7e07-4751-866c-88bd46db376e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046877 Apr 19 15:04:08 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 142/429] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:04:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:04:10 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [req-3f0b4216-69f7-495b-b25d-afd381bca58b req-435032e0-6ee7-4035-9173-7c933db5eb12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19e2d593-f78d-481a-981b-56a156923303", "name": "network-vif-plugged", "status": "completed", "tag": "d08d185e-1268-4122-a84c-798bb55e844f"}]} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:04:10 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-3f0b4216-69f7-495b-b25d-afd381bca58b req-435032e0-6ee7-4035-9173-7c933db5eb12 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:04:10 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-3f0b4216-69f7-495b-b25d-afd381bca58b req-435032e0-6ee7-4035-9173-7c933db5eb12 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:04:10 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-3f0b4216-69f7-495b-b25d-afd381bca58b req-435032e0-6ee7-4035-9173-7c933db5eb12 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:04:10 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-3f0b4216-69f7-495b-b25d-afd381bca58b req-435032e0-6ee7-4035-9173-7c933db5eb12 service nova] Creating event network-vif-plugged:d08d185e-1268-4122-a84c-798bb55e844f for instance 19e2d593-f78d-481a-981b-56a156923303 on user Apr 19 15:04:10 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [req-3f0b4216-69f7-495b-b25d-afd381bca58b req-435032e0-6ee7-4035-9173-7c933db5eb12 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040846 Apr 19 15:04:10 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 143/430] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:04:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:04:12 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-f5e2a46f-b20a-458d-b33d-fde4b1fd0f34 req-14a30568-8038-4b2a-9046-9f5b19cfb63f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19e2d593-f78d-481a-981b-56a156923303", "name": "network-vif-plugged", "status": "completed", "tag": "d08d185e-1268-4122-a84c-798bb55e844f"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:04:12 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-f5e2a46f-b20a-458d-b33d-fde4b1fd0f34 req-14a30568-8038-4b2a-9046-9f5b19cfb63f service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:04:12 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-f5e2a46f-b20a-458d-b33d-fde4b1fd0f34 req-14a30568-8038-4b2a-9046-9f5b19cfb63f service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:04:12 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-f5e2a46f-b20a-458d-b33d-fde4b1fd0f34 req-14a30568-8038-4b2a-9046-9f5b19cfb63f service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:04:12 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-f5e2a46f-b20a-458d-b33d-fde4b1fd0f34 req-14a30568-8038-4b2a-9046-9f5b19cfb63f service nova] Creating event network-vif-plugged:d08d185e-1268-4122-a84c-798bb55e844f for instance 19e2d593-f78d-481a-981b-56a156923303 on user Apr 19 15:04:12 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [req-f5e2a46f-b20a-458d-b33d-fde4b1fd0f34 req-14a30568-8038-4b2a-9046-9f5b19cfb63f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030900 Apr 19 15:04:12 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 146/431] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:04:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:04:39 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell0:SELECT=4 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:04:39 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:04:39 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell1:SELECT=2 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:04:39 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-3e237bf8-51cc-4823-9cad-b5680f6e2062 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:04:39 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-3e237bf8-51cc-4823-9cad-b5680f6e2062 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] [instance: 6e7ecd24-b21a-40f1-aea3-e87104f260bf] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:04:39 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-3e237bf8-51cc-4823-9cad-b5680f6e2062 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:04:39 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-3e237bf8-51cc-4823-9cad-b5680f6e2062 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:04:39 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-3e237bf8-51cc-4823-9cad-b5680f6e2062 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:04:39 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-3e237bf8-51cc-4823-9cad-b5680f6e2062 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:04:39 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-3e237bf8-51cc-4823-9cad-b5680f6e2062 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:04:39 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-3e237bf8-51cc-4823-9cad-b5680f6e2062 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:04:39 user devstack@n-api.service[61254]: INFO nova.api.openstack.wsgi [None req-3e237bf8-51cc-4823-9cad-b5680f6e2062 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] HTTP exception thrown: Instance 6e7ecd24-b21a-40f1-aea3-e87104f260bf could not be found. Apr 19 15:04:39 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-3e237bf8-51cc-4823-9cad-b5680f6e2062 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Request method failure captured: Apr 19 15:04:39 user devstack@n-api.service[61254]: request: GET /compute/v2.1/servers/6e7ecd24-b21a-40f1-aea3-e87104f260bf HTTP/1.1 Apr 19 15:04:39 user devstack@n-api.service[61254]: Accept: application/json Apr 19 15:04:39 user devstack@n-api.service[61254]: Accept-Encoding: identity Apr 19 15:04:39 user devstack@n-api.service[61254]: Connection: close Apr 19 15:04:39 user devstack@n-api.service[61254]: Content-Length: 0 Apr 19 15:04:39 user devstack@n-api.service[61254]: Content-Type: application/json Apr 19 15:04:39 user devstack@n-api.service[61254]: Host: 10.0.0.210 Apr 19 15:04:39 user devstack@n-api.service[61254]: Openstack-System-Scope: None Apr 19 15:04:39 user devstack@n-api.service[61254]: User-Agent: python-urllib3/1.26.15 Apr 19 15:04:39 user devstack@n-api.service[61254]: X-Auth-Token: gAAAAABkQAH17G1z-eDF9rWS5jiLFpdio4lSZe39DYlD33eMAYaSfsR1foo2esxOySOzRms29D1l4sTwZMiqt_3qR6Hl11NpbgMxVGIoUeOfZT6o266IQVs4ScZlGrq3661OzhzYXuKgX93UvMhm2hdLNjkx2SCRwrRAK5ax1tIWHca3739pKNQ Apr 19 15:04:39 user devstack@n-api.service[61254]: X-Domain-Id: None Apr 19 15:04:39 user devstack@n-api.service[61254]: X-Domain-Name: None Apr 19 15:04:39 user devstack@n-api.service[61254]: X-Identity-Status: Confirmed Apr 19 15:04:39 user devstack@n-api.service[61254]: X-Is-Admin-Project: True Apr 19 15:04:39 user devstack@n-api.service[61254]: X-Project-Domain-Id: default Apr 19 15:04:39 user devstack@n-api.service[61254]: X-Project-Domain-Name: Default Apr 19 15:04:39 user devstack@n-api.service[61254]: X-Project-Id: 6b55a0da17744d83b432ad3994d1a4b4 Apr 19 15:04:39 user devstack@n-api.service[61254]: X-Project-Name: tempest-ServersNegativeTestJSON-354425430 Apr 19 15:04:39 user devstack@n-api.service[61254]: X-Role: member,reader Apr 19 15:04:39 user devstack@n-api.service[61254]: X-Roles: member,reader Apr 19 15:04:39 user devstack@n-api.service[61254]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6b55a0da17744d83b432ad3994d1a4b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6b55a0da17744d83b432ad3994d1a4b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6b55a0da17744d83b432ad3994d1a4b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 15:04:39 user devstack@n-api.service[61254]: X-Tenant: tempest-ServersNegativeTestJSON-354425430 Apr 19 15:04:39 user devstack@n-api.service[61254]: X-Tenant-Id: 6b55a0da17744d83b432ad3994d1a4b4 Apr 19 15:04:39 user devstack@n-api.service[61254]: X-Tenant-Name: tempest-ServersNegativeTestJSON-354425430 Apr 19 15:04:39 user devstack@n-api.service[61254]: X-User: tempest-ServersNegativeTestJSON-354425430-project-member Apr 19 15:04:39 user devstack@n-api.service[61254]: X-User-Domain-Id: default Apr 19 15:04:39 user devstack@n-api.service[61254]: X-User-Domain-Name: Default Apr 19 15:04:39 user devstack@n-api.service[61254]: X-User-Id: 88cac3222b6a46af94d475533efdb6a4 Apr 19 15:04:39 user devstack@n-api.service[61254]: X-User-Name: tempest-ServersNegativeTestJSON-354425430-project-member Apr 19 15:04:39 user devstack@n-api.service[61254]: method: > Apr 19 15:04:39 user devstack@n-api.service[61254]: exception: Instance 6e7ecd24-b21a-40f1-aea3-e87104f260bf could not be found. Apr 19 15:04:39 user devstack@n-api.service[61254]: action_args: {'id': '6e7ecd24-b21a-40f1-aea3-e87104f260bf'} Apr 19 15:04:39 user devstack@n-api.service[61254]: {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:04:39 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:04:39 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:04:39 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:04:39 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:04:39 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:04:39 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:04:39 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:04:39 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:04:39 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:04:39 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e7ecd24-b21a-40f1-aea3-e87104f260bf could not be found. Apr 19 15:04:39 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 15:04:39 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:04:39 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 15:04:39 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:04:39 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:04:39 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:04:39 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:04:39 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:04:39 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:04:39 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:04:39 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 15:04:39 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 15:04:39 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:04:39 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:04:39 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:04:39 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:04:39 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e7ecd24-b21a-40f1-aea3-e87104f260bf could not be found. Apr 19 15:04:39 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 15:04:39 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:04:39 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 15:04:39 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:04:39 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:04:39 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:04:39 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:04:39 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:04:39 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e7ecd24-b21a-40f1-aea3-e87104f260bf could not be found. Apr 19 15:04:39 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 15:04:39 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-3e237bf8-51cc-4823-9cad-b5680f6e2062 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Returning 404 to user: Instance 6e7ecd24-b21a-40f1-aea3-e87104f260bf could not be found. {{(pid=61254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:04:39 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-3e237bf8-51cc-4823-9cad-b5680f6e2062 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e7ecd24-b21a-40f1-aea3-e87104f260bf" status: 404 len: 111 microversion: 2.1 time: 0.044495 Apr 19 15:04:39 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 143/432] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:04:39 2023] GET /compute/v2.1/servers/6e7ecd24-b21a-40f1-aea3-e87104f260bf => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 15:04:39 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell0:SELECT=2 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:04:39 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell0:SELECT=6 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:04:39 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:04:39 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell1:SELECT=6 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:04:39 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-0e9ef7b5-81a0-4a21-b6ba-2796fa563c1b tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:04:39 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-0e9ef7b5-81a0-4a21-b6ba-2796fa563c1b tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] [instance: 99c2d5c6-9b60-4265-9b7c-a3d970df83c7] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:04:39 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-0e9ef7b5-81a0-4a21-b6ba-2796fa563c1b tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:04:39 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-0e9ef7b5-81a0-4a21-b6ba-2796fa563c1b tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:04:39 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-0e9ef7b5-81a0-4a21-b6ba-2796fa563c1b tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:04:39 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-0e9ef7b5-81a0-4a21-b6ba-2796fa563c1b tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:04:39 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-0e9ef7b5-81a0-4a21-b6ba-2796fa563c1b tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:04:39 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-0e9ef7b5-81a0-4a21-b6ba-2796fa563c1b tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:04:39 user devstack@n-api.service[61253]: DEBUG nova.policy [None req-0e9ef7b5-81a0-4a21-b6ba-2796fa563c1b tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cac3222b6a46af94d475533efdb6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b55a0da17744d83b432ad3994d1a4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61253) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:04:39 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-0e9ef7b5-81a0-4a21-b6ba-2796fa563c1b tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99c2d5c6-9b60-4265-9b7c-a3d970df83c7" status: 200 len: 1494 microversion: 2.1 time: 0.244263 Apr 19 15:04:39 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 144/433] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:04:39 2023] GET /compute/v2.1/servers/99c2d5c6-9b60-4265-9b7c-a3d970df83c7 => generated 1494 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:04:56 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell0:SELECT=2 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:04:56 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:04:56 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell1:SELECT=2 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:04:56 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-dfe197cb-2d22-4179-bce4-f6d7f198a1ca tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:04:56 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-dfe197cb-2d22-4179-bce4-f6d7f198a1ca tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] [instance: 19e2d593-f78d-481a-981b-56a156923303] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:04:56 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-dfe197cb-2d22-4179-bce4-f6d7f198a1ca tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:04:56 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-dfe197cb-2d22-4179-bce4-f6d7f198a1ca tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:04:56 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-dfe197cb-2d22-4179-bce4-f6d7f198a1ca tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:04:56 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-dfe197cb-2d22-4179-bce4-f6d7f198a1ca tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:04:56 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-dfe197cb-2d22-4179-bce4-f6d7f198a1ca tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:04:56 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-dfe197cb-2d22-4179-bce4-f6d7f198a1ca tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:04:56 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-dfe197cb-2d22-4179-bce4-f6d7f198a1ca tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f765d12fe234d0a9df2aa1f12e71b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc36f2d52844dc090a6c23e0f14d9a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:04:56 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-dfe197cb-2d22-4179-bce4-f6d7f198a1ca tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f765d12fe234d0a9df2aa1f12e71b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc36f2d52844dc090a6c23e0f14d9a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:04:56 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-dfe197cb-2d22-4179-bce4-f6d7f198a1ca tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f765d12fe234d0a9df2aa1f12e71b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc36f2d52844dc090a6c23e0f14d9a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:04:56 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-dfe197cb-2d22-4179-bce4-f6d7f198a1ca tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19e2d593-f78d-481a-981b-56a156923303" status: 200 len: 1587 microversion: 2.20 time: 0.217926 Apr 19 15:04:56 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 147/434] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 15:04:56 2023] GET /compute/v2.1/servers/19e2d593-f78d-481a-981b-56a156923303 => generated 1587 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 15:05:41 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_api:SELECT=2 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:05:41 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell1:SELECT=2 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:05:41 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-8593d5fa-001d-4557-b6fa-00657160d252 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:05:41 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-8593d5fa-001d-4557-b6fa-00657160d252 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] [instance: 99c2d5c6-9b60-4265-9b7c-a3d970df83c7] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:05:41 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-8593d5fa-001d-4557-b6fa-00657160d252 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:05:41 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-8593d5fa-001d-4557-b6fa-00657160d252 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:05:41 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-8593d5fa-001d-4557-b6fa-00657160d252 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:05:41 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-8593d5fa-001d-4557-b6fa-00657160d252 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:05:41 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-8593d5fa-001d-4557-b6fa-00657160d252 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:05:41 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-8593d5fa-001d-4557-b6fa-00657160d252 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:05:41 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-8593d5fa-001d-4557-b6fa-00657160d252 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cac3222b6a46af94d475533efdb6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b55a0da17744d83b432ad3994d1a4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:05:41 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-8593d5fa-001d-4557-b6fa-00657160d252 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99c2d5c6-9b60-4265-9b7c-a3d970df83c7" status: 200 len: 1494 microversion: 2.1 time: 0.311832 Apr 19 15:05:41 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 144/435] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:05:41 2023] GET /compute/v2.1/servers/99c2d5c6-9b60-4265-9b7c-a3d970df83c7 => generated 1494 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:05:56 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_api:SELECT=2 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:05:56 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell1:SELECT=6 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:05:56 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-2add6f57-bafa-42b9-9ac0-3c745e3b43f2 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:05:56 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-2add6f57-bafa-42b9-9ac0-3c745e3b43f2 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] [instance: 19e2d593-f78d-481a-981b-56a156923303] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:05:56 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-2add6f57-bafa-42b9-9ac0-3c745e3b43f2 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:05:56 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-2add6f57-bafa-42b9-9ac0-3c745e3b43f2 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:05:56 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-2add6f57-bafa-42b9-9ac0-3c745e3b43f2 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:05:56 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-2add6f57-bafa-42b9-9ac0-3c745e3b43f2 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:05:56 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-2add6f57-bafa-42b9-9ac0-3c745e3b43f2 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:05:56 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-2add6f57-bafa-42b9-9ac0-3c745e3b43f2 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:05:56 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-2add6f57-bafa-42b9-9ac0-3c745e3b43f2 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19e2d593-f78d-481a-981b-56a156923303/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.173475 Apr 19 15:05:56 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 145/436] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 19 15:05:56 2023] GET /compute/v2.1/servers/19e2d593-f78d-481a-981b-56a156923303/os-interface => generated 283 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 15:05:58 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_api:SELECT=2 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:05:58 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell1:SELECT=6 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:05:58 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-f004602a-f41c-4acc-9a82-718fbc7daf71 req-720f602e-bb1f-407b-b427-6e8f4565a447 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19e2d593-f78d-481a-981b-56a156923303", "tag": "d08d185e-1268-4122-a84c-798bb55e844f"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:05:58 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-f004602a-f41c-4acc-9a82-718fbc7daf71 req-720f602e-bb1f-407b-b427-6e8f4565a447 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:05:58 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-f004602a-f41c-4acc-9a82-718fbc7daf71 req-720f602e-bb1f-407b-b427-6e8f4565a447 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:05:58 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-f004602a-f41c-4acc-9a82-718fbc7daf71 req-720f602e-bb1f-407b-b427-6e8f4565a447 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:05:58 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-4116610d-f24c-42f4-8425-da3664149b7e tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:05:58 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-4116610d-f24c-42f4-8425-da3664149b7e tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] [instance: 19e2d593-f78d-481a-981b-56a156923303] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:05:58 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-f004602a-f41c-4acc-9a82-718fbc7daf71 req-720f602e-bb1f-407b-b427-6e8f4565a447 service nova] Creating event network-changed:d08d185e-1268-4122-a84c-798bb55e844f for instance 19e2d593-f78d-481a-981b-56a156923303 on user Apr 19 15:05:58 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_api:SELECT=2 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:05:58 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [req-f004602a-f41c-4acc-9a82-718fbc7daf71 req-720f602e-bb1f-407b-b427-6e8f4565a447 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034393 Apr 19 15:05:58 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 148/437] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:05:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:05:58 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell1:SELECT=6 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:05:58 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-4116610d-f24c-42f4-8425-da3664149b7e tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:05:58 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-4116610d-f24c-42f4-8425-da3664149b7e tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:05:58 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-4116610d-f24c-42f4-8425-da3664149b7e tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:05:58 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-4116610d-f24c-42f4-8425-da3664149b7e tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:05:58 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-4116610d-f24c-42f4-8425-da3664149b7e tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:05:58 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-4116610d-f24c-42f4-8425-da3664149b7e tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:05:58 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-4116610d-f24c-42f4-8425-da3664149b7e tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19e2d593-f78d-481a-981b-56a156923303/ips" status: 200 len: 111 microversion: 2.20 time: 0.040132 Apr 19 15:05:58 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 145/438] 10.0.0.210 () {64 vars in 1366 bytes} [Wed Apr 19 15:05:58 2023] GET /compute/v2.1/servers/19e2d593-f78d-481a-981b-56a156923303/ips => generated 111 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 15:05:59 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-f139437a-d7dc-4f04-a6f2-1402c1449011 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:05:59 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-f139437a-d7dc-4f04-a6f2-1402c1449011 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] [instance: 19e2d593-f78d-481a-981b-56a156923303] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:05:59 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-f139437a-d7dc-4f04-a6f2-1402c1449011 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:05:59 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-f139437a-d7dc-4f04-a6f2-1402c1449011 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:05:59 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-f139437a-d7dc-4f04-a6f2-1402c1449011 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:05:59 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-f139437a-d7dc-4f04-a6f2-1402c1449011 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:05:59 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-f139437a-d7dc-4f04-a6f2-1402c1449011 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:05:59 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-f139437a-d7dc-4f04-a6f2-1402c1449011 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:05:59 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-f139437a-d7dc-4f04-a6f2-1402c1449011 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] [instance: 19e2d593-f78d-481a-981b-56a156923303] Going to try to terminate instance {{(pid=61253) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 15:05:59 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-f139437a-d7dc-4f04-a6f2-1402c1449011 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/19e2d593-f78d-481a-981b-56a156923303" status: 204 len: 0 microversion: 2.20 time: 0.139737 Apr 19 15:05:59 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 146/439] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 19 15:05:59 2023] DELETE /compute/v2.1/servers/19e2d593-f78d-481a-981b-56a156923303 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 19 15:05:59 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-f69ff69f-76d0-48f6-a715-531ab911134e tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:05:59 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-f69ff69f-76d0-48f6-a715-531ab911134e tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] [instance: 19e2d593-f78d-481a-981b-56a156923303] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:05:59 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-f69ff69f-76d0-48f6-a715-531ab911134e tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:05:59 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-f69ff69f-76d0-48f6-a715-531ab911134e tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:05:59 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-f69ff69f-76d0-48f6-a715-531ab911134e tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:05:59 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-f69ff69f-76d0-48f6-a715-531ab911134e tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:05:59 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-f69ff69f-76d0-48f6-a715-531ab911134e tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:05:59 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-f69ff69f-76d0-48f6-a715-531ab911134e tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:06:00 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [req-4ae90949-c8f6-42dd-89c0-7c76f350b86c req-1ee28e42-af5f-48e5-8e4e-7f924d9ba573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19e2d593-f78d-481a-981b-56a156923303", "name": "network-vif-unplugged", "status": "completed", "tag": "d08d185e-1268-4122-a84c-798bb55e844f"}, {"server_uuid": "19e2d593-f78d-481a-981b-56a156923303", "name": "network-vif-plugged", "status": "completed", "tag": "d08d185e-1268-4122-a84c-798bb55e844f"}]} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:06:00 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-f69ff69f-76d0-48f6-a715-531ab911134e tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f765d12fe234d0a9df2aa1f12e71b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc36f2d52844dc090a6c23e0f14d9a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:06:00 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-4ae90949-c8f6-42dd-89c0-7c76f350b86c req-1ee28e42-af5f-48e5-8e4e-7f924d9ba573 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:06:00 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-4ae90949-c8f6-42dd-89c0-7c76f350b86c req-1ee28e42-af5f-48e5-8e4e-7f924d9ba573 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:06:00 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-4ae90949-c8f6-42dd-89c0-7c76f350b86c req-1ee28e42-af5f-48e5-8e4e-7f924d9ba573 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:06:00 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-f69ff69f-76d0-48f6-a715-531ab911134e tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f765d12fe234d0a9df2aa1f12e71b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc36f2d52844dc090a6c23e0f14d9a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:06:00 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-f69ff69f-76d0-48f6-a715-531ab911134e tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f765d12fe234d0a9df2aa1f12e71b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc36f2d52844dc090a6c23e0f14d9a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:06:00 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-f69ff69f-76d0-48f6-a715-531ab911134e tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19e2d593-f78d-481a-981b-56a156923303" status: 200 len: 1712 microversion: 2.20 time: 0.546188 Apr 19 15:06:00 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 149/440] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 15:05:59 2023] GET /compute/v2.1/servers/19e2d593-f78d-481a-981b-56a156923303 => generated 1712 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 15:06:00 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-4ae90949-c8f6-42dd-89c0-7c76f350b86c req-1ee28e42-af5f-48e5-8e4e-7f924d9ba573 service nova] Creating event network-vif-unplugged:d08d185e-1268-4122-a84c-798bb55e844f for instance 19e2d593-f78d-481a-981b-56a156923303 on user Apr 19 15:06:00 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-4ae90949-c8f6-42dd-89c0-7c76f350b86c req-1ee28e42-af5f-48e5-8e4e-7f924d9ba573 service nova] Creating event network-vif-plugged:d08d185e-1268-4122-a84c-798bb55e844f for instance 19e2d593-f78d-481a-981b-56a156923303 on user Apr 19 15:06:00 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [req-4ae90949-c8f6-42dd-89c0-7c76f350b86c req-1ee28e42-af5f-48e5-8e4e-7f924d9ba573 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.030639 Apr 19 15:06:00 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 146/441] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:06:00 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:06:01 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [req-658a5614-274a-426c-b43c-a1f4a2f5ec06 req-8b9e653d-09b0-4ae5-ab71-4de48dd69d53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19e2d593-f78d-481a-981b-56a156923303", "name": "network-vif-deleted", "tag": "d08d185e-1268-4122-a84c-798bb55e844f"}]} {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:06:01 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-658a5614-274a-426c-b43c-a1f4a2f5ec06 req-8b9e653d-09b0-4ae5-ab71-4de48dd69d53 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:06:01 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-658a5614-274a-426c-b43c-a1f4a2f5ec06 req-8b9e653d-09b0-4ae5-ab71-4de48dd69d53 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:06:01 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [req-658a5614-274a-426c-b43c-a1f4a2f5ec06 req-8b9e653d-09b0-4ae5-ab71-4de48dd69d53 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:06:01 user devstack@n-api.service[61253]: INFO nova.api.openstack.compute.server_external_events [req-658a5614-274a-426c-b43c-a1f4a2f5ec06 req-8b9e653d-09b0-4ae5-ab71-4de48dd69d53 service nova] Creating event network-vif-deleted:d08d185e-1268-4122-a84c-798bb55e844f for instance 19e2d593-f78d-481a-981b-56a156923303 on user Apr 19 15:06:01 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [req-658a5614-274a-426c-b43c-a1f4a2f5ec06 req-8b9e653d-09b0-4ae5-ab71-4de48dd69d53 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029966 Apr 19 15:06:01 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 147/442] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:06:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:06:41 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-9780de1d-5b2f-4c76-b06a-d4617399faa7 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:06:41 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-9780de1d-5b2f-4c76-b06a-d4617399faa7 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] [instance: 99c2d5c6-9b60-4265-9b7c-a3d970df83c7] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:06:41 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_api:SELECT=4 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:06:41 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell1:SELECT=8 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:06:41 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-9780de1d-5b2f-4c76-b06a-d4617399faa7 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:06:41 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-9780de1d-5b2f-4c76-b06a-d4617399faa7 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:06:41 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-9780de1d-5b2f-4c76-b06a-d4617399faa7 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:06:41 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-9780de1d-5b2f-4c76-b06a-d4617399faa7 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:06:41 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-9780de1d-5b2f-4c76-b06a-d4617399faa7 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:06:41 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-9780de1d-5b2f-4c76-b06a-d4617399faa7 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:06:41 user devstack@n-api.service[61255]: DEBUG nova.policy [None req-9780de1d-5b2f-4c76-b06a-d4617399faa7 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cac3222b6a46af94d475533efdb6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b55a0da17744d83b432ad3994d1a4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61255) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:06:41 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-9780de1d-5b2f-4c76-b06a-d4617399faa7 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99c2d5c6-9b60-4265-9b7c-a3d970df83c7" status: 200 len: 1494 microversion: 2.1 time: 0.226083 Apr 19 15:06:41 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 150/443] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:06:41 2023] GET /compute/v2.1/servers/99c2d5c6-9b60-4265-9b7c-a3d970df83c7 => generated 1494 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:06:50 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_api:SELECT=4 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:06:50 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell1:SELECT=6 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:06:50 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-54923df9-2d9a-4170-80c5-af880f223fae tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:06:50 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-54923df9-2d9a-4170-80c5-af880f223fae tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] [instance: 19e2d593-f78d-481a-981b-56a156923303] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:06:50 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-54923df9-2d9a-4170-80c5-af880f223fae tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:06:50 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-54923df9-2d9a-4170-80c5-af880f223fae tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:06:50 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-54923df9-2d9a-4170-80c5-af880f223fae tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:06:50 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-54923df9-2d9a-4170-80c5-af880f223fae tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:06:50 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-54923df9-2d9a-4170-80c5-af880f223fae tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:06:50 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-54923df9-2d9a-4170-80c5-af880f223fae tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:06:50 user devstack@n-api.service[61254]: INFO nova.api.openstack.wsgi [None req-54923df9-2d9a-4170-80c5-af880f223fae tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] HTTP exception thrown: Instance 19e2d593-f78d-481a-981b-56a156923303 could not be found. Apr 19 15:06:50 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-54923df9-2d9a-4170-80c5-af880f223fae tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Request method failure captured: Apr 19 15:06:50 user devstack@n-api.service[61254]: request: GET /compute/v2.1/servers/19e2d593-f78d-481a-981b-56a156923303 HTTP/1.1 Apr 19 15:06:50 user devstack@n-api.service[61254]: Accept: application/json Apr 19 15:06:50 user devstack@n-api.service[61254]: Accept-Encoding: identity Apr 19 15:06:50 user devstack@n-api.service[61254]: Connection: close Apr 19 15:06:50 user devstack@n-api.service[61254]: Content-Length: 0 Apr 19 15:06:50 user devstack@n-api.service[61254]: Content-Type: application/json Apr 19 15:06:50 user devstack@n-api.service[61254]: Host: 10.0.0.210 Apr 19 15:06:50 user devstack@n-api.service[61254]: Openstack-System-Scope: None Apr 19 15:06:50 user devstack@n-api.service[61254]: User-Agent: python-urllib3/1.26.15 Apr 19 15:06:50 user devstack@n-api.service[61254]: X-Auth-Token: gAAAAABkQAI8_De3m8i4MMbROun7tITHVSEDr6P7gwhCfyS6Xu_dj-bYjagGc5LfxmKGmLzBdYtfsRgeiDTeAYOze9Vh83Wmb5CbpJJq-dZ8gSsMusfNckclBz9rDsojo8ZbXByRHjg1ByUo5KL5QO66tVhKzm7qlX-d0Zd42EmMyFFqGK618gI Apr 19 15:06:50 user devstack@n-api.service[61254]: X-Domain-Id: None Apr 19 15:06:50 user devstack@n-api.service[61254]: X-Domain-Name: None Apr 19 15:06:50 user devstack@n-api.service[61254]: X-Identity-Status: Confirmed Apr 19 15:06:50 user devstack@n-api.service[61254]: X-Is-Admin-Project: True Apr 19 15:06:50 user devstack@n-api.service[61254]: X-Openstack-Nova-Api-Version: 2.20 Apr 19 15:06:50 user devstack@n-api.service[61254]: X-Project-Domain-Id: default Apr 19 15:06:50 user devstack@n-api.service[61254]: X-Project-Domain-Name: Default Apr 19 15:06:50 user devstack@n-api.service[61254]: X-Project-Id: ccc36f2d52844dc090a6c23e0f14d9a9 Apr 19 15:06:50 user devstack@n-api.service[61254]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2044517699 Apr 19 15:06:50 user devstack@n-api.service[61254]: X-Role: member,reader Apr 19 15:06:50 user devstack@n-api.service[61254]: X-Roles: member,reader Apr 19 15:06:50 user devstack@n-api.service[61254]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ccc36f2d52844dc090a6c23e0f14d9a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ccc36f2d52844dc090a6c23e0f14d9a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ccc36f2d52844dc090a6c23e0f14d9a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 15:06:50 user devstack@n-api.service[61254]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2044517699 Apr 19 15:06:50 user devstack@n-api.service[61254]: X-Tenant-Id: ccc36f2d52844dc090a6c23e0f14d9a9 Apr 19 15:06:50 user devstack@n-api.service[61254]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2044517699 Apr 19 15:06:50 user devstack@n-api.service[61254]: X-User: tempest-AttachVolumeShelveTestJSON-2044517699-project-member Apr 19 15:06:50 user devstack@n-api.service[61254]: X-User-Domain-Id: default Apr 19 15:06:50 user devstack@n-api.service[61254]: X-User-Domain-Name: Default Apr 19 15:06:50 user devstack@n-api.service[61254]: X-User-Id: 6f765d12fe234d0a9df2aa1f12e71b9d Apr 19 15:06:50 user devstack@n-api.service[61254]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2044517699-project-member Apr 19 15:06:50 user devstack@n-api.service[61254]: method: > Apr 19 15:06:50 user devstack@n-api.service[61254]: exception: Instance 19e2d593-f78d-481a-981b-56a156923303 could not be found. Apr 19 15:06:50 user devstack@n-api.service[61254]: action_args: {'id': '19e2d593-f78d-481a-981b-56a156923303'} Apr 19 15:06:50 user devstack@n-api.service[61254]: {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:06:50 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:06:50 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:06:50 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:06:50 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:06:50 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:06:50 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:06:50 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:06:50 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:06:50 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:06:50 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19e2d593-f78d-481a-981b-56a156923303 could not be found. Apr 19 15:06:50 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 15:06:50 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:06:50 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 15:06:50 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:06:50 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:06:50 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:06:50 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:06:50 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:06:50 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:06:50 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:06:50 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 15:06:50 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 15:06:50 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:06:50 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:06:50 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:06:50 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:06:50 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19e2d593-f78d-481a-981b-56a156923303 could not be found. Apr 19 15:06:50 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 15:06:50 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:06:50 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 15:06:50 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:06:50 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:06:50 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:06:50 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:06:50 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:06:50 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19e2d593-f78d-481a-981b-56a156923303 could not be found. Apr 19 15:06:50 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 15:06:50 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-54923df9-2d9a-4170-80c5-af880f223fae tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Returning 404 to user: Instance 19e2d593-f78d-481a-981b-56a156923303 could not be found. {{(pid=61254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:06:50 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-54923df9-2d9a-4170-80c5-af880f223fae tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19e2d593-f78d-481a-981b-56a156923303" status: 404 len: 111 microversion: 2.20 time: 0.111144 Apr 19 15:06:50 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 147/444] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 15:06:50 2023] GET /compute/v2.1/servers/19e2d593-f78d-481a-981b-56a156923303 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 15:06:50 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:06:50 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:06:50 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-7c93dcba-b5b4-4994-9bfd-8c93b6521001 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Calling method '.version_select at 0x7f3cfa846200>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:06:50 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-7c93dcba-b5b4-4994-9bfd-8c93b6521001 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-161065607" status: 204 len: 0 microversion: 2.20 time: 0.029313 Apr 19 15:06:50 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 148/445] 10.0.0.210 () {64 vars in 1336 bytes} [Wed Apr 19 15:06:50 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-161065607 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 19 15:06:51 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-b8b965d3-7df7-4227-b1f1-ebe895ae11cd tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:06:51 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-b8b965d3-7df7-4227-b1f1-ebe895ae11cd tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] [instance: 19e2d593-f78d-481a-981b-56a156923303] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:06:51 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-b8b965d3-7df7-4227-b1f1-ebe895ae11cd tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:06:51 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-b8b965d3-7df7-4227-b1f1-ebe895ae11cd tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:06:51 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-b8b965d3-7df7-4227-b1f1-ebe895ae11cd tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:06:51 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-b8b965d3-7df7-4227-b1f1-ebe895ae11cd tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:06:51 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-b8b965d3-7df7-4227-b1f1-ebe895ae11cd tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:06:51 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-b8b965d3-7df7-4227-b1f1-ebe895ae11cd tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:06:51 user devstack@n-api.service[61255]: INFO nova.api.openstack.wsgi [None req-b8b965d3-7df7-4227-b1f1-ebe895ae11cd tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] HTTP exception thrown: Instance 19e2d593-f78d-481a-981b-56a156923303 could not be found. Apr 19 15:06:51 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-b8b965d3-7df7-4227-b1f1-ebe895ae11cd tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Request method failure captured: Apr 19 15:06:51 user devstack@n-api.service[61255]: request: DELETE /compute/v2.1/servers/19e2d593-f78d-481a-981b-56a156923303 HTTP/1.1 Apr 19 15:06:51 user devstack@n-api.service[61255]: Accept: application/json Apr 19 15:06:51 user devstack@n-api.service[61255]: Accept-Encoding: identity Apr 19 15:06:51 user devstack@n-api.service[61255]: Connection: close Apr 19 15:06:51 user devstack@n-api.service[61255]: Content-Length: 0 Apr 19 15:06:51 user devstack@n-api.service[61255]: Content-Type: application/json Apr 19 15:06:51 user devstack@n-api.service[61255]: Host: 10.0.0.210 Apr 19 15:06:51 user devstack@n-api.service[61255]: Openstack-System-Scope: None Apr 19 15:06:51 user devstack@n-api.service[61255]: User-Agent: python-urllib3/1.26.15 Apr 19 15:06:51 user devstack@n-api.service[61255]: X-Auth-Token: gAAAAABkQAI8_De3m8i4MMbROun7tITHVSEDr6P7gwhCfyS6Xu_dj-bYjagGc5LfxmKGmLzBdYtfsRgeiDTeAYOze9Vh83Wmb5CbpJJq-dZ8gSsMusfNckclBz9rDsojo8ZbXByRHjg1ByUo5KL5QO66tVhKzm7qlX-d0Zd42EmMyFFqGK618gI Apr 19 15:06:51 user devstack@n-api.service[61255]: X-Domain-Id: None Apr 19 15:06:51 user devstack@n-api.service[61255]: X-Domain-Name: None Apr 19 15:06:51 user devstack@n-api.service[61255]: X-Identity-Status: Confirmed Apr 19 15:06:51 user devstack@n-api.service[61255]: X-Is-Admin-Project: True Apr 19 15:06:51 user devstack@n-api.service[61255]: X-Openstack-Nova-Api-Version: 2.20 Apr 19 15:06:51 user devstack@n-api.service[61255]: X-Project-Domain-Id: default Apr 19 15:06:51 user devstack@n-api.service[61255]: X-Project-Domain-Name: Default Apr 19 15:06:51 user devstack@n-api.service[61255]: X-Project-Id: ccc36f2d52844dc090a6c23e0f14d9a9 Apr 19 15:06:51 user devstack@n-api.service[61255]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2044517699 Apr 19 15:06:51 user devstack@n-api.service[61255]: X-Role: member,reader Apr 19 15:06:51 user devstack@n-api.service[61255]: X-Roles: member,reader Apr 19 15:06:51 user devstack@n-api.service[61255]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ccc36f2d52844dc090a6c23e0f14d9a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ccc36f2d52844dc090a6c23e0f14d9a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ccc36f2d52844dc090a6c23e0f14d9a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 15:06:51 user devstack@n-api.service[61255]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2044517699 Apr 19 15:06:51 user devstack@n-api.service[61255]: X-Tenant-Id: ccc36f2d52844dc090a6c23e0f14d9a9 Apr 19 15:06:51 user devstack@n-api.service[61255]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2044517699 Apr 19 15:06:51 user devstack@n-api.service[61255]: X-User: tempest-AttachVolumeShelveTestJSON-2044517699-project-member Apr 19 15:06:51 user devstack@n-api.service[61255]: X-User-Domain-Id: default Apr 19 15:06:51 user devstack@n-api.service[61255]: X-User-Domain-Name: Default Apr 19 15:06:51 user devstack@n-api.service[61255]: X-User-Id: 6f765d12fe234d0a9df2aa1f12e71b9d Apr 19 15:06:51 user devstack@n-api.service[61255]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2044517699-project-member Apr 19 15:06:51 user devstack@n-api.service[61255]: method: > Apr 19 15:06:51 user devstack@n-api.service[61255]: exception: Instance 19e2d593-f78d-481a-981b-56a156923303 could not be found. Apr 19 15:06:51 user devstack@n-api.service[61255]: action_args: {'id': '19e2d593-f78d-481a-981b-56a156923303'} Apr 19 15:06:51 user devstack@n-api.service[61255]: {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19e2d593-f78d-481a-981b-56a156923303 could not be found. Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19e2d593-f78d-481a-981b-56a156923303 could not be found. Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19e2d593-f78d-481a-981b-56a156923303 could not be found. Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 15:06:51 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-b8b965d3-7df7-4227-b1f1-ebe895ae11cd tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Returning 404 to user: Instance 19e2d593-f78d-481a-981b-56a156923303 could not be found. {{(pid=61255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:06:51 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-b8b965d3-7df7-4227-b1f1-ebe895ae11cd tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/19e2d593-f78d-481a-981b-56a156923303" status: 404 len: 111 microversion: 2.20 time: 0.033671 Apr 19 15:06:51 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 151/446] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 19 15:06:51 2023] DELETE /compute/v2.1/servers/19e2d593-f78d-481a-981b-56a156923303 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 15:06:51 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-86d935b0-55bd-49d4-b73b-25e47b073dc4 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:06:51 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-86d935b0-55bd-49d4-b73b-25e47b073dc4 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] [instance: 19e2d593-f78d-481a-981b-56a156923303] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:06:51 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-86d935b0-55bd-49d4-b73b-25e47b073dc4 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:06:51 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-86d935b0-55bd-49d4-b73b-25e47b073dc4 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:06:51 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-86d935b0-55bd-49d4-b73b-25e47b073dc4 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:06:51 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-86d935b0-55bd-49d4-b73b-25e47b073dc4 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:06:51 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-86d935b0-55bd-49d4-b73b-25e47b073dc4 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:06:51 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-86d935b0-55bd-49d4-b73b-25e47b073dc4 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:06:51 user devstack@n-api.service[61254]: INFO nova.api.openstack.wsgi [None req-86d935b0-55bd-49d4-b73b-25e47b073dc4 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] HTTP exception thrown: Instance 19e2d593-f78d-481a-981b-56a156923303 could not be found. Apr 19 15:06:51 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-86d935b0-55bd-49d4-b73b-25e47b073dc4 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Request method failure captured: Apr 19 15:06:51 user devstack@n-api.service[61254]: request: GET /compute/v2.1/servers/19e2d593-f78d-481a-981b-56a156923303 HTTP/1.1 Apr 19 15:06:51 user devstack@n-api.service[61254]: Accept: application/json Apr 19 15:06:51 user devstack@n-api.service[61254]: Accept-Encoding: identity Apr 19 15:06:51 user devstack@n-api.service[61254]: Connection: close Apr 19 15:06:51 user devstack@n-api.service[61254]: Content-Length: 0 Apr 19 15:06:51 user devstack@n-api.service[61254]: Content-Type: application/json Apr 19 15:06:51 user devstack@n-api.service[61254]: Host: 10.0.0.210 Apr 19 15:06:51 user devstack@n-api.service[61254]: Openstack-System-Scope: None Apr 19 15:06:51 user devstack@n-api.service[61254]: User-Agent: python-urllib3/1.26.15 Apr 19 15:06:51 user devstack@n-api.service[61254]: X-Auth-Token: gAAAAABkQAI8_De3m8i4MMbROun7tITHVSEDr6P7gwhCfyS6Xu_dj-bYjagGc5LfxmKGmLzBdYtfsRgeiDTeAYOze9Vh83Wmb5CbpJJq-dZ8gSsMusfNckclBz9rDsojo8ZbXByRHjg1ByUo5KL5QO66tVhKzm7qlX-d0Zd42EmMyFFqGK618gI Apr 19 15:06:51 user devstack@n-api.service[61254]: X-Domain-Id: None Apr 19 15:06:51 user devstack@n-api.service[61254]: X-Domain-Name: None Apr 19 15:06:51 user devstack@n-api.service[61254]: X-Identity-Status: Confirmed Apr 19 15:06:51 user devstack@n-api.service[61254]: X-Is-Admin-Project: True Apr 19 15:06:51 user devstack@n-api.service[61254]: X-Openstack-Nova-Api-Version: 2.20 Apr 19 15:06:51 user devstack@n-api.service[61254]: X-Project-Domain-Id: default Apr 19 15:06:51 user devstack@n-api.service[61254]: X-Project-Domain-Name: Default Apr 19 15:06:51 user devstack@n-api.service[61254]: X-Project-Id: ccc36f2d52844dc090a6c23e0f14d9a9 Apr 19 15:06:51 user devstack@n-api.service[61254]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2044517699 Apr 19 15:06:51 user devstack@n-api.service[61254]: X-Role: member,reader Apr 19 15:06:51 user devstack@n-api.service[61254]: X-Roles: member,reader Apr 19 15:06:51 user devstack@n-api.service[61254]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ccc36f2d52844dc090a6c23e0f14d9a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ccc36f2d52844dc090a6c23e0f14d9a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ccc36f2d52844dc090a6c23e0f14d9a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 15:06:51 user devstack@n-api.service[61254]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2044517699 Apr 19 15:06:51 user devstack@n-api.service[61254]: X-Tenant-Id: ccc36f2d52844dc090a6c23e0f14d9a9 Apr 19 15:06:51 user devstack@n-api.service[61254]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2044517699 Apr 19 15:06:51 user devstack@n-api.service[61254]: X-User: tempest-AttachVolumeShelveTestJSON-2044517699-project-member Apr 19 15:06:51 user devstack@n-api.service[61254]: X-User-Domain-Id: default Apr 19 15:06:51 user devstack@n-api.service[61254]: X-User-Domain-Name: Default Apr 19 15:06:51 user devstack@n-api.service[61254]: X-User-Id: 6f765d12fe234d0a9df2aa1f12e71b9d Apr 19 15:06:51 user devstack@n-api.service[61254]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2044517699-project-member Apr 19 15:06:51 user devstack@n-api.service[61254]: method: > Apr 19 15:06:51 user devstack@n-api.service[61254]: exception: Instance 19e2d593-f78d-481a-981b-56a156923303 could not be found. Apr 19 15:06:51 user devstack@n-api.service[61254]: action_args: {'id': '19e2d593-f78d-481a-981b-56a156923303'} Apr 19 15:06:51 user devstack@n-api.service[61254]: {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:06:51 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:06:51 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:06:51 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:06:51 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:06:51 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:06:51 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:06:51 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:06:51 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:06:51 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:06:51 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19e2d593-f78d-481a-981b-56a156923303 could not be found. Apr 19 15:06:51 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 15:06:51 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:06:51 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 15:06:51 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:06:51 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:06:51 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:06:51 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:06:51 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:06:51 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:06:51 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:06:51 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 15:06:51 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 15:06:51 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:06:51 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:06:51 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:06:51 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:06:51 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19e2d593-f78d-481a-981b-56a156923303 could not be found. Apr 19 15:06:51 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 15:06:51 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:06:51 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 15:06:51 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:06:51 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:06:51 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:06:51 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:06:51 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:06:51 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19e2d593-f78d-481a-981b-56a156923303 could not be found. Apr 19 15:06:51 user devstack@n-api.service[61254]: ERROR nova.api.openstack.wsgi Apr 19 15:06:51 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-86d935b0-55bd-49d4-b73b-25e47b073dc4 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Returning 404 to user: Instance 19e2d593-f78d-481a-981b-56a156923303 could not be found. {{(pid=61254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:06:51 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-86d935b0-55bd-49d4-b73b-25e47b073dc4 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19e2d593-f78d-481a-981b-56a156923303" status: 404 len: 111 microversion: 2.20 time: 0.026642 Apr 19 15:06:51 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 148/447] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 15:06:51 2023] GET /compute/v2.1/servers/19e2d593-f78d-481a-981b-56a156923303 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 15:06:51 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-2836e8be-86b5-445e-a2da-35a748226c33 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:06:51 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-2836e8be-86b5-445e-a2da-35a748226c33 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] [instance: b0637e45-4a13-4970-b933-7c5fc5b84fff] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:06:51 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-2836e8be-86b5-445e-a2da-35a748226c33 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:06:51 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-2836e8be-86b5-445e-a2da-35a748226c33 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:06:51 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-2836e8be-86b5-445e-a2da-35a748226c33 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:06:51 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-2836e8be-86b5-445e-a2da-35a748226c33 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:06:51 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-2836e8be-86b5-445e-a2da-35a748226c33 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:06:51 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-2836e8be-86b5-445e-a2da-35a748226c33 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:06:51 user devstack@n-api.service[61253]: INFO nova.api.openstack.wsgi [None req-2836e8be-86b5-445e-a2da-35a748226c33 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] HTTP exception thrown: Instance b0637e45-4a13-4970-b933-7c5fc5b84fff could not be found. Apr 19 15:06:51 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-2836e8be-86b5-445e-a2da-35a748226c33 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Request method failure captured: Apr 19 15:06:51 user devstack@n-api.service[61253]: request: DELETE /compute/v2.1/servers/b0637e45-4a13-4970-b933-7c5fc5b84fff HTTP/1.1 Apr 19 15:06:51 user devstack@n-api.service[61253]: Accept: application/json Apr 19 15:06:51 user devstack@n-api.service[61253]: Accept-Encoding: identity Apr 19 15:06:51 user devstack@n-api.service[61253]: Connection: close Apr 19 15:06:51 user devstack@n-api.service[61253]: Content-Length: 0 Apr 19 15:06:51 user devstack@n-api.service[61253]: Content-Type: application/json Apr 19 15:06:51 user devstack@n-api.service[61253]: Host: 10.0.0.210 Apr 19 15:06:51 user devstack@n-api.service[61253]: Openstack-System-Scope: None Apr 19 15:06:51 user devstack@n-api.service[61253]: User-Agent: python-urllib3/1.26.15 Apr 19 15:06:51 user devstack@n-api.service[61253]: X-Auth-Token: gAAAAABkQAI8_De3m8i4MMbROun7tITHVSEDr6P7gwhCfyS6Xu_dj-bYjagGc5LfxmKGmLzBdYtfsRgeiDTeAYOze9Vh83Wmb5CbpJJq-dZ8gSsMusfNckclBz9rDsojo8ZbXByRHjg1ByUo5KL5QO66tVhKzm7qlX-d0Zd42EmMyFFqGK618gI Apr 19 15:06:51 user devstack@n-api.service[61253]: X-Domain-Id: None Apr 19 15:06:51 user devstack@n-api.service[61253]: X-Domain-Name: None Apr 19 15:06:51 user devstack@n-api.service[61253]: X-Identity-Status: Confirmed Apr 19 15:06:51 user devstack@n-api.service[61253]: X-Is-Admin-Project: True Apr 19 15:06:51 user devstack@n-api.service[61253]: X-Openstack-Nova-Api-Version: 2.20 Apr 19 15:06:51 user devstack@n-api.service[61253]: X-Project-Domain-Id: default Apr 19 15:06:51 user devstack@n-api.service[61253]: X-Project-Domain-Name: Default Apr 19 15:06:51 user devstack@n-api.service[61253]: X-Project-Id: ccc36f2d52844dc090a6c23e0f14d9a9 Apr 19 15:06:51 user devstack@n-api.service[61253]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2044517699 Apr 19 15:06:51 user devstack@n-api.service[61253]: X-Role: member,reader Apr 19 15:06:51 user devstack@n-api.service[61253]: X-Roles: member,reader Apr 19 15:06:51 user devstack@n-api.service[61253]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ccc36f2d52844dc090a6c23e0f14d9a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ccc36f2d52844dc090a6c23e0f14d9a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ccc36f2d52844dc090a6c23e0f14d9a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 15:06:51 user devstack@n-api.service[61253]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2044517699 Apr 19 15:06:51 user devstack@n-api.service[61253]: X-Tenant-Id: ccc36f2d52844dc090a6c23e0f14d9a9 Apr 19 15:06:51 user devstack@n-api.service[61253]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2044517699 Apr 19 15:06:51 user devstack@n-api.service[61253]: X-User: tempest-AttachVolumeShelveTestJSON-2044517699-project-member Apr 19 15:06:51 user devstack@n-api.service[61253]: X-User-Domain-Id: default Apr 19 15:06:51 user devstack@n-api.service[61253]: X-User-Domain-Name: Default Apr 19 15:06:51 user devstack@n-api.service[61253]: X-User-Id: 6f765d12fe234d0a9df2aa1f12e71b9d Apr 19 15:06:51 user devstack@n-api.service[61253]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2044517699-project-member Apr 19 15:06:51 user devstack@n-api.service[61253]: method: > Apr 19 15:06:51 user devstack@n-api.service[61253]: exception: Instance b0637e45-4a13-4970-b933-7c5fc5b84fff could not be found. Apr 19 15:06:51 user devstack@n-api.service[61253]: action_args: {'id': 'b0637e45-4a13-4970-b933-7c5fc5b84fff'} Apr 19 15:06:51 user devstack@n-api.service[61253]: {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:06:51 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:06:51 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:06:51 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:06:51 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:06:51 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:06:51 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:06:51 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:06:51 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:06:51 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:06:51 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0637e45-4a13-4970-b933-7c5fc5b84fff could not be found. Apr 19 15:06:51 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 15:06:51 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:06:51 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 15:06:51 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:06:51 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:06:51 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:06:51 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:06:51 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:06:51 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:06:51 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:06:51 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 19 15:06:51 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 19 15:06:51 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 19 15:06:51 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 19 15:06:51 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:06:51 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:06:51 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:06:51 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:06:51 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0637e45-4a13-4970-b933-7c5fc5b84fff could not be found. Apr 19 15:06:51 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 15:06:51 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:06:51 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 15:06:51 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:06:51 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:06:51 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:06:51 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:06:51 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:06:51 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0637e45-4a13-4970-b933-7c5fc5b84fff could not be found. Apr 19 15:06:51 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 15:06:51 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-2836e8be-86b5-445e-a2da-35a748226c33 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Returning 404 to user: Instance b0637e45-4a13-4970-b933-7c5fc5b84fff could not be found. {{(pid=61253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:06:51 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-2836e8be-86b5-445e-a2da-35a748226c33 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b0637e45-4a13-4970-b933-7c5fc5b84fff" status: 404 len: 111 microversion: 2.20 time: 0.027393 Apr 19 15:06:51 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 149/448] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 19 15:06:51 2023] DELETE /compute/v2.1/servers/b0637e45-4a13-4970-b933-7c5fc5b84fff => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 15:06:51 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-61a3e174-a204-43e3-b2ff-a812e2416195 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:06:51 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-61a3e174-a204-43e3-b2ff-a812e2416195 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] [instance: b0637e45-4a13-4970-b933-7c5fc5b84fff] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:06:51 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-61a3e174-a204-43e3-b2ff-a812e2416195 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:06:51 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-61a3e174-a204-43e3-b2ff-a812e2416195 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:06:51 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-61a3e174-a204-43e3-b2ff-a812e2416195 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:06:51 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-61a3e174-a204-43e3-b2ff-a812e2416195 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:06:51 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-61a3e174-a204-43e3-b2ff-a812e2416195 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:06:51 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-61a3e174-a204-43e3-b2ff-a812e2416195 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:06:51 user devstack@n-api.service[61255]: INFO nova.api.openstack.wsgi [None req-61a3e174-a204-43e3-b2ff-a812e2416195 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] HTTP exception thrown: Instance b0637e45-4a13-4970-b933-7c5fc5b84fff could not be found. Apr 19 15:06:51 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-61a3e174-a204-43e3-b2ff-a812e2416195 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Request method failure captured: Apr 19 15:06:51 user devstack@n-api.service[61255]: request: GET /compute/v2.1/servers/b0637e45-4a13-4970-b933-7c5fc5b84fff HTTP/1.1 Apr 19 15:06:51 user devstack@n-api.service[61255]: Accept: application/json Apr 19 15:06:51 user devstack@n-api.service[61255]: Accept-Encoding: identity Apr 19 15:06:51 user devstack@n-api.service[61255]: Connection: close Apr 19 15:06:51 user devstack@n-api.service[61255]: Content-Length: 0 Apr 19 15:06:51 user devstack@n-api.service[61255]: Content-Type: application/json Apr 19 15:06:51 user devstack@n-api.service[61255]: Host: 10.0.0.210 Apr 19 15:06:51 user devstack@n-api.service[61255]: Openstack-System-Scope: None Apr 19 15:06:51 user devstack@n-api.service[61255]: User-Agent: python-urllib3/1.26.15 Apr 19 15:06:51 user devstack@n-api.service[61255]: X-Auth-Token: gAAAAABkQAI8_De3m8i4MMbROun7tITHVSEDr6P7gwhCfyS6Xu_dj-bYjagGc5LfxmKGmLzBdYtfsRgeiDTeAYOze9Vh83Wmb5CbpJJq-dZ8gSsMusfNckclBz9rDsojo8ZbXByRHjg1ByUo5KL5QO66tVhKzm7qlX-d0Zd42EmMyFFqGK618gI Apr 19 15:06:51 user devstack@n-api.service[61255]: X-Domain-Id: None Apr 19 15:06:51 user devstack@n-api.service[61255]: X-Domain-Name: None Apr 19 15:06:51 user devstack@n-api.service[61255]: X-Identity-Status: Confirmed Apr 19 15:06:51 user devstack@n-api.service[61255]: X-Is-Admin-Project: True Apr 19 15:06:51 user devstack@n-api.service[61255]: X-Openstack-Nova-Api-Version: 2.20 Apr 19 15:06:51 user devstack@n-api.service[61255]: X-Project-Domain-Id: default Apr 19 15:06:51 user devstack@n-api.service[61255]: X-Project-Domain-Name: Default Apr 19 15:06:51 user devstack@n-api.service[61255]: X-Project-Id: ccc36f2d52844dc090a6c23e0f14d9a9 Apr 19 15:06:51 user devstack@n-api.service[61255]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2044517699 Apr 19 15:06:51 user devstack@n-api.service[61255]: X-Role: member,reader Apr 19 15:06:51 user devstack@n-api.service[61255]: X-Roles: member,reader Apr 19 15:06:51 user devstack@n-api.service[61255]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ccc36f2d52844dc090a6c23e0f14d9a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ccc36f2d52844dc090a6c23e0f14d9a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ccc36f2d52844dc090a6c23e0f14d9a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 15:06:51 user devstack@n-api.service[61255]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2044517699 Apr 19 15:06:51 user devstack@n-api.service[61255]: X-Tenant-Id: ccc36f2d52844dc090a6c23e0f14d9a9 Apr 19 15:06:51 user devstack@n-api.service[61255]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2044517699 Apr 19 15:06:51 user devstack@n-api.service[61255]: X-User: tempest-AttachVolumeShelveTestJSON-2044517699-project-member Apr 19 15:06:51 user devstack@n-api.service[61255]: X-User-Domain-Id: default Apr 19 15:06:51 user devstack@n-api.service[61255]: X-User-Domain-Name: Default Apr 19 15:06:51 user devstack@n-api.service[61255]: X-User-Id: 6f765d12fe234d0a9df2aa1f12e71b9d Apr 19 15:06:51 user devstack@n-api.service[61255]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2044517699-project-member Apr 19 15:06:51 user devstack@n-api.service[61255]: method: > Apr 19 15:06:51 user devstack@n-api.service[61255]: exception: Instance b0637e45-4a13-4970-b933-7c5fc5b84fff could not be found. Apr 19 15:06:51 user devstack@n-api.service[61255]: action_args: {'id': 'b0637e45-4a13-4970-b933-7c5fc5b84fff'} Apr 19 15:06:51 user devstack@n-api.service[61255]: {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0637e45-4a13-4970-b933-7c5fc5b84fff could not be found. Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0637e45-4a13-4970-b933-7c5fc5b84fff could not be found. Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0637e45-4a13-4970-b933-7c5fc5b84fff could not be found. Apr 19 15:06:51 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 15:06:51 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-61a3e174-a204-43e3-b2ff-a812e2416195 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] Returning 404 to user: Instance b0637e45-4a13-4970-b933-7c5fc5b84fff could not be found. {{(pid=61255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:06:51 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-61a3e174-a204-43e3-b2ff-a812e2416195 tempest-AttachVolumeShelveTestJSON-2044517699 tempest-AttachVolumeShelveTestJSON-2044517699-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0637e45-4a13-4970-b933-7c5fc5b84fff" status: 404 len: 111 microversion: 2.20 time: 0.031233 Apr 19 15:06:51 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 152/449] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 15:06:51 2023] GET /compute/v2.1/servers/b0637e45-4a13-4970-b933-7c5fc5b84fff => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 15:07:43 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-6f662077-645a-4fbd-83be-dbc2032e3eb0 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:07:43 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-6f662077-645a-4fbd-83be-dbc2032e3eb0 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] [instance: 99c2d5c6-9b60-4265-9b7c-a3d970df83c7] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:07:43 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_api:SELECT=4 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:07:43 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell1:SELECT=4 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:07:43 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-6f662077-645a-4fbd-83be-dbc2032e3eb0 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:07:43 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-6f662077-645a-4fbd-83be-dbc2032e3eb0 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:07:43 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-6f662077-645a-4fbd-83be-dbc2032e3eb0 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:07:43 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-6f662077-645a-4fbd-83be-dbc2032e3eb0 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:07:43 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-6f662077-645a-4fbd-83be-dbc2032e3eb0 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:07:43 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-6f662077-645a-4fbd-83be-dbc2032e3eb0 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:07:43 user devstack@n-api.service[61254]: DEBUG nova.policy [None req-6f662077-645a-4fbd-83be-dbc2032e3eb0 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cac3222b6a46af94d475533efdb6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b55a0da17744d83b432ad3994d1a4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61254) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:07:43 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-6f662077-645a-4fbd-83be-dbc2032e3eb0 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99c2d5c6-9b60-4265-9b7c-a3d970df83c7" status: 200 len: 1494 microversion: 2.1 time: 0.241717 Apr 19 15:07:43 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 149/450] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:07:43 2023] GET /compute/v2.1/servers/99c2d5c6-9b60-4265-9b7c-a3d970df83c7 => generated 1494 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:08:43 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:08:43 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell1:SELECT=2 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:08:43 user devstack@n-api.service[61253]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 15:08:43 user devstack@n-api.service[61253]: Wed Apr 19 15:08:43 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6e7ecd24-b21a-40f1-aea3-e87104f260bf (ip 10.0.0.210) !!! Apr 19 15:08:43 user devstack@n-api.service[61253]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 15:08:43 user devstack@n-api.service[61253]: Wed Apr 19 15:08:43 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6e7ecd24-b21a-40f1-aea3-e87104f260bf (ip 10.0.0.210) !!! Apr 19 15:08:43 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-0de36ea4-cd27-4243-88bf-297faf40a7c1 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:08:43 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-0de36ea4-cd27-4243-88bf-297faf40a7c1 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] [instance: 6e7ecd24-b21a-40f1-aea3-e87104f260bf] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:08:43 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-0de36ea4-cd27-4243-88bf-297faf40a7c1 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:08:43 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-0de36ea4-cd27-4243-88bf-297faf40a7c1 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:08:43 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-0de36ea4-cd27-4243-88bf-297faf40a7c1 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:08:43 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-0de36ea4-cd27-4243-88bf-297faf40a7c1 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:08:43 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-0de36ea4-cd27-4243-88bf-297faf40a7c1 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:08:43 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-0de36ea4-cd27-4243-88bf-297faf40a7c1 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:08:43 user devstack@n-api.service[61253]: INFO nova.api.openstack.wsgi [None req-0de36ea4-cd27-4243-88bf-297faf40a7c1 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] HTTP exception thrown: Instance 6e7ecd24-b21a-40f1-aea3-e87104f260bf could not be found. Apr 19 15:08:43 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-0de36ea4-cd27-4243-88bf-297faf40a7c1 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Request method failure captured: Apr 19 15:08:43 user devstack@n-api.service[61253]: request: DELETE /compute/v2.1/servers/6e7ecd24-b21a-40f1-aea3-e87104f260bf HTTP/1.1 Apr 19 15:08:43 user devstack@n-api.service[61253]: Accept: application/json Apr 19 15:08:43 user devstack@n-api.service[61253]: Accept-Encoding: identity Apr 19 15:08:43 user devstack@n-api.service[61253]: Connection: close Apr 19 15:08:43 user devstack@n-api.service[61253]: Content-Length: 0 Apr 19 15:08:43 user devstack@n-api.service[61253]: Content-Type: application/json Apr 19 15:08:43 user devstack@n-api.service[61253]: Host: 10.0.0.210 Apr 19 15:08:43 user devstack@n-api.service[61253]: Openstack-System-Scope: None Apr 19 15:08:43 user devstack@n-api.service[61253]: User-Agent: python-urllib3/1.26.15 Apr 19 15:08:43 user devstack@n-api.service[61253]: X-Auth-Token: gAAAAABkQAH17G1z-eDF9rWS5jiLFpdio4lSZe39DYlD33eMAYaSfsR1foo2esxOySOzRms29D1l4sTwZMiqt_3qR6Hl11NpbgMxVGIoUeOfZT6o266IQVs4ScZlGrq3661OzhzYXuKgX93UvMhm2hdLNjkx2SCRwrRAK5ax1tIWHca3739pKNQ Apr 19 15:08:43 user devstack@n-api.service[61253]: X-Domain-Id: None Apr 19 15:08:43 user devstack@n-api.service[61253]: X-Domain-Name: None Apr 19 15:08:43 user devstack@n-api.service[61253]: X-Identity-Status: Confirmed Apr 19 15:08:43 user devstack@n-api.service[61253]: X-Is-Admin-Project: True Apr 19 15:08:43 user devstack@n-api.service[61253]: X-Project-Domain-Id: default Apr 19 15:08:43 user devstack@n-api.service[61253]: X-Project-Domain-Name: Default Apr 19 15:08:43 user devstack@n-api.service[61253]: X-Project-Id: 6b55a0da17744d83b432ad3994d1a4b4 Apr 19 15:08:43 user devstack@n-api.service[61253]: X-Project-Name: tempest-ServersNegativeTestJSON-354425430 Apr 19 15:08:43 user devstack@n-api.service[61253]: X-Role: member,reader Apr 19 15:08:43 user devstack@n-api.service[61253]: X-Roles: member,reader Apr 19 15:08:43 user devstack@n-api.service[61253]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6b55a0da17744d83b432ad3994d1a4b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6b55a0da17744d83b432ad3994d1a4b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6b55a0da17744d83b432ad3994d1a4b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 15:08:43 user devstack@n-api.service[61253]: X-Tenant: tempest-ServersNegativeTestJSON-354425430 Apr 19 15:08:43 user devstack@n-api.service[61253]: X-Tenant-Id: 6b55a0da17744d83b432ad3994d1a4b4 Apr 19 15:08:43 user devstack@n-api.service[61253]: X-Tenant-Name: tempest-ServersNegativeTestJSON-354425430 Apr 19 15:08:43 user devstack@n-api.service[61253]: X-User: tempest-ServersNegativeTestJSON-354425430-project-member Apr 19 15:08:43 user devstack@n-api.service[61253]: X-User-Domain-Id: default Apr 19 15:08:43 user devstack@n-api.service[61253]: X-User-Domain-Name: Default Apr 19 15:08:43 user devstack@n-api.service[61253]: X-User-Id: 88cac3222b6a46af94d475533efdb6a4 Apr 19 15:08:43 user devstack@n-api.service[61253]: X-User-Name: tempest-ServersNegativeTestJSON-354425430-project-member Apr 19 15:08:43 user devstack@n-api.service[61253]: method: > Apr 19 15:08:43 user devstack@n-api.service[61253]: exception: Instance 6e7ecd24-b21a-40f1-aea3-e87104f260bf could not be found. Apr 19 15:08:43 user devstack@n-api.service[61253]: action_args: {'id': '6e7ecd24-b21a-40f1-aea3-e87104f260bf'} Apr 19 15:08:43 user devstack@n-api.service[61253]: {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:08:43 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:08:43 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:08:43 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:08:43 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:08:43 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:08:43 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:08:43 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:08:43 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:08:43 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:08:43 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e7ecd24-b21a-40f1-aea3-e87104f260bf could not be found. Apr 19 15:08:43 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 15:08:43 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:08:43 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 15:08:43 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:08:43 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:08:43 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:08:43 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:08:43 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:08:43 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:08:43 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:08:43 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 19 15:08:43 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 19 15:08:43 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 19 15:08:43 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 19 15:08:43 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:08:43 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:08:43 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:08:43 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:08:43 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e7ecd24-b21a-40f1-aea3-e87104f260bf could not be found. Apr 19 15:08:43 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 15:08:43 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:08:43 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 15:08:43 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:08:43 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:08:43 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:08:43 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:08:43 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:08:43 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e7ecd24-b21a-40f1-aea3-e87104f260bf could not be found. Apr 19 15:08:43 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 15:08:43 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-0de36ea4-cd27-4243-88bf-297faf40a7c1 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Returning 404 to user: Instance 6e7ecd24-b21a-40f1-aea3-e87104f260bf could not be found. {{(pid=61253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:08:43 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-0de36ea4-cd27-4243-88bf-297faf40a7c1 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6e7ecd24-b21a-40f1-aea3-e87104f260bf" status: 404 len: 111 microversion: 2.1 time: 0.045350 Apr 19 15:08:43 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 150/451] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 15:08:43 2023] DELETE /compute/v2.1/servers/6e7ecd24-b21a-40f1-aea3-e87104f260bf => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 19 15:08:43 user devstack@n-api.service[61255]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 15:08:43 user devstack@n-api.service[61255]: Wed Apr 19 15:08:43 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6e7ecd24-b21a-40f1-aea3-e87104f260bf (ip 10.0.0.210) !!! Apr 19 15:08:43 user devstack@n-api.service[61255]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 15:08:43 user devstack@n-api.service[61255]: Wed Apr 19 15:08:43 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6e7ecd24-b21a-40f1-aea3-e87104f260bf (ip 10.0.0.210) !!! Apr 19 15:08:43 user devstack@n-api.service[61255]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 15:08:43 user devstack@n-api.service[61255]: Wed Apr 19 15:08:43 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6e7ecd24-b21a-40f1-aea3-e87104f260bf (ip 10.0.0.210) !!! Apr 19 15:08:43 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_api:SELECT=6 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:08:43 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell1:SELECT=10 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:08:43 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-1a293763-6f4f-4644-9137-85013c737f05 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Calling method '>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:08:43 user devstack@n-api.service[61255]: DEBUG nova.compute.api [None req-1a293763-6f4f-4644-9137-85013c737f05 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] [instance: 6e7ecd24-b21a-40f1-aea3-e87104f260bf] Fetching instance by UUID {{(pid=61255) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:08:43 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-1a293763-6f4f-4644-9137-85013c737f05 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:08:43 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-1a293763-6f4f-4644-9137-85013c737f05 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:08:43 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-1a293763-6f4f-4644-9137-85013c737f05 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:08:43 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-1a293763-6f4f-4644-9137-85013c737f05 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:08:43 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-1a293763-6f4f-4644-9137-85013c737f05 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:08:43 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [None req-1a293763-6f4f-4644-9137-85013c737f05 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:08:43 user devstack@n-api.service[61255]: INFO nova.api.openstack.wsgi [None req-1a293763-6f4f-4644-9137-85013c737f05 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] HTTP exception thrown: Instance 6e7ecd24-b21a-40f1-aea3-e87104f260bf could not be found. Apr 19 15:08:43 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-1a293763-6f4f-4644-9137-85013c737f05 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Request method failure captured: Apr 19 15:08:43 user devstack@n-api.service[61255]: request: GET /compute/v2.1/servers/6e7ecd24-b21a-40f1-aea3-e87104f260bf HTTP/1.1 Apr 19 15:08:43 user devstack@n-api.service[61255]: Accept: application/json Apr 19 15:08:43 user devstack@n-api.service[61255]: Accept-Encoding: identity Apr 19 15:08:43 user devstack@n-api.service[61255]: Connection: close Apr 19 15:08:43 user devstack@n-api.service[61255]: Content-Length: 0 Apr 19 15:08:43 user devstack@n-api.service[61255]: Content-Type: application/json Apr 19 15:08:43 user devstack@n-api.service[61255]: Host: 10.0.0.210 Apr 19 15:08:43 user devstack@n-api.service[61255]: Openstack-System-Scope: None Apr 19 15:08:43 user devstack@n-api.service[61255]: User-Agent: python-urllib3/1.26.15 Apr 19 15:08:43 user devstack@n-api.service[61255]: X-Auth-Token: gAAAAABkQAH17G1z-eDF9rWS5jiLFpdio4lSZe39DYlD33eMAYaSfsR1foo2esxOySOzRms29D1l4sTwZMiqt_3qR6Hl11NpbgMxVGIoUeOfZT6o266IQVs4ScZlGrq3661OzhzYXuKgX93UvMhm2hdLNjkx2SCRwrRAK5ax1tIWHca3739pKNQ Apr 19 15:08:43 user devstack@n-api.service[61255]: X-Domain-Id: None Apr 19 15:08:43 user devstack@n-api.service[61255]: X-Domain-Name: None Apr 19 15:08:43 user devstack@n-api.service[61255]: X-Identity-Status: Confirmed Apr 19 15:08:43 user devstack@n-api.service[61255]: X-Is-Admin-Project: True Apr 19 15:08:43 user devstack@n-api.service[61255]: X-Project-Domain-Id: default Apr 19 15:08:43 user devstack@n-api.service[61255]: X-Project-Domain-Name: Default Apr 19 15:08:43 user devstack@n-api.service[61255]: X-Project-Id: 6b55a0da17744d83b432ad3994d1a4b4 Apr 19 15:08:43 user devstack@n-api.service[61255]: X-Project-Name: tempest-ServersNegativeTestJSON-354425430 Apr 19 15:08:43 user devstack@n-api.service[61255]: X-Role: member,reader Apr 19 15:08:43 user devstack@n-api.service[61255]: X-Roles: member,reader Apr 19 15:08:43 user devstack@n-api.service[61255]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6b55a0da17744d83b432ad3994d1a4b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6b55a0da17744d83b432ad3994d1a4b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6b55a0da17744d83b432ad3994d1a4b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 15:08:43 user devstack@n-api.service[61255]: X-Tenant: tempest-ServersNegativeTestJSON-354425430 Apr 19 15:08:43 user devstack@n-api.service[61255]: X-Tenant-Id: 6b55a0da17744d83b432ad3994d1a4b4 Apr 19 15:08:43 user devstack@n-api.service[61255]: X-Tenant-Name: tempest-ServersNegativeTestJSON-354425430 Apr 19 15:08:43 user devstack@n-api.service[61255]: X-User: tempest-ServersNegativeTestJSON-354425430-project-member Apr 19 15:08:43 user devstack@n-api.service[61255]: X-User-Domain-Id: default Apr 19 15:08:43 user devstack@n-api.service[61255]: X-User-Domain-Name: Default Apr 19 15:08:43 user devstack@n-api.service[61255]: X-User-Id: 88cac3222b6a46af94d475533efdb6a4 Apr 19 15:08:43 user devstack@n-api.service[61255]: X-User-Name: tempest-ServersNegativeTestJSON-354425430-project-member Apr 19 15:08:43 user devstack@n-api.service[61255]: method: > Apr 19 15:08:43 user devstack@n-api.service[61255]: exception: Instance 6e7ecd24-b21a-40f1-aea3-e87104f260bf could not be found. Apr 19 15:08:43 user devstack@n-api.service[61255]: action_args: {'id': '6e7ecd24-b21a-40f1-aea3-e87104f260bf'} Apr 19 15:08:43 user devstack@n-api.service[61255]: {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:08:43 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:08:43 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:08:43 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:08:43 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:08:43 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:08:43 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:08:43 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:08:43 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:08:43 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:08:43 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e7ecd24-b21a-40f1-aea3-e87104f260bf could not be found. Apr 19 15:08:43 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 15:08:43 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:08:43 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 15:08:43 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:08:43 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:08:43 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:08:43 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:08:43 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:08:43 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:08:43 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:08:43 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 15:08:43 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 15:08:43 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:08:43 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:08:43 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:08:43 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:08:43 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e7ecd24-b21a-40f1-aea3-e87104f260bf could not be found. Apr 19 15:08:43 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 15:08:43 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:08:43 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 15:08:43 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:08:43 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:08:43 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:08:43 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:08:43 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:08:43 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e7ecd24-b21a-40f1-aea3-e87104f260bf could not be found. Apr 19 15:08:43 user devstack@n-api.service[61255]: ERROR nova.api.openstack.wsgi Apr 19 15:08:43 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-1a293763-6f4f-4644-9137-85013c737f05 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Returning 404 to user: Instance 6e7ecd24-b21a-40f1-aea3-e87104f260bf could not be found. {{(pid=61255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:08:43 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-1a293763-6f4f-4644-9137-85013c737f05 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e7ecd24-b21a-40f1-aea3-e87104f260bf" status: 404 len: 111 microversion: 2.1 time: 0.042811 Apr 19 15:08:43 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 153/452] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:08:43 2023] GET /compute/v2.1/servers/6e7ecd24-b21a-40f1-aea3-e87104f260bf => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 15:08:43 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_api:SELECT=2 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:08:43 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell1:SELECT=6 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:08:43 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-e259cc82-297d-4c73-894c-dca0a35a1b2e tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Calling method '>' {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:08:43 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-e259cc82-297d-4c73-894c-dca0a35a1b2e tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] [instance: 99c2d5c6-9b60-4265-9b7c-a3d970df83c7] Fetching instance by UUID {{(pid=61254) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:08:43 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-e259cc82-297d-4c73-894c-dca0a35a1b2e tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:08:43 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-e259cc82-297d-4c73-894c-dca0a35a1b2e tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:08:43 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-e259cc82-297d-4c73-894c-dca0a35a1b2e tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:08:43 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-e259cc82-297d-4c73-894c-dca0a35a1b2e tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:08:43 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-e259cc82-297d-4c73-894c-dca0a35a1b2e tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:08:43 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [None req-e259cc82-297d-4c73-894c-dca0a35a1b2e tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:08:43 user devstack@n-api.service[61254]: DEBUG nova.compute.api [None req-e259cc82-297d-4c73-894c-dca0a35a1b2e tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] [instance: 99c2d5c6-9b60-4265-9b7c-a3d970df83c7] Going to try to terminate instance {{(pid=61254) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 15:08:43 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-e259cc82-297d-4c73-894c-dca0a35a1b2e tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/99c2d5c6-9b60-4265-9b7c-a3d970df83c7" status: 204 len: 0 microversion: 2.1 time: 0.143422 Apr 19 15:08:43 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 150/453] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 15:08:43 2023] DELETE /compute/v2.1/servers/99c2d5c6-9b60-4265-9b7c-a3d970df83c7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 15:08:43 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-b7d4bff0-0d5f-434c-ac4d-a7db844b88a0 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:08:43 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-b7d4bff0-0d5f-434c-ac4d-a7db844b88a0 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] [instance: 99c2d5c6-9b60-4265-9b7c-a3d970df83c7] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:08:43 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-b7d4bff0-0d5f-434c-ac4d-a7db844b88a0 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:08:43 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-b7d4bff0-0d5f-434c-ac4d-a7db844b88a0 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:08:43 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-b7d4bff0-0d5f-434c-ac4d-a7db844b88a0 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:08:43 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-b7d4bff0-0d5f-434c-ac4d-a7db844b88a0 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:08:43 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-b7d4bff0-0d5f-434c-ac4d-a7db844b88a0 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:08:43 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-b7d4bff0-0d5f-434c-ac4d-a7db844b88a0 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:08:44 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-72f8d066-1505-4c8f-8a69-b49a1ef549c9 req-942fc6cc-e587-4eb5-93f6-3c5a85872a3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99c2d5c6-9b60-4265-9b7c-a3d970df83c7", "name": "network-vif-unplugged", "status": "completed", "tag": "dc338427-108e-4cf2-8cd9-a1a06bfe1513"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:08:44 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-72f8d066-1505-4c8f-8a69-b49a1ef549c9 req-942fc6cc-e587-4eb5-93f6-3c5a85872a3d service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:08:44 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-72f8d066-1505-4c8f-8a69-b49a1ef549c9 req-942fc6cc-e587-4eb5-93f6-3c5a85872a3d service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:08:44 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-72f8d066-1505-4c8f-8a69-b49a1ef549c9 req-942fc6cc-e587-4eb5-93f6-3c5a85872a3d service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:08:44 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-72f8d066-1505-4c8f-8a69-b49a1ef549c9 req-942fc6cc-e587-4eb5-93f6-3c5a85872a3d service nova] Creating event network-vif-unplugged:dc338427-108e-4cf2-8cd9-a1a06bfe1513 for instance 99c2d5c6-9b60-4265-9b7c-a3d970df83c7 on user Apr 19 15:08:44 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [req-72f8d066-1505-4c8f-8a69-b49a1ef549c9 req-942fc6cc-e587-4eb5-93f6-3c5a85872a3d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.167912 Apr 19 15:08:44 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 154/454] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:08:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:08:44 user devstack@n-api.service[61253]: DEBUG nova.policy [None req-b7d4bff0-0d5f-434c-ac4d-a7db844b88a0 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cac3222b6a46af94d475533efdb6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b55a0da17744d83b432ad3994d1a4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61253) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:08:44 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-b7d4bff0-0d5f-434c-ac4d-a7db844b88a0 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99c2d5c6-9b60-4265-9b7c-a3d970df83c7" status: 200 len: 1500 microversion: 2.1 time: 0.435018 Apr 19 15:08:44 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 151/455] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:08:43 2023] GET /compute/v2.1/servers/99c2d5c6-9b60-4265-9b7c-a3d970df83c7 => generated 1500 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:08:45 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [req-d869566a-deea-4374-9da3-684d16837718 req-b170180c-26c7-4e37-bddb-947dbbe3cc04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99c2d5c6-9b60-4265-9b7c-a3d970df83c7", "name": "network-vif-deleted", "tag": "dc338427-108e-4cf2-8cd9-a1a06bfe1513"}]} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:08:45 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-d869566a-deea-4374-9da3-684d16837718 req-b170180c-26c7-4e37-bddb-947dbbe3cc04 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:08:45 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-d869566a-deea-4374-9da3-684d16837718 req-b170180c-26c7-4e37-bddb-947dbbe3cc04 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:08:45 user devstack@n-api.service[61254]: DEBUG oslo_concurrency.lockutils [req-d869566a-deea-4374-9da3-684d16837718 req-b170180c-26c7-4e37-bddb-947dbbe3cc04 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61254) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:08:45 user devstack@n-api.service[61254]: INFO nova.api.openstack.compute.server_external_events [req-d869566a-deea-4374-9da3-684d16837718 req-b170180c-26c7-4e37-bddb-947dbbe3cc04 service nova] Creating event network-vif-deleted:dc338427-108e-4cf2-8cd9-a1a06bfe1513 for instance 99c2d5c6-9b60-4265-9b7c-a3d970df83c7 on user Apr 19 15:08:45 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [req-d869566a-deea-4374-9da3-684d16837718 req-b170180c-26c7-4e37-bddb-947dbbe3cc04 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090193 Apr 19 15:08:45 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 151/456] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:08:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:08:46 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [req-0d490426-7af9-4dbd-a49c-60aec37df25f req-d681614c-1fb6-4eaa-ad32-a43ac4709127 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99c2d5c6-9b60-4265-9b7c-a3d970df83c7", "name": "network-vif-plugged", "status": "completed", "tag": "dc338427-108e-4cf2-8cd9-a1a06bfe1513"}]} {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:08:46 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-0d490426-7af9-4dbd-a49c-60aec37df25f req-d681614c-1fb6-4eaa-ad32-a43ac4709127 service nova] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:08:46 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-0d490426-7af9-4dbd-a49c-60aec37df25f req-d681614c-1fb6-4eaa-ad32-a43ac4709127 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:08:46 user devstack@n-api.service[61255]: DEBUG oslo_concurrency.lockutils [req-0d490426-7af9-4dbd-a49c-60aec37df25f req-d681614c-1fb6-4eaa-ad32-a43ac4709127 service nova] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61255) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:08:46 user devstack@n-api.service[61255]: INFO nova.api.openstack.compute.server_external_events [req-0d490426-7af9-4dbd-a49c-60aec37df25f req-d681614c-1fb6-4eaa-ad32-a43ac4709127 service nova] Creating event network-vif-plugged:dc338427-108e-4cf2-8cd9-a1a06bfe1513 for instance 99c2d5c6-9b60-4265-9b7c-a3d970df83c7 on user Apr 19 15:08:46 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [req-0d490426-7af9-4dbd-a49c-60aec37df25f req-d681614c-1fb6-4eaa-ad32-a43ac4709127 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031251 Apr 19 15:08:46 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 155/457] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:08:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:09:34 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-67c832ba-42d2-4709-901f-840da5f0c2c1 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Calling method '>' {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:09:34 user devstack@n-api.service[61253]: DEBUG nova.compute.api [None req-67c832ba-42d2-4709-901f-840da5f0c2c1 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] [instance: 99c2d5c6-9b60-4265-9b7c-a3d970df83c7] Fetching instance by UUID {{(pid=61253) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:09:34 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_api:SELECT=4 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:09:34 user devstack@n-api.service[61253]: DEBUG dbcounter [-] [61253] Writing DB stats nova_cell1:SELECT=8 {{(pid=61253) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:09:34 user devstack@n-api.service[61253]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 19 15:09:34 user devstack@n-api.service[61253]: Wed Apr 19 15:09:34 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/99c2d5c6-9b60-4265-9b7c-a3d970df83c7 (ip 10.0.0.210) !!! Apr 19 15:09:34 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-67c832ba-42d2-4709-901f-840da5f0c2c1 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:09:34 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-67c832ba-42d2-4709-901f-840da5f0c2c1 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:09:34 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-67c832ba-42d2-4709-901f-840da5f0c2c1 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:09:34 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-67c832ba-42d2-4709-901f-840da5f0c2c1 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Acquiring lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:09:34 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-67c832ba-42d2-4709-901f-840da5f0c2c1 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:09:34 user devstack@n-api.service[61253]: DEBUG oslo_concurrency.lockutils [None req-67c832ba-42d2-4709-901f-840da5f0c2c1 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Lock "294c8cd7-7972-4e5f-a789-800b7d5aa37d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61253) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:09:34 user devstack@n-api.service[61253]: INFO nova.api.openstack.wsgi [None req-67c832ba-42d2-4709-901f-840da5f0c2c1 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] HTTP exception thrown: Instance 99c2d5c6-9b60-4265-9b7c-a3d970df83c7 could not be found. Apr 19 15:09:34 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-67c832ba-42d2-4709-901f-840da5f0c2c1 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Request method failure captured: Apr 19 15:09:34 user devstack@n-api.service[61253]: request: GET /compute/v2.1/servers/99c2d5c6-9b60-4265-9b7c-a3d970df83c7 HTTP/1.1 Apr 19 15:09:34 user devstack@n-api.service[61253]: Accept: application/json Apr 19 15:09:34 user devstack@n-api.service[61253]: Accept-Encoding: identity Apr 19 15:09:34 user devstack@n-api.service[61253]: Connection: close Apr 19 15:09:34 user devstack@n-api.service[61253]: Content-Length: 0 Apr 19 15:09:34 user devstack@n-api.service[61253]: Content-Type: application/json Apr 19 15:09:34 user devstack@n-api.service[61253]: Host: 10.0.0.210 Apr 19 15:09:34 user devstack@n-api.service[61253]: Openstack-System-Scope: None Apr 19 15:09:34 user devstack@n-api.service[61253]: User-Agent: python-urllib3/1.26.15 Apr 19 15:09:34 user devstack@n-api.service[61253]: X-Auth-Token: gAAAAABkQAH17G1z-eDF9rWS5jiLFpdio4lSZe39DYlD33eMAYaSfsR1foo2esxOySOzRms29D1l4sTwZMiqt_3qR6Hl11NpbgMxVGIoUeOfZT6o266IQVs4ScZlGrq3661OzhzYXuKgX93UvMhm2hdLNjkx2SCRwrRAK5ax1tIWHca3739pKNQ Apr 19 15:09:34 user devstack@n-api.service[61253]: X-Domain-Id: None Apr 19 15:09:34 user devstack@n-api.service[61253]: X-Domain-Name: None Apr 19 15:09:34 user devstack@n-api.service[61253]: X-Identity-Status: Confirmed Apr 19 15:09:34 user devstack@n-api.service[61253]: X-Is-Admin-Project: True Apr 19 15:09:34 user devstack@n-api.service[61253]: X-Project-Domain-Id: default Apr 19 15:09:34 user devstack@n-api.service[61253]: X-Project-Domain-Name: Default Apr 19 15:09:34 user devstack@n-api.service[61253]: X-Project-Id: 6b55a0da17744d83b432ad3994d1a4b4 Apr 19 15:09:34 user devstack@n-api.service[61253]: X-Project-Name: tempest-ServersNegativeTestJSON-354425430 Apr 19 15:09:34 user devstack@n-api.service[61253]: X-Role: member,reader Apr 19 15:09:34 user devstack@n-api.service[61253]: X-Roles: member,reader Apr 19 15:09:34 user devstack@n-api.service[61253]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6b55a0da17744d83b432ad3994d1a4b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6b55a0da17744d83b432ad3994d1a4b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6b55a0da17744d83b432ad3994d1a4b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 19 15:09:34 user devstack@n-api.service[61253]: X-Tenant: tempest-ServersNegativeTestJSON-354425430 Apr 19 15:09:34 user devstack@n-api.service[61253]: X-Tenant-Id: 6b55a0da17744d83b432ad3994d1a4b4 Apr 19 15:09:34 user devstack@n-api.service[61253]: X-Tenant-Name: tempest-ServersNegativeTestJSON-354425430 Apr 19 15:09:34 user devstack@n-api.service[61253]: X-User: tempest-ServersNegativeTestJSON-354425430-project-member Apr 19 15:09:34 user devstack@n-api.service[61253]: X-User-Domain-Id: default Apr 19 15:09:34 user devstack@n-api.service[61253]: X-User-Domain-Name: Default Apr 19 15:09:34 user devstack@n-api.service[61253]: X-User-Id: 88cac3222b6a46af94d475533efdb6a4 Apr 19 15:09:34 user devstack@n-api.service[61253]: X-User-Name: tempest-ServersNegativeTestJSON-354425430-project-member Apr 19 15:09:34 user devstack@n-api.service[61253]: method: > Apr 19 15:09:34 user devstack@n-api.service[61253]: exception: Instance 99c2d5c6-9b60-4265-9b7c-a3d970df83c7 could not be found. Apr 19 15:09:34 user devstack@n-api.service[61253]: action_args: {'id': '99c2d5c6-9b60-4265-9b7c-a3d970df83c7'} Apr 19 15:09:34 user devstack@n-api.service[61253]: {{(pid=61253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:09:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:09:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:09:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:09:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:09:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:09:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:09:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:09:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:09:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:09:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99c2d5c6-9b60-4265-9b7c-a3d970df83c7 could not be found. Apr 19 15:09:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 15:09:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:09:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 15:09:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:09:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:09:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:09:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:09:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:09:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:09:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:09:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 15:09:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 15:09:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:09:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:09:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:09:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:09:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99c2d5c6-9b60-4265-9b7c-a3d970df83c7 could not be found. Apr 19 15:09:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 15:09:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:09:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 15:09:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:09:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:09:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:09:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:09:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:09:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99c2d5c6-9b60-4265-9b7c-a3d970df83c7 could not be found. Apr 19 15:09:34 user devstack@n-api.service[61253]: ERROR nova.api.openstack.wsgi Apr 19 15:09:34 user devstack@n-api.service[61253]: DEBUG nova.api.openstack.wsgi [None req-67c832ba-42d2-4709-901f-840da5f0c2c1 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] Returning 404 to user: Instance 99c2d5c6-9b60-4265-9b7c-a3d970df83c7 could not be found. {{(pid=61253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:09:34 user devstack@n-api.service[61253]: INFO nova.api.openstack.requestlog [None req-67c832ba-42d2-4709-901f-840da5f0c2c1 tempest-ServersNegativeTestJSON-354425430 tempest-ServersNegativeTestJSON-354425430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99c2d5c6-9b60-4265-9b7c-a3d970df83c7" status: 404 len: 111 microversion: 2.1 time: 0.043465 Apr 19 15:09:34 user devstack@n-api.service[61253]: [pid: 61253|app: 0|req: 152/458] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:09:34 2023] GET /compute/v2.1/servers/99c2d5c6-9b60-4265-9b7c-a3d970df83c7 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 15:10:10 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:10:10 user devstack@n-api.service[61254]: DEBUG dbcounter [-] [61254] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61254) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:10:10 user devstack@n-api.service[61254]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 15:10:10 user devstack@n-api.service[61254]: Wed Apr 19 15:10:10 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.0.0.210) !!! Apr 19 15:10:10 user devstack@n-api.service[61254]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 15:10:10 user devstack@n-api.service[61254]: Wed Apr 19 15:10:10 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.0.0.210) !!! Apr 19 15:10:10 user devstack@n-api.service[61254]: DEBUG nova.api.openstack.wsgi [None req-4fa7462c-8510-4184-825f-f0a887596ae3 tempest-TestVolumeBootPattern-830746011 tempest-TestVolumeBootPattern-830746011-project-member] Action: 'create', calling method: .version_select at 0x7f3cfa8c49d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1320133546", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHz5ay8ykGy1XoJBiLhZxCtlcpHPCmXLfGixSed57c657fUv9n5sRUP+GzD9+lzGgVMl7bKwamGKFh49CFCUGdiBwf+izJVOeZDY9Z5JDZtKLIpUwSxcip3ZTxq05ebfxw=="}} {{(pid=61254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:10:10 user devstack@n-api.service[61254]: DEBUG nova.quota [None req-4fa7462c-8510-4184-825f-f0a887596ae3 tempest-TestVolumeBootPattern-830746011 tempest-TestVolumeBootPattern-830746011-project-member] Getting quotas for project c5b03cb1809e440a97cb1e59218942aa. Resources: {'key_pairs'} {{(pid=61254) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:10:10 user devstack@n-api.service[61254]: DEBUG nova.quota [None req-4fa7462c-8510-4184-825f-f0a887596ae3 tempest-TestVolumeBootPattern-830746011 tempest-TestVolumeBootPattern-830746011-project-member] Getting quotas for user ca7c5e945d9543c5bbd2a3132b75034a and project c5b03cb1809e440a97cb1e59218942aa. Resources: {'key_pairs'} {{(pid=61254) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:10:10 user devstack@n-api.service[61254]: INFO nova.api.openstack.requestlog [None req-4fa7462c-8510-4184-825f-f0a887596ae3 tempest-TestVolumeBootPattern-830746011 tempest-TestVolumeBootPattern-830746011-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.064374 Apr 19 15:10:10 user devstack@n-api.service[61254]: [pid: 61254|app: 0|req: 152/459] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 15:10:10 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:10:13 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_api:SELECT=6 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:10:13 user devstack@n-api.service[61255]: DEBUG dbcounter [-] [61255] Writing DB stats nova_cell1:SELECT=6 {{(pid=61255) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:10:13 user devstack@n-api.service[61255]: DEBUG nova.api.openstack.wsgi [None req-810e36a4-9b24-489e-8c38-cd4631808b37 tempest-TestVolumeBootPattern-830746011 tempest-TestVolumeBootPattern-830746011-project-member] Calling method '.version_select at 0x7f3cfaa0e050>' {{(pid=61255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:10:13 user devstack@n-api.service[61255]: INFO nova.api.openstack.requestlog [None req-810e36a4-9b24-489e-8c38-cd4631808b37 tempest-TestVolumeBootPattern-830746011 tempest-TestVolumeBootPattern-830746011-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1320133546" status: 202 len: 0 microversion: 2.1 time: 0.031452 Apr 19 15:10:13 user devstack@n-api.service[61255]: [pid: 61255|app: 0|req: 156/460] 10.0.0.210 () {62 vars in 1340 bytes} [Wed Apr 19 15:10:13 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1320133546 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)