Apr 21 10:40:47 user devstack@n-api.service[61317]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 21 10:40:47 user devstack@n-api.service[61317]: *** Starting uWSGI 2.0.20-debian (64bit) on [Fri Apr 21 10:40:47 2023] *** Apr 21 10:40:47 user devstack@n-api.service[61317]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 21 10:40:47 user devstack@n-api.service[61317]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 21 10:40:47 user devstack@n-api.service[61317]: nodename: user Apr 21 10:40:47 user devstack@n-api.service[61317]: machine: x86_64 Apr 21 10:40:47 user devstack@n-api.service[61317]: clock source: unix Apr 21 10:40:47 user devstack@n-api.service[61317]: pcre jit disabled Apr 21 10:40:47 user devstack@n-api.service[61317]: detected number of CPU cores: 12 Apr 21 10:40:47 user devstack@n-api.service[61317]: current working directory: / Apr 21 10:40:47 user devstack@n-api.service[61317]: detected binary path: /usr/bin/uwsgi-core Apr 21 10:40:47 user devstack@n-api.service[61317]: your processes number limit is 63637 Apr 21 10:40:47 user devstack@n-api.service[61317]: your memory page size is 4096 bytes Apr 21 10:40:47 user devstack@n-api.service[61317]: detected max file descriptor number: 2048 Apr 21 10:40:47 user devstack@n-api.service[61317]: lock engine: pthread robust mutexes Apr 21 10:40:47 user devstack@n-api.service[61317]: thunder lock: enabled Apr 21 10:40:47 user devstack@n-api.service[61317]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 21 10:40:47 user devstack@n-api.service[61317]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 21 10:40:47 user devstack@n-api.service[61317]: Python main interpreter initialized at 0x55dfde385990 Apr 21 10:40:47 user devstack@n-api.service[61317]: python threads support enabled Apr 21 10:40:47 user devstack@n-api.service[61317]: your server socket listen backlog is limited to 100 connections Apr 21 10:40:47 user devstack@n-api.service[61317]: your mercy for graceful operations on workers is 90 seconds Apr 21 10:40:47 user devstack@n-api.service[61317]: mapped 537436 bytes (524 KB) for 3 cores Apr 21 10:40:47 user devstack@n-api.service[61317]: *** Operational MODE: preforking *** Apr 21 10:40:47 user devstack@n-api.service[61317]: *** uWSGI is running in multiple interpreter mode *** Apr 21 10:40:47 user devstack@n-api.service[61317]: spawned uWSGI master process (pid: 61317) Apr 21 10:40:47 user devstack@n-api.service[61317]: spawned uWSGI worker 1 (pid: 61318, cores: 1) Apr 21 10:40:47 user devstack@n-api.service[61317]: spawned uWSGI worker 2 (pid: 61319, cores: 1) Apr 21 10:40:47 user devstack@n-api.service[61317]: spawned uWSGI worker 3 (pid: 61320, cores: 1) Apr 21 10:40:47 user devstack@n-api.service[61317]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 21 10:40:48 user devstack@n-api.service[61319]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 21 10:40:48 user devstack@n-api.service[61318]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 21 10:40:48 user devstack@n-api.service[61320]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 21 10:40:51 user devstack@n-api.service[61319]: live_migration_uri is deprecated for removal in favor of two other options that Apr 21 10:40:51 user devstack@n-api.service[61319]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 21 10:40:51 user devstack@n-api.service[61319]: and ``live_migration_inbound_addr`` respectively. Apr 21 10:40:51 user devstack@n-api.service[61319]: ). Its value may be silently ignored in the future. Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 21 10:40:51 user devstack@n-api.service[61318]: live_migration_uri is deprecated for removal in favor of two other options that Apr 21 10:40:51 user devstack@n-api.service[61318]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 21 10:40:51 user devstack@n-api.service[61318]: and ``live_migration_inbound_addr`` respectively. Apr 21 10:40:51 user devstack@n-api.service[61318]: ). Its value may be silently ignored in the future. Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 21 10:40:51 user devstack@n-api.service[61320]: live_migration_uri is deprecated for removal in favor of two other options that Apr 21 10:40:51 user devstack@n-api.service[61320]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 21 10:40:51 user devstack@n-api.service[61320]: and ``live_migration_inbound_addr`` respectively. Apr 21 10:40:51 user devstack@n-api.service[61320]: ). Its value may be silently ignored in the future. Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61319) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61318) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61320) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 21 10:40:51 user devstack@n-api.service[61319]: INFO dbcounter [None req-1ab3856b-3ede-45fe-894b-97b6cfc083e6 None None] Registered counter for database nova_api Apr 21 10:40:51 user devstack@n-api.service[61318]: INFO dbcounter [None req-30648425-769a-400f-9dc9-7c0b421f7015 None None] Registered counter for database nova_api Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG oslo_db.sqlalchemy.engines [None req-1ab3856b-3ede-45fe-894b-97b6cfc083e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61319) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 21 10:40:51 user devstack@n-api.service[61320]: INFO dbcounter [None req-c8949cbc-a0a6-4e31-9e61-5ccaa3abe9d6 None None] Registered counter for database nova_api Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writer thread running {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG oslo_db.sqlalchemy.engines [None req-30648425-769a-400f-9dc9-7c0b421f7015 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61318) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG oslo_db.sqlalchemy.engines [None req-c8949cbc-a0a6-4e31-9e61-5ccaa3abe9d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61320) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writer thread running {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writer thread running {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG nova.context [None req-1ab3856b-3ede-45fe-894b-97b6cfc083e6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bb5ee891-ceca-455b-842d-847784699b19(cell1) {{(pid=61319) load_cells /opt/stack/nova/nova/context.py:464}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-1ab3856b-3ede-45fe-894b-97b6cfc083e6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-1ab3856b-3ede-45fe-894b-97b6cfc083e6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-1ab3856b-3ede-45fe-894b-97b6cfc083e6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-1ab3856b-3ede-45fe-894b-97b6cfc083e6 None None] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-1ab3856b-3ede-45fe-894b-97b6cfc083e6 None None] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-1ab3856b-3ede-45fe-894b-97b6cfc083e6 None None] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:40:51 user devstack@n-api.service[61319]: INFO dbcounter [None req-1ab3856b-3ede-45fe-894b-97b6cfc083e6 None None] Registered counter for database nova_cell0 Apr 21 10:40:51 user devstack@n-api.service[61319]: INFO dbcounter [None req-1ab3856b-3ede-45fe-894b-97b6cfc083e6 None None] Registered counter for database nova_cell1 Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG nova.context [None req-30648425-769a-400f-9dc9-7c0b421f7015 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bb5ee891-ceca-455b-842d-847784699b19(cell1) {{(pid=61318) load_cells /opt/stack/nova/nova/context.py:464}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG nova.context [None req-c8949cbc-a0a6-4e31-9e61-5ccaa3abe9d6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bb5ee891-ceca-455b-842d-847784699b19(cell1) {{(pid=61320) load_cells /opt/stack/nova/nova/context.py:464}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG oslo_db.sqlalchemy.engines [None req-1ab3856b-3ede-45fe-894b-97b6cfc083e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61319) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-30648425-769a-400f-9dc9-7c0b421f7015 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-30648425-769a-400f-9dc9-7c0b421f7015 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-c8949cbc-a0a6-4e31-9e61-5ccaa3abe9d6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-c8949cbc-a0a6-4e31-9e61-5ccaa3abe9d6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-30648425-769a-400f-9dc9-7c0b421f7015 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-30648425-769a-400f-9dc9-7c0b421f7015 None None] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-30648425-769a-400f-9dc9-7c0b421f7015 None None] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-c8949cbc-a0a6-4e31-9e61-5ccaa3abe9d6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-c8949cbc-a0a6-4e31-9e61-5ccaa3abe9d6 None None] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-c8949cbc-a0a6-4e31-9e61-5ccaa3abe9d6 None None] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-30648425-769a-400f-9dc9-7c0b421f7015 None None] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-c8949cbc-a0a6-4e31-9e61-5ccaa3abe9d6 None None] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:40:51 user devstack@n-api.service[61318]: INFO dbcounter [None req-30648425-769a-400f-9dc9-7c0b421f7015 None None] Registered counter for database nova_cell0 Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG oslo_db.sqlalchemy.engines [None req-1ab3856b-3ede-45fe-894b-97b6cfc083e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61319) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 21 10:40:51 user devstack@n-api.service[61320]: INFO dbcounter [None req-c8949cbc-a0a6-4e31-9e61-5ccaa3abe9d6 None None] Registered counter for database nova_cell0 Apr 21 10:40:51 user devstack@n-api.service[61318]: INFO dbcounter [None req-30648425-769a-400f-9dc9-7c0b421f7015 None None] Registered counter for database nova_cell1 Apr 21 10:40:51 user devstack@n-api.service[61320]: INFO dbcounter [None req-c8949cbc-a0a6-4e31-9e61-5ccaa3abe9d6 None None] Registered counter for database nova_cell1 Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writer thread running {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writer thread running {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG oslo_db.sqlalchemy.engines [None req-30648425-769a-400f-9dc9-7c0b421f7015 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61318) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writer thread running {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG oslo_db.sqlalchemy.engines [None req-30648425-769a-400f-9dc9-7c0b421f7015 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61318) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG oslo_db.sqlalchemy.engines [None req-c8949cbc-a0a6-4e31-9e61-5ccaa3abe9d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61320) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writer thread running {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG oslo_db.sqlalchemy.engines [None req-c8949cbc-a0a6-4e31-9e61-5ccaa3abe9d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61320) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 21 10:40:51 user devstack@n-api.service[61319]: INFO dbcounter [None req-1ab3856b-3ede-45fe-894b-97b6cfc083e6 None None] Registered counter for database nova_cell0 Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writer thread running {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG oslo_db.sqlalchemy.engines [None req-1ab3856b-3ede-45fe-894b-97b6cfc083e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61319) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 21 10:40:51 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writer thread running {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 21 10:40:51 user devstack@n-api.service[61318]: INFO dbcounter [None req-30648425-769a-400f-9dc9-7c0b421f7015 None None] Registered counter for database nova_cell0 Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writer thread running {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG oslo_db.sqlalchemy.engines [None req-30648425-769a-400f-9dc9-7c0b421f7015 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61318) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 21 10:40:51 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writer thread running {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 21 10:40:51 user devstack@n-api.service[61320]: INFO dbcounter [None req-c8949cbc-a0a6-4e31-9e61-5ccaa3abe9d6 None None] Registered counter for database nova_cell0 Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG oslo_db.sqlalchemy.engines [None req-c8949cbc-a0a6-4e31-9e61-5ccaa3abe9d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61320) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 21 10:40:51 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writer thread running {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 21 10:40:52 user devstack@n-api.service[61318]: WARNING keystonemiddleware.auth_token [None req-30648425-769a-400f-9dc9-7c0b421f7015 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 21 10:40:52 user devstack@n-api.service[61320]: WARNING keystonemiddleware.auth_token [None req-c8949cbc-a0a6-4e31-9e61-5ccaa3abe9d6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 21 10:40:52 user devstack@n-api.service[61318]: WARNING keystonemiddleware.auth_token [None req-30648425-769a-400f-9dc9-7c0b421f7015 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 21 10:40:52 user devstack@n-api.service[61320]: WARNING keystonemiddleware.auth_token [None req-c8949cbc-a0a6-4e31-9e61-5ccaa3abe9d6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 21 10:40:52 user devstack@n-api.service[61319]: WARNING keystonemiddleware.auth_token [None req-1ab3856b-3ede-45fe-894b-97b6cfc083e6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 21 10:40:52 user devstack@n-api.service[61319]: WARNING keystonemiddleware.auth_token [None req-1ab3856b-3ede-45fe-894b-97b6cfc083e6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 21 10:40:52 user devstack@n-api.service[61319]: WARNING keystonemiddleware.auth_token [None req-1ab3856b-3ede-45fe-894b-97b6cfc083e6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 21 10:40:52 user devstack@n-api.service[61319]: WARNING keystonemiddleware.auth_token [None req-1ab3856b-3ede-45fe-894b-97b6cfc083e6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 21 10:40:52 user devstack@n-api.service[61319]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55dfde385990 pid: 61319 (default app) Apr 21 10:40:52 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-1ab3856b-3ede-45fe-894b-97b6cfc083e6 None None] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:40:52 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-1ab3856b-3ede-45fe-894b-97b6cfc083e6 None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001509 Apr 21 10:40:52 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Fri Apr 21 10:40:52 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:40:52 user devstack@n-api.service[61318]: WARNING keystonemiddleware.auth_token [None req-30648425-769a-400f-9dc9-7c0b421f7015 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 21 10:40:52 user devstack@n-api.service[61320]: WARNING keystonemiddleware.auth_token [None req-c8949cbc-a0a6-4e31-9e61-5ccaa3abe9d6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 21 10:40:52 user devstack@n-api.service[61318]: WARNING keystonemiddleware.auth_token [None req-30648425-769a-400f-9dc9-7c0b421f7015 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 21 10:40:52 user devstack@n-api.service[61318]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55dfde385990 pid: 61318 (default app) Apr 21 10:40:52 user devstack@n-api.service[61320]: WARNING keystonemiddleware.auth_token [None req-c8949cbc-a0a6-4e31-9e61-5ccaa3abe9d6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 21 10:40:52 user devstack@n-api.service[61320]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55dfde385990 pid: 61320 (default app) Apr 21 10:42:59 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-1ab3856b-3ede-45fe-894b-97b6cfc083e6 None None] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:42:59 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-1ab3856b-3ede-45fe-894b-97b6cfc083e6 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002629 Apr 21 10:42:59 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 21 10:42:59 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:42:59 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_api:SELECT=3 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:42:59 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell0:SELECT=3 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:42:59 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell1:SELECT=3 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:42:59 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:42:59 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-2eb83ff4-3f90-48f2-aa72-8e868cf81640 admin admin] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:42:59 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-2eb83ff4-3f90-48f2-aa72-8e868cf81640 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.369336 Apr 21 10:42:59 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Fri Apr 21 10:42:59 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:43:01 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-c8949cbc-a0a6-4e31-9e61-5ccaa3abe9d6 None None] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:43:01 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-c8949cbc-a0a6-4e31-9e61-5ccaa3abe9d6 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002143 Apr 21 10:43:01 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 21 10:43:01 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:43:01 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_api:SELECT=3 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:43:01 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell0:SELECT=3 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:43:01 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell1:SELECT=3 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:43:01 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:43:01 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-888014b7-a78f-4e3b-b3cf-548d89cafe77 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 1, "swap": 0, "name": "cirros256", "id": "c1", "ram": 256, "vcpus": 1}} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:43:01 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-888014b7-a78f-4e3b-b3cf-548d89cafe77 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.355885 Apr 21 10:43:01 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 21 10:43:01 2023] POST /compute/v2.1/flavors => generated 405 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 10:43:01 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-8e07ad80-be87-4110-a542-d6366020c0a5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:43:01 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-8e07ad80-be87-4110-a542-d6366020c0a5 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.056762 Apr 21 10:43:01 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 21 10:43:01 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:43:03 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-c8949cbc-a0a6-4e31-9e61-5ccaa3abe9d6 None None] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:43:03 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-c8949cbc-a0a6-4e31-9e61-5ccaa3abe9d6 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001560 Apr 21 10:43:03 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 21 10:43:03 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:43:03 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-345b33c1-1b60-4fdc-a689-897b0e78c9ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "rxtx_factor": 1.0, "disk": 5, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "ram": 512, "swap": 0}} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:43:03 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-345b33c1-1b60-4fdc-a689-897b0e78c9ab admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.103290 Apr 21 10:43:03 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 21 10:43:03 2023] POST /compute/v2.1/flavors => generated 402 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 10:43:03 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-e08fe908-b202-4b06-8e1e-42c3e4bacf5c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:43:03 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-e08fe908-b202-4b06-8e1e-42c3e4bacf5c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028431 Apr 21 10:43:03 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 21 10:43:03 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:43:05 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-c8949cbc-a0a6-4e31-9e61-5ccaa3abe9d6 None None] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:43:05 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-c8949cbc-a0a6-4e31-9e61-5ccaa3abe9d6 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002553 Apr 21 10:43:05 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 21 10:43:05 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:43:05 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-9117b8e5-59be-4639-8e52-7ee815bcdf35 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "name": "ds1G", "id": "d2", "disk": 10, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1}} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:43:05 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-9117b8e5-59be-4639-8e52-7ee815bcdf35 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.080509 Apr 21 10:43:05 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 21 10:43:05 2023] POST /compute/v2.1/flavors => generated 402 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 21 10:43:05 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-42432e7c-ef0a-403a-8a82-cc5826a2d4a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:43:05 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-42432e7c-ef0a-403a-8a82-cc5826a2d4a9 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.022676 Apr 21 10:43:05 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 21 10:43:05 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:43:07 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-c8949cbc-a0a6-4e31-9e61-5ccaa3abe9d6 None None] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:43:07 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-c8949cbc-a0a6-4e31-9e61-5ccaa3abe9d6 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001558 Apr 21 10:43:07 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 21 10:43:07 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:43:07 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-64f173e9-df9f-4077-9421-4ce06c4bfa27 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "d3", "vcpus": 2, "rxtx_factor": 1.0, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:43:07 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-64f173e9-df9f-4077-9421-4ce06c4bfa27 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.061629 Apr 21 10:43:07 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 21 10:43:07 2023] POST /compute/v2.1/flavors => generated 402 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 10:43:07 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-ddb58d03-6df3-40c6-ab1d-feb92ace98e3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:43:07 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-ddb58d03-6df3-40c6-ab1d-feb92ace98e3 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027073 Apr 21 10:43:07 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 21 10:43:07 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:43:09 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-c8949cbc-a0a6-4e31-9e61-5ccaa3abe9d6 None None] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:43:09 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-c8949cbc-a0a6-4e31-9e61-5ccaa3abe9d6 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001593 Apr 21 10:43:09 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 21 10:43:09 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:43:09 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-6123eadc-3c91-4b48-9c28-ed023967b2f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "rxtx_factor": 1.0, "vcpus": 4, "os-flavor-access:is_public": true, "name": "ds4G", "swap": 0, "ram": 4096, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:43:09 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-6123eadc-3c91-4b48-9c28-ed023967b2f9 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.084346 Apr 21 10:43:09 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 21 10:43:09 2023] POST /compute/v2.1/flavors => generated 402 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 10:43:09 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-78b7335b-1da1-41d7-90ee-20cb15f7abea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:43:09 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-78b7335b-1da1-41d7-90ee-20cb15f7abea admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025280 Apr 21 10:43:09 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 21 10:43:09 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:43:11 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-c8949cbc-a0a6-4e31-9e61-5ccaa3abe9d6 None None] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:43:11 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-c8949cbc-a0a6-4e31-9e61-5ccaa3abe9d6 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001519 Apr 21 10:43:11 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 21 10:43:11 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:43:11 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-62be212d-ea46-444a-8653-72aa9ef818ab admin admin] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:43:11 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-62be212d-ea46-444a-8653-72aa9ef818ab admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.065537 Apr 21 10:43:11 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Fri Apr 21 10:43:11 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 10:43:13 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-78b7335b-1da1-41d7-90ee-20cb15f7abea admin admin] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:43:13 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-78b7335b-1da1-41d7-90ee-20cb15f7abea admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001407 Apr 21 10:43:13 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 21 10:43:13 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:43:13 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_api:SELECT=3 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:43:13 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell0:SELECT=3 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:43:13 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell1:SELECT=3 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:43:13 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell0:SELECT=3 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:43:14 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-99840b1e-98f4-494a-83b4-286170c18972 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.tiny", "id": "1", "rxtx_factor": 1.0, "disk": 1, "ram": 512, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:43:14 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-99840b1e-98f4-494a-83b4-286170c18972 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.370681 Apr 21 10:43:14 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 21 10:43:13 2023] POST /compute/v2.1/flavors => generated 400 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 10:43:14 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-fcce2519-d857-4ba2-bc36-75507ca31ac3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:43:14 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-fcce2519-d857-4ba2-bc36-75507ca31ac3 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043214 Apr 21 10:43:14 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 21 10:43:14 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:43:16 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-78b7335b-1da1-41d7-90ee-20cb15f7abea admin admin] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:43:16 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-78b7335b-1da1-41d7-90ee-20cb15f7abea admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001266 Apr 21 10:43:16 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 21 10:43:16 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:43:16 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-5e785277-db2c-4572-9f2d-8f94926ed4e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "2", "vcpus": 1, "swap": 0, "disk": 20, "ram": 2048, "name": "m1.small"}} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:43:16 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-5e785277-db2c-4572-9f2d-8f94926ed4e2 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.064880 Apr 21 10:43:16 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 21 10:43:16 2023] POST /compute/v2.1/flavors => generated 403 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 10:43:16 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-f196e24b-bd93-4772-9e39-dc37fd6312c7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:43:16 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-f196e24b-bd93-4772-9e39-dc37fd6312c7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028796 Apr 21 10:43:16 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 21 10:43:16 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:43:18 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-78b7335b-1da1-41d7-90ee-20cb15f7abea admin admin] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:43:18 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-78b7335b-1da1-41d7-90ee-20cb15f7abea admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002289 Apr 21 10:43:18 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 21 10:43:18 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:43:18 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-1390cdce-0b00-4eda-9d70-54a1232866d4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "vcpus": 2, "id": "3", "rxtx_factor": 1.0, "name": "m1.medium", "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:43:18 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-1390cdce-0b00-4eda-9d70-54a1232866d4 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071606 Apr 21 10:43:18 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 21 10:43:18 2023] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 10:43:18 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-688f6edd-e96e-4f02-af8f-ca85c1198c74 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:43:18 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-688f6edd-e96e-4f02-af8f-ca85c1198c74 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024204 Apr 21 10:43:18 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 21 10:43:18 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:43:20 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-78b7335b-1da1-41d7-90ee-20cb15f7abea admin admin] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:43:20 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-78b7335b-1da1-41d7-90ee-20cb15f7abea admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001361 Apr 21 10:43:20 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 21 10:43:20 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:43:20 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-b6cb746d-d8cc-48a8-97f9-3ef07973757c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "name": "m1.large", "os-flavor-access:is_public": true, "ram": 8192, "swap": 0, "rxtx_factor": 1.0}} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:43:20 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-b6cb746d-d8cc-48a8-97f9-3ef07973757c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.065624 Apr 21 10:43:20 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 21 10:43:20 2023] POST /compute/v2.1/flavors => generated 403 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 21 10:43:20 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-e15c96bb-6773-4eb3-a483-ef04fd47132d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:43:20 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-e15c96bb-6773-4eb3-a483-ef04fd47132d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024037 Apr 21 10:43:20 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 21 10:43:20 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:43:22 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-78b7335b-1da1-41d7-90ee-20cb15f7abea admin admin] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:43:22 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-78b7335b-1da1-41d7-90ee-20cb15f7abea admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001379 Apr 21 10:43:22 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 21 10:43:22 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:43:22 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-a83cb24e-0310-4137-b926-492eea49ae2f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 16384, "vcpus": 8, "name": "m1.xlarge", "id": "5", "disk": 160, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:43:22 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-a83cb24e-0310-4137-b926-492eea49ae2f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.099279 Apr 21 10:43:22 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 21 10:43:22 2023] POST /compute/v2.1/flavors => generated 406 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 10:43:22 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-15d44e19-93ea-49b5-aa5f-d0d839139719 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:43:22 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-15d44e19-93ea-49b5-aa5f-d0d839139719 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023900 Apr 21 10:43:22 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 21 10:43:22 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:43:53 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-78b7335b-1da1-41d7-90ee-20cb15f7abea admin admin] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:43:53 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-78b7335b-1da1-41d7-90ee-20cb15f7abea admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001574 Apr 21 10:43:53 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 21 10:43:53 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 10:43:53 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:43:53 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-698229a2-0dd0-4157-a8b9-324e750a9bac admin admin] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:43:53 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-698229a2-0dd0-4157-a8b9-324e750a9bac admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:43:53 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-698229a2-0dd0-4157-a8b9-324e750a9bac admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:43:53 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-698229a2-0dd0-4157-a8b9-324e750a9bac admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:43:53 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-698229a2-0dd0-4157-a8b9-324e750a9bac admin admin] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:43:53 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-698229a2-0dd0-4157-a8b9-324e750a9bac admin admin] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:43:53 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-698229a2-0dd0-4157-a8b9-324e750a9bac admin admin] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:43:53 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-698229a2-0dd0-4157-a8b9-324e750a9bac admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.092402 Apr 21 10:43:53 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Fri Apr 21 10:43:53 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 10:44:25 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-15d44e19-93ea-49b5-aa5f-d0d839139719 admin admin] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:44:25 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-15d44e19-93ea-49b5-aa5f-d0d839139719 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002470 Apr 21 10:44:25 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 21 10:44:25 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:44:25 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:44:25 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-b068a5b4-fc16-409b-bcca-a342d0c1f0f5 admin admin] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:44:25 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-b068a5b4-fc16-409b-bcca-a342d0c1f0f5 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.067202 Apr 21 10:44:25 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Fri Apr 21 10:44:25 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 10:44:30 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-698229a2-0dd0-4157-a8b9-324e750a9bac admin admin] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:44:30 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-698229a2-0dd0-4157-a8b9-324e750a9bac admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001703 Apr 21 10:44:30 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 21 10:44:30 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:44:30 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:44:30 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-7e8c1469-c6a1-48a2-a958-935e6038686b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 128, "disk": 1, "swap": 0, "rxtx_factor": 1.0, "name": "m1.nano", "os-flavor-access:is_public": true, "id": "42", "vcpus": 1}} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:44:30 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-7e8c1469-c6a1-48a2-a958-935e6038686b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.063025 Apr 21 10:44:30 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Fri Apr 21 10:44:30 2023] POST /compute/v2.1/flavors => generated 403 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 10:44:30 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-46e73637-65ec-4bb3-ad22-dbcaca19950e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:44:30 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-46e73637-65ec-4bb3-ad22-dbcaca19950e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028807 Apr 21 10:44:30 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Fri Apr 21 10:44:30 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:44:34 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-698229a2-0dd0-4157-a8b9-324e750a9bac admin admin] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:44:34 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-698229a2-0dd0-4157-a8b9-324e750a9bac admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001560 Apr 21 10:44:34 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 21 10:44:34 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:44:34 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-dd63f77d-5369-4c03-a6f4-da76995acfb7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "name": "m1.micro", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "84", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "ram": 192}} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:44:34 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-dd63f77d-5369-4c03-a6f4-da76995acfb7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.060529 Apr 21 10:44:34 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Fri Apr 21 10:44:34 2023] POST /compute/v2.1/flavors => generated 404 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 10:44:34 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-0b8d30a1-16b1-4103-917e-88718aeb6ba8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:44:34 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-0b8d30a1-16b1-4103-917e-88718aeb6ba8 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029794 Apr 21 10:44:34 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Fri Apr 21 10:44:34 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:46:46 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell0:SELECT=2 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:46:46 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell1:SELECT=2 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:46:46 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_api:SELECT=4 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:46:47 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-d903228e-cd76-4aaa-987d-45ba9763cbbf tempest-VolumesGetTestJSON-2014229216 tempest-VolumesGetTestJSON-2014229216-project-member] Action: 'create', calling method: .version_select at 0x7f91a6bcdbd0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1694656711", "metadata": {"Type": "work"}}} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:46:48 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-d903228e-cd76-4aaa-987d-45ba9763cbbf tempest-VolumesGetTestJSON-2014229216 tempest-VolumesGetTestJSON-2014229216-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.821692 Apr 21 10:46:48 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 21 10:46:46 2023] POST /compute/v2.1/os-volumes => generated 353 bytes in 1823 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 21 10:46:48 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-a2f3eb71-e550-4d33-a9bb-1801151bc745 tempest-VolumesGetTestJSON-2014229216 tempest-VolumesGetTestJSON-2014229216-project-member] Calling method '.version_select at 0x7f91a6b66680>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:46:48 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:46:49 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-a2f3eb71-e550-4d33-a9bb-1801151bc745 tempest-VolumesGetTestJSON-2014229216 tempest-VolumesGetTestJSON-2014229216-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e318ff72-0d5e-4d1a-bdd9-60d2a482649b" status: 200 len: 350 microversion: 2.1 time: 0.292831 Apr 21 10:46:49 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 17/47] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 21 10:46:48 2023] GET /compute/v2.1/os-volumes/e318ff72-0d5e-4d1a-bdd9-60d2a482649b => generated 350 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 10:46:50 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:46:50 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-674f5490-cf6f-4254-8d0a-4c9d07326f9d tempest-VolumesGetTestJSON-2014229216 tempest-VolumesGetTestJSON-2014229216-project-member] Calling method '.version_select at 0x7f91a6dbb010>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:46:50 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-674f5490-cf6f-4254-8d0a-4c9d07326f9d tempest-VolumesGetTestJSON-2014229216 tempest-VolumesGetTestJSON-2014229216-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e318ff72-0d5e-4d1a-bdd9-60d2a482649b" status: 200 len: 350 microversion: 2.1 time: 0.332177 Apr 21 10:46:50 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 16/48] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 21 10:46:50 2023] GET /compute/v2.1/os-volumes/e318ff72-0d5e-4d1a-bdd9-60d2a482649b => generated 350 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:46:50 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-c9fde2d1-8064-4399-916e-65f330a0ce56 tempest-VolumesGetTestJSON-2014229216 tempest-VolumesGetTestJSON-2014229216-project-member] Calling method '.version_select at 0x7f91a6a4af80>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:46:50 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-c9fde2d1-8064-4399-916e-65f330a0ce56 tempest-VolumesGetTestJSON-2014229216 tempest-VolumesGetTestJSON-2014229216-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/e318ff72-0d5e-4d1a-bdd9-60d2a482649b" status: 202 len: 0 microversion: 2.1 time: 0.231144 Apr 21 10:46:50 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 16/49] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 21 10:46:50 2023] DELETE /compute/v2.1/os-volumes/e318ff72-0d5e-4d1a-bdd9-60d2a482649b => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 10:46:50 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-06925c49-b147-46ee-9da2-2c2aeead1af0 tempest-VolumesGetTestJSON-2014229216 tempest-VolumesGetTestJSON-2014229216-project-member] Calling method '.version_select at 0x7f91a6beb760>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:46:50 user devstack@n-api.service[61319]: INFO nova.api.openstack.wsgi [None req-06925c49-b147-46ee-9da2-2c2aeead1af0 tempest-VolumesGetTestJSON-2014229216 tempest-VolumesGetTestJSON-2014229216-project-member] HTTP exception thrown: Volume e318ff72-0d5e-4d1a-bdd9-60d2a482649b could not be found. Apr 21 10:46:50 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-06925c49-b147-46ee-9da2-2c2aeead1af0 tempest-VolumesGetTestJSON-2014229216 tempest-VolumesGetTestJSON-2014229216-project-member] Request method failure captured: Apr 21 10:46:50 user devstack@n-api.service[61319]: request: GET /compute/v2.1/os-volumes/e318ff72-0d5e-4d1a-bdd9-60d2a482649b HTTP/1.1 Apr 21 10:46:50 user devstack@n-api.service[61319]: Accept: application/json Apr 21 10:46:50 user devstack@n-api.service[61319]: Accept-Encoding: identity Apr 21 10:46:50 user devstack@n-api.service[61319]: Connection: close Apr 21 10:46:50 user devstack@n-api.service[61319]: Content-Length: 0 Apr 21 10:46:50 user devstack@n-api.service[61319]: Content-Type: application/json Apr 21 10:46:50 user devstack@n-api.service[61319]: Host: 10.0.0.210 Apr 21 10:46:50 user devstack@n-api.service[61319]: Openstack-System-Scope: None Apr 21 10:46:50 user devstack@n-api.service[61319]: User-Agent: python-urllib3/1.26.15 Apr 21 10:46:50 user devstack@n-api.service[61319]: X-Auth-Token: gAAAAABkQmmW6YRMLLQQJkkXbwtz3r-rY1iT_tGi8CYcCOl4MqbGBWLMU66Ilhw9eUYNy90qxKZxfJZEc3ShsaFtrd9tNXZ4R_VaA7b7CjCBshCY3zYCx7aQWnkdlOwL11EZs6aGvOL9lfNtGrPDn3XcyOlelbB4K9cv8vYXAdYnpwFljFUDnFI Apr 21 10:46:50 user devstack@n-api.service[61319]: X-Domain-Id: None Apr 21 10:46:50 user devstack@n-api.service[61319]: X-Domain-Name: None Apr 21 10:46:50 user devstack@n-api.service[61319]: X-Identity-Status: Confirmed Apr 21 10:46:50 user devstack@n-api.service[61319]: X-Is-Admin-Project: True Apr 21 10:46:50 user devstack@n-api.service[61319]: X-Project-Domain-Id: default Apr 21 10:46:50 user devstack@n-api.service[61319]: X-Project-Domain-Name: Default Apr 21 10:46:50 user devstack@n-api.service[61319]: X-Project-Id: e62e4bf5ad5f440c9984ca19f8d28cf4 Apr 21 10:46:50 user devstack@n-api.service[61319]: X-Project-Name: tempest-VolumesGetTestJSON-2014229216 Apr 21 10:46:50 user devstack@n-api.service[61319]: X-Role: reader,member Apr 21 10:46:50 user devstack@n-api.service[61319]: X-Roles: reader,member Apr 21 10:46:50 user devstack@n-api.service[61319]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e62e4bf5ad5f440c9984ca19f8d28cf4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e62e4bf5ad5f440c9984ca19f8d28cf4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e62e4bf5ad5f440c9984ca19f8d28cf4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 10:46:50 user devstack@n-api.service[61319]: X-Tenant: tempest-VolumesGetTestJSON-2014229216 Apr 21 10:46:50 user devstack@n-api.service[61319]: X-Tenant-Id: e62e4bf5ad5f440c9984ca19f8d28cf4 Apr 21 10:46:50 user devstack@n-api.service[61319]: X-Tenant-Name: tempest-VolumesGetTestJSON-2014229216 Apr 21 10:46:50 user devstack@n-api.service[61319]: X-User: tempest-VolumesGetTestJSON-2014229216-project-member Apr 21 10:46:50 user devstack@n-api.service[61319]: X-User-Domain-Id: default Apr 21 10:46:50 user devstack@n-api.service[61319]: X-User-Domain-Name: Default Apr 21 10:46:50 user devstack@n-api.service[61319]: X-User-Id: a955e6eebd4e469fa255a56865effb17 Apr 21 10:46:50 user devstack@n-api.service[61319]: X-User-Name: tempest-VolumesGetTestJSON-2014229216-project-member Apr 21 10:46:50 user devstack@n-api.service[61319]: method: Apr 21 10:46:50 user devstack@n-api.service[61319]: exception: Volume e318ff72-0d5e-4d1a-bdd9-60d2a482649b could not be found. Apr 21 10:46:50 user devstack@n-api.service[61319]: action_args: {'id': 'e318ff72-0d5e-4d1a-bdd9-60d2a482649b'} Apr 21 10:46:50 user devstack@n-api.service[61319]: {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e318ff72-0d5e-4d1a-bdd9-60d2a482649b could not be found. (HTTP 404) (Request-ID: req-2c91d1df-7178-430d-87e8-e6e4a1900388) Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e318ff72-0d5e-4d1a-bdd9-60d2a482649b could not be found. Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e318ff72-0d5e-4d1a-bdd9-60d2a482649b could not be found. Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e318ff72-0d5e-4d1a-bdd9-60d2a482649b could not be found. Apr 21 10:46:50 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:46:50 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-06925c49-b147-46ee-9da2-2c2aeead1af0 tempest-VolumesGetTestJSON-2014229216 tempest-VolumesGetTestJSON-2014229216-project-member] Returning 404 to user: Volume e318ff72-0d5e-4d1a-bdd9-60d2a482649b could not be found. {{(pid=61319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 10:46:50 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-06925c49-b147-46ee-9da2-2c2aeead1af0 tempest-VolumesGetTestJSON-2014229216 tempest-VolumesGetTestJSON-2014229216-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e318ff72-0d5e-4d1a-bdd9-60d2a482649b" status: 404 len: 109 microversion: 2.1 time: 0.040112 Apr 21 10:46:50 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 18/50] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 21 10:46:50 2023] GET /compute/v2.1/os-volumes/e318ff72-0d5e-4d1a-bdd9-60d2a482649b => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 10:46:59 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-5660a17b-c8be-435f-930b-b5424132b807 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-76757344", "imageRef": "3b29a01a-1fc0-4d0d-89fb-23d22b2de02e", "flavorRef": "42", "networks": [{"uuid": "cfb4de90-44ea-486a-b5c4-c3b1111aa2bd"}]}} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:46:59 user devstack@n-api.service[61318]: DEBUG nova.network.neutron [None req-5660a17b-c8be-435f-930b-b5424132b807 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] validate_networks() for [('cfb4de90-44ea-486a-b5c4-c3b1111aa2bd', None, None, None, None, None)] {{(pid=61318) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 10:47:00 user devstack@n-api.service[61318]: DEBUG nova.virt.hardware [None req-5660a17b-c8be-435f-930b-b5424132b807 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Flavor limits 0:0:0 {{(pid=61318) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 10:47:00 user devstack@n-api.service[61318]: DEBUG nova.virt.hardware [None req-5660a17b-c8be-435f-930b-b5424132b807 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Image limits 0:0:0 {{(pid=61318) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 10:47:00 user devstack@n-api.service[61318]: DEBUG nova.virt.hardware [None req-5660a17b-c8be-435f-930b-b5424132b807 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Flavor pref 0:0:0 {{(pid=61318) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 10:47:00 user devstack@n-api.service[61318]: DEBUG nova.virt.hardware [None req-5660a17b-c8be-435f-930b-b5424132b807 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Image pref 0:0:0 {{(pid=61318) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 10:47:00 user devstack@n-api.service[61318]: DEBUG nova.virt.hardware [None req-5660a17b-c8be-435f-930b-b5424132b807 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61318) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 10:47:00 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-5660a17b-c8be-435f-930b-b5424132b807 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:47:00 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-5660a17b-c8be-435f-930b-b5424132b807 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:47:00 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-5660a17b-c8be-435f-930b-b5424132b807 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:47:00 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-5660a17b-c8be-435f-930b-b5424132b807 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:47:00 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-5660a17b-c8be-435f-930b-b5424132b807 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:47:00 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-5660a17b-c8be-435f-930b-b5424132b807 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:47:00 user devstack@n-api.service[61318]: DEBUG nova.quota [None req-5660a17b-c8be-435f-930b-b5424132b807 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Getting quotas for project aad84a0e014f47ddaeaddc88bf16b0a8. Resources: {'cores', 'instances', 'ram'} {{(pid=61318) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 10:47:00 user devstack@n-api.service[61318]: DEBUG nova.quota [None req-5660a17b-c8be-435f-930b-b5424132b807 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Getting quotas for user 54c67d90b6014d9ea24ef2552006bc04 and project aad84a0e014f47ddaeaddc88bf16b0a8. Resources: {'cores', 'instances', 'ram'} {{(pid=61318) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 10:47:01 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-5660a17b-c8be-435f-930b-b5424132b807 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Going to run 1 instances... {{(pid=61318) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 10:47:01 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-5660a17b-c8be-435f-930b-b5424132b807 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] [instance: 84b55fc0-e748-4c05-97ad-a6994c0487d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3b29a01a-1fc0-4d0d-89fb-23d22b2de02e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61318) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 10:47:01 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-5660a17b-c8be-435f-930b-b5424132b807 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 2.160994 Apr 21 10:47:01 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 17/51] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 21 10:46:58 2023] POST /compute/v2.1/servers => generated 378 bytes in 2165 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 21 10:47:01 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-8deb8fd6-a58c-43d0-8a2e-1d9215557595 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:47:01 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-8deb8fd6-a58c-43d0-8a2e-1d9215557595 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] [instance: 84b55fc0-e748-4c05-97ad-a6994c0487d2] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:47:01 user devstack@n-api.service[61320]: DEBUG nova.policy [None req-8deb8fd6-a58c-43d0-8a2e-1d9215557595 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c67d90b6014d9ea24ef2552006bc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad84a0e014f47ddaeaddc88bf16b0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61320) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:47:01 user devstack@n-api.service[61320]: DEBUG nova.policy [None req-8deb8fd6-a58c-43d0-8a2e-1d9215557595 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c67d90b6014d9ea24ef2552006bc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad84a0e014f47ddaeaddc88bf16b0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61320) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:47:01 user devstack@n-api.service[61320]: DEBUG nova.policy [None req-8deb8fd6-a58c-43d0-8a2e-1d9215557595 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c67d90b6014d9ea24ef2552006bc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad84a0e014f47ddaeaddc88bf16b0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61320) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:47:01 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-8deb8fd6-a58c-43d0-8a2e-1d9215557595 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84b55fc0-e748-4c05-97ad-a6994c0487d2" status: 200 len: 1393 microversion: 2.87 time: 0.158242 Apr 21 10:47:01 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 17/52] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 10:47:01 2023] GET /compute/v2.1/servers/84b55fc0-e748-4c05-97ad-a6994c0487d2 => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 10:47:06 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-34bae57e-dff0-4d2a-ab7a-a11ecc8a50e8 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Action: 'create', calling method: .version_select at 0x7f91a6a40e50>, body: {"keypair": {"name": "tempest-keypair-1735824251", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP17pDhSIQbCv4xewaSR+c65YmMH+hIkRmyXO1jHYq3hmftzXxLb6EXcvZayMHXJMHoDUOwUfoaQ/r3kME39pIqEI1cveoujwBV7i5jBCcTH71kCrlaE9KNWPqoT9mc/lQ=="}} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:47:06 user devstack@n-api.service[61319]: DEBUG nova.quota [None req-34bae57e-dff0-4d2a-ab7a-a11ecc8a50e8 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Getting quotas for project 648163a728fc4b28b85a24e9198d356b. Resources: {'key_pairs'} {{(pid=61319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 10:47:06 user devstack@n-api.service[61319]: DEBUG nova.quota [None req-34bae57e-dff0-4d2a-ab7a-a11ecc8a50e8 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Getting quotas for user ced216baa4a64c72946cf3f71eb873dd and project 648163a728fc4b28b85a24e9198d356b. Resources: {'key_pairs'} {{(pid=61319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 10:47:06 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-34bae57e-dff0-4d2a-ab7a-a11ecc8a50e8 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.295573 Apr 21 10:47:06 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 19/53] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 21 10:47:06 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:47:09 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-ff195b2c-3d68-4076-94be-265ba32ac3d4 tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2137471025", "imageRef": "3b29a01a-1fc0-4d0d-89fb-23d22b2de02e", "flavorRef": "42", "networks": [{"uuid": "4ef6bc58-0f6a-4b52-a251-5871f0f7d2d1"}]}} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:47:09 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-0b69a762-ec3d-47a0-a11c-aa1b92a8b3bb tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Action: 'create', calling method: .version_select at 0x7f91a612c430>, body: {"keypair": {"name": "tempest-keypair-474843765", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOLDYACefR6pJbo/1FNlJcU0uVLNhwHibyQxq6uGxw58mBzlostFRjitCW5kqYo4/rT+TGHwIPAMOKYgrhYN17TXx7fyo6rQDJa7QLpDa2shAHPXuXXSRjnzvc+xkQMdw=="}} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:47:09 user devstack@n-api.service[61318]: DEBUG nova.quota [None req-0b69a762-ec3d-47a0-a11c-aa1b92a8b3bb tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Getting quotas for project 4bdd7a4ccfc340aa9c1b02c57f7a0e70. Resources: {'key_pairs'} {{(pid=61318) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 10:47:09 user devstack@n-api.service[61318]: DEBUG nova.quota [None req-0b69a762-ec3d-47a0-a11c-aa1b92a8b3bb tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Getting quotas for user d172d648a9474db082646a47a2840214 and project 4bdd7a4ccfc340aa9c1b02c57f7a0e70. Resources: {'key_pairs'} {{(pid=61318) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 10:47:09 user devstack@n-api.service[61320]: DEBUG nova.network.neutron [None req-ff195b2c-3d68-4076-94be-265ba32ac3d4 tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] validate_networks() for [('4ef6bc58-0f6a-4b52-a251-5871f0f7d2d1', None, None, None, None, None)] {{(pid=61320) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 10:47:09 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-0b69a762-ec3d-47a0-a11c-aa1b92a8b3bb tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.313680 Apr 21 10:47:09 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 18/54] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 21 10:47:09 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:47:11 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell0:SELECT=2 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:47:12 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-42b5fd9e-b0fb-4f3f-bae5-1ae5b57eac93 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1307788712", "imageRef": "3b29a01a-1fc0-4d0d-89fb-23d22b2de02e", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "ba8e9ff2-e562-462e-a2fa-0d7f643da26c"}], "security_groups": [{"name": "tempest-securitygroup--1519594085"}], "key_name": "tempest-keypair-1735824251", "user_data": "}} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:47:12 user devstack@n-api.service[61319]: DEBUG nova.network.neutron [None req-42b5fd9e-b0fb-4f3f-bae5-1ae5b57eac93 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] validate_networks() for [('ba8e9ff2-e562-462e-a2fa-0d7f643da26c', None, None, None, None, None)] {{(pid=61319) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 10:47:13 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-ff195b2c-3d68-4076-94be-265ba32ac3d4 tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Flavor limits 0:0:0 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 10:47:13 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-ff195b2c-3d68-4076-94be-265ba32ac3d4 tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Image limits 0:0:0 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 10:47:13 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-ff195b2c-3d68-4076-94be-265ba32ac3d4 tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Flavor pref 0:0:0 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 10:47:13 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-ff195b2c-3d68-4076-94be-265ba32ac3d4 tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Image pref 0:0:0 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 10:47:13 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-ff195b2c-3d68-4076-94be-265ba32ac3d4 tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 10:47:13 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-ff195b2c-3d68-4076-94be-265ba32ac3d4 tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:47:13 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-ff195b2c-3d68-4076-94be-265ba32ac3d4 tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:47:13 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-ff195b2c-3d68-4076-94be-265ba32ac3d4 tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:47:13 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-ff195b2c-3d68-4076-94be-265ba32ac3d4 tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:47:13 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-ff195b2c-3d68-4076-94be-265ba32ac3d4 tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:47:13 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-ff195b2c-3d68-4076-94be-265ba32ac3d4 tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:47:13 user devstack@n-api.service[61320]: DEBUG nova.quota [None req-ff195b2c-3d68-4076-94be-265ba32ac3d4 tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Getting quotas for project f12ec80f50254e5bbc5afd5470546c71. Resources: {'cores', 'instances', 'ram'} {{(pid=61320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 10:47:13 user devstack@n-api.service[61320]: DEBUG nova.quota [None req-ff195b2c-3d68-4076-94be-265ba32ac3d4 tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Getting quotas for user eb7625e4107240d5a92379ace66052fa and project f12ec80f50254e5bbc5afd5470546c71. Resources: {'cores', 'instances', 'ram'} {{(pid=61320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 10:47:13 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-ff195b2c-3d68-4076-94be-265ba32ac3d4 tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Going to run 1 instances... {{(pid=61320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 10:47:13 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-ff195b2c-3d68-4076-94be-265ba32ac3d4 tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] [instance: dd34ae7e-dcf2-4bb2-8ea3-0a3ee553efd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3b29a01a-1fc0-4d0d-89fb-23d22b2de02e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 10:47:13 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-ff195b2c-3d68-4076-94be-265ba32ac3d4 tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 3.689505 Apr 21 10:47:13 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 18/55] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 10:47:09 2023] POST /compute/v2.1/servers => generated 378 bytes in 3692 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 10:47:13 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell0:SELECT=2 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:47:13 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell1:SELECT=2 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:47:13 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-97d701fd-997a-4515-9c25-f24fb9bcc9f1 tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:47:13 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-97d701fd-997a-4515-9c25-f24fb9bcc9f1 tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] [instance: dd34ae7e-dcf2-4bb2-8ea3-0a3ee553efd8] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:47:13 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [req-1d3f7fcc-db1d-4b92-b70e-8a36dd446b9b req-59208acd-7932-46c7-a783-ac501b0d8657 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84b55fc0-e748-4c05-97ad-a6994c0487d2", "tag": "2a49817a-aed1-49bd-96b6-36286ff71e1c"}]} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:47:13 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-1d3f7fcc-db1d-4b92-b70e-8a36dd446b9b req-59208acd-7932-46c7-a783-ac501b0d8657 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:47:13 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-1d3f7fcc-db1d-4b92-b70e-8a36dd446b9b req-59208acd-7932-46c7-a783-ac501b0d8657 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:47:13 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-1d3f7fcc-db1d-4b92-b70e-8a36dd446b9b req-59208acd-7932-46c7-a783-ac501b0d8657 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:47:13 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-1d3f7fcc-db1d-4b92-b70e-8a36dd446b9b req-59208acd-7932-46c7-a783-ac501b0d8657 service nova] Creating event network-changed:2a49817a-aed1-49bd-96b6-36286ff71e1c for instance 84b55fc0-e748-4c05-97ad-a6994c0487d2 on user Apr 21 10:47:13 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-1d3f7fcc-db1d-4b92-b70e-8a36dd446b9b req-59208acd-7932-46c7-a783-ac501b0d8657 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61320) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 21 10:47:13 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-1d3f7fcc-db1d-4b92-b70e-8a36dd446b9b req-59208acd-7932-46c7-a783-ac501b0d8657 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61320) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 21 10:47:13 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-b69b82a9-a85f-42cf-a65b-f42e504b6da1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:47:13 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-b69b82a9-a85f-42cf-a65b-f42e504b6da1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:47:13 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-b69b82a9-a85f-42cf-a65b-f42e504b6da1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:47:13 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-b69b82a9-a85f-42cf-a65b-f42e504b6da1 None None] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:47:13 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-b69b82a9-a85f-42cf-a65b-f42e504b6da1 None None] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:47:13 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-b69b82a9-a85f-42cf-a65b-f42e504b6da1 None None] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:47:13 user devstack@n-api.service[61320]: INFO nova.compute.rpcapi [None req-b69b82a9-a85f-42cf-a65b-f42e504b6da1 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 21 10:47:13 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-b69b82a9-a85f-42cf-a65b-f42e504b6da1 None None] Releasing lock "compute-rpcapi-router" {{(pid=61320) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 21 10:47:13 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-b69b82a9-a85f-42cf-a65b-f42e504b6da1 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148204 Apr 21 10:47:13 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 19/56] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:47:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:47:13 user devstack@n-api.service[61318]: DEBUG nova.policy [None req-97d701fd-997a-4515-9c25-f24fb9bcc9f1 tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7625e4107240d5a92379ace66052fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12ec80f50254e5bbc5afd5470546c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61318) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:47:13 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-97d701fd-997a-4515-9c25-f24fb9bcc9f1 tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dd34ae7e-dcf2-4bb2-8ea3-0a3ee553efd8" status: 200 len: 1209 microversion: 2.1 time: 0.352164 Apr 21 10:47:13 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 19/57] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:47:13 2023] GET /compute/v2.1/servers/dd34ae7e-dcf2-4bb2-8ea3-0a3ee553efd8 => generated 1209 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:47:14 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-15ba48b0-cbd7-44e3-8f37-f4cc5d86cc5e tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Action: 'create', calling method: .version_select at 0x7f91a6963880>, body: {"keypair": {"name": "tempest-keypair-495885922", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE61zuAXT232aH/KOTnubmgBMkuEfigCy73bZO4uuf2B23JR41s8cx2vf+RH51d7wxX9P1MtxP7zNqYI2bDeqdfZasdq2OLkldcjqDGH3vLtRM+8mAr7ZBtqN4SKtJs0UQ=="}} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:47:14 user devstack@n-api.service[61320]: DEBUG nova.quota [None req-15ba48b0-cbd7-44e3-8f37-f4cc5d86cc5e tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Getting quotas for project d85f51547e5244e495343281725fe320. Resources: {'key_pairs'} {{(pid=61320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 10:47:14 user devstack@n-api.service[61320]: DEBUG nova.quota [None req-15ba48b0-cbd7-44e3-8f37-f4cc5d86cc5e tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Getting quotas for user 25fb0d890b594080bb1bb99dd6294ff1 and project d85f51547e5244e495343281725fe320. Resources: {'key_pairs'} {{(pid=61320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 10:47:14 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-15ba48b0-cbd7-44e3-8f37-f4cc5d86cc5e tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.245914 Apr 21 10:47:14 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 20/58] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 21 10:47:14 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:47:15 user devstack@n-api.service[61319]: DEBUG nova.virt.hardware [None req-42b5fd9e-b0fb-4f3f-bae5-1ae5b57eac93 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Flavor limits 0:0:0 {{(pid=61319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 10:47:15 user devstack@n-api.service[61319]: DEBUG nova.virt.hardware [None req-42b5fd9e-b0fb-4f3f-bae5-1ae5b57eac93 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Image limits 0:0:0 {{(pid=61319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 10:47:15 user devstack@n-api.service[61319]: DEBUG nova.virt.hardware [None req-42b5fd9e-b0fb-4f3f-bae5-1ae5b57eac93 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Flavor pref 0:0:0 {{(pid=61319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 10:47:15 user devstack@n-api.service[61319]: DEBUG nova.virt.hardware [None req-42b5fd9e-b0fb-4f3f-bae5-1ae5b57eac93 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Image pref 0:0:0 {{(pid=61319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 10:47:15 user devstack@n-api.service[61319]: DEBUG nova.virt.hardware [None req-42b5fd9e-b0fb-4f3f-bae5-1ae5b57eac93 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 10:47:15 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-42b5fd9e-b0fb-4f3f-bae5-1ae5b57eac93 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:47:15 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-42b5fd9e-b0fb-4f3f-bae5-1ae5b57eac93 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:47:15 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-42b5fd9e-b0fb-4f3f-bae5-1ae5b57eac93 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:47:15 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-42b5fd9e-b0fb-4f3f-bae5-1ae5b57eac93 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:47:15 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-42b5fd9e-b0fb-4f3f-bae5-1ae5b57eac93 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:47:15 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-42b5fd9e-b0fb-4f3f-bae5-1ae5b57eac93 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:47:15 user devstack@n-api.service[61319]: DEBUG nova.quota [None req-42b5fd9e-b0fb-4f3f-bae5-1ae5b57eac93 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Getting quotas for project 648163a728fc4b28b85a24e9198d356b. Resources: {'cores', 'instances', 'ram'} {{(pid=61319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 10:47:15 user devstack@n-api.service[61319]: DEBUG nova.quota [None req-42b5fd9e-b0fb-4f3f-bae5-1ae5b57eac93 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Getting quotas for user ced216baa4a64c72946cf3f71eb873dd and project 648163a728fc4b28b85a24e9198d356b. Resources: {'cores', 'instances', 'ram'} {{(pid=61319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 10:47:15 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-42b5fd9e-b0fb-4f3f-bae5-1ae5b57eac93 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Going to run 1 instances... {{(pid=61319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 10:47:15 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-42b5fd9e-b0fb-4f3f-bae5-1ae5b57eac93 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] [instance: f8609da3-c26d-482a-bc03-017baf4bce22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3b29a01a-1fc0-4d0d-89fb-23d22b2de02e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 10:47:15 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-42b5fd9e-b0fb-4f3f-bae5-1ae5b57eac93 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 3.187002 Apr 21 10:47:15 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 20/59] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 10:47:12 2023] POST /compute/v2.1/servers => generated 407 bytes in 3189 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 10:47:15 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-351283df-0d9c-417d-a679-3044579d6bf7 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:47:15 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-351283df-0d9c-417d-a679-3044579d6bf7 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] [instance: f8609da3-c26d-482a-bc03-017baf4bce22] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:47:15 user devstack@n-api.service[61318]: DEBUG nova.policy [None req-351283df-0d9c-417d-a679-3044579d6bf7 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced216baa4a64c72946cf3f71eb873dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648163a728fc4b28b85a24e9198d356b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61318) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:47:15 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-351283df-0d9c-417d-a679-3044579d6bf7 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8609da3-c26d-482a-bc03-017baf4bce22" status: 200 len: 1233 microversion: 2.1 time: 0.133857 Apr 21 10:47:15 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 20/60] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:47:15 2023] GET /compute/v2.1/servers/f8609da3-c26d-482a-bc03-017baf4bce22 => generated 1233 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:47:16 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-cdcf6209-6d7d-4344-ae1d-788df8b62401 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-830796194", "imageRef": "3b29a01a-1fc0-4d0d-89fb-23d22b2de02e", "flavorRef": "42", "networks": [{"uuid": "ba9d5253-efcc-4b0a-8cda-778a5a337551"}], "security_groups": [{"name": "tempest-securitygroup--1391987559"}], "key_name": "tempest-keypair-474843765", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:47:16 user devstack@n-api.service[61320]: DEBUG nova.network.neutron [None req-cdcf6209-6d7d-4344-ae1d-788df8b62401 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] validate_networks() for [('ba9d5253-efcc-4b0a-8cda-778a5a337551', None, None, None, None, None)] {{(pid=61320) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 10:47:17 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-4ee85eb8-d9c0-4b24-8eee-b9f0337457ab tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-721132263", "imageRef": "3b29a01a-1fc0-4d0d-89fb-23d22b2de02e", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "b24b52ac-b8ab-493e-994c-c38d7c5c7089"}], "security_groups": [{"name": "tempest-securitygroup--105200930"}], "key_name": "tempest-keypair-495885922", "user_data": "}} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:47:17 user devstack@n-api.service[61319]: DEBUG nova.network.neutron [None req-4ee85eb8-d9c0-4b24-8eee-b9f0337457ab tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] validate_networks() for [('b24b52ac-b8ab-493e-994c-c38d7c5c7089', None, None, None, None, None)] {{(pid=61319) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 10:47:19 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-cdcf6209-6d7d-4344-ae1d-788df8b62401 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Flavor limits 0:0:0 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 10:47:19 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-cdcf6209-6d7d-4344-ae1d-788df8b62401 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Image limits 0:0:0 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 10:47:19 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-cdcf6209-6d7d-4344-ae1d-788df8b62401 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Flavor pref 0:0:0 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 10:47:19 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-cdcf6209-6d7d-4344-ae1d-788df8b62401 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Image pref 0:0:0 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 10:47:19 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-cdcf6209-6d7d-4344-ae1d-788df8b62401 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 10:47:19 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-cdcf6209-6d7d-4344-ae1d-788df8b62401 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:47:19 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-cdcf6209-6d7d-4344-ae1d-788df8b62401 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:47:19 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-cdcf6209-6d7d-4344-ae1d-788df8b62401 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:47:19 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-cdcf6209-6d7d-4344-ae1d-788df8b62401 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:47:19 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-cdcf6209-6d7d-4344-ae1d-788df8b62401 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:47:19 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-cdcf6209-6d7d-4344-ae1d-788df8b62401 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:47:19 user devstack@n-api.service[61320]: DEBUG nova.quota [None req-cdcf6209-6d7d-4344-ae1d-788df8b62401 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Getting quotas for project 4bdd7a4ccfc340aa9c1b02c57f7a0e70. Resources: {'cores', 'instances', 'ram'} {{(pid=61320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 10:47:19 user devstack@n-api.service[61320]: DEBUG nova.quota [None req-cdcf6209-6d7d-4344-ae1d-788df8b62401 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Getting quotas for user d172d648a9474db082646a47a2840214 and project 4bdd7a4ccfc340aa9c1b02c57f7a0e70. Resources: {'cores', 'instances', 'ram'} {{(pid=61320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 10:47:19 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-cdcf6209-6d7d-4344-ae1d-788df8b62401 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Going to run 1 instances... {{(pid=61320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 10:47:19 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-cdcf6209-6d7d-4344-ae1d-788df8b62401 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] [instance: 15bf9321-a92e-4be2-bcae-a943988c811a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3b29a01a-1fc0-4d0d-89fb-23d22b2de02e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 10:47:19 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-cdcf6209-6d7d-4344-ae1d-788df8b62401 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.879591 Apr 21 10:47:19 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 21/61] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 10:47:16 2023] POST /compute/v2.1/servers => generated 404 bytes in 2881 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 10:47:19 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-e6530c46-4e3b-4e23-858a-bd83ecc9d6a4 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:47:19 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-e6530c46-4e3b-4e23-858a-bd83ecc9d6a4 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] [instance: 15bf9321-a92e-4be2-bcae-a943988c811a] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:47:19 user devstack@n-api.service[61320]: DEBUG nova.policy [None req-e6530c46-4e3b-4e23-858a-bd83ecc9d6a4 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd172d648a9474db082646a47a2840214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdd7a4ccfc340aa9c1b02c57f7a0e70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61320) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:47:19 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-e6530c46-4e3b-4e23-858a-bd83ecc9d6a4 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15bf9321-a92e-4be2-bcae-a943988c811a" status: 200 len: 1238 microversion: 2.1 time: 0.137406 Apr 21 10:47:19 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 22/62] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:47:19 2023] GET /compute/v2.1/servers/15bf9321-a92e-4be2-bcae-a943988c811a => generated 1238 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 10:47:19 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-113c9aa2-ad6d-49dd-ad46-0d5abfe5ae31 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Action: 'create', calling method: .version_select at 0x7f91a618c1f0>, body: {"keypair": {"name": "tempest-keypair-538215549", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiXQMKehmXbZ+t/TYVT0gSKs0KmTZ5FlYz6zFGTYVIOj5Jx7gtGmebbyFsJUNZbybkDh6qpI1q+o00ju2IhzrS6d4GO5cz3RO8d1HNO4lgr/58RDDJYurBNqFihZhWt2A=="}} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:47:19 user devstack@n-api.service[61318]: DEBUG nova.quota [None req-113c9aa2-ad6d-49dd-ad46-0d5abfe5ae31 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Getting quotas for project a3d2c4f2fb9f45559c4e51e86339a0e0. Resources: {'key_pairs'} {{(pid=61318) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 10:47:19 user devstack@n-api.service[61318]: DEBUG nova.quota [None req-113c9aa2-ad6d-49dd-ad46-0d5abfe5ae31 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Getting quotas for user c0b1fae0fc8d4b9a998ab0679bace1a1 and project a3d2c4f2fb9f45559c4e51e86339a0e0. Resources: {'key_pairs'} {{(pid=61318) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 10:47:19 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-113c9aa2-ad6d-49dd-ad46-0d5abfe5ae31 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.336854 Apr 21 10:47:19 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 21/63] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 21 10:47:19 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:47:19 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [req-3d747eb8-7a58-4371-a3ca-df095ec7a55c req-25b095fc-d3f0-43ce-ba7d-80c98d99dfe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84b55fc0-e748-4c05-97ad-a6994c0487d2", "name": "network-vif-plugged", "status": "completed", "tag": "2a49817a-aed1-49bd-96b6-36286ff71e1c"}]} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:47:19 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-3d747eb8-7a58-4371-a3ca-df095ec7a55c req-25b095fc-d3f0-43ce-ba7d-80c98d99dfe2 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:47:19 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-3d747eb8-7a58-4371-a3ca-df095ec7a55c req-25b095fc-d3f0-43ce-ba7d-80c98d99dfe2 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:47:19 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-3d747eb8-7a58-4371-a3ca-df095ec7a55c req-25b095fc-d3f0-43ce-ba7d-80c98d99dfe2 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:47:19 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-3d747eb8-7a58-4371-a3ca-df095ec7a55c req-25b095fc-d3f0-43ce-ba7d-80c98d99dfe2 service nova] Creating event network-vif-plugged:2a49817a-aed1-49bd-96b6-36286ff71e1c for instance 84b55fc0-e748-4c05-97ad-a6994c0487d2 on user Apr 21 10:47:19 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [req-3d747eb8-7a58-4371-a3ca-df095ec7a55c req-25b095fc-d3f0-43ce-ba7d-80c98d99dfe2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047538 Apr 21 10:47:19 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 23/64] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:47:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:47:19 user devstack@n-api.service[61319]: DEBUG nova.virt.hardware [None req-4ee85eb8-d9c0-4b24-8eee-b9f0337457ab tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Flavor limits 0:0:0 {{(pid=61319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 10:47:19 user devstack@n-api.service[61319]: DEBUG nova.virt.hardware [None req-4ee85eb8-d9c0-4b24-8eee-b9f0337457ab tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Image limits 0:0:0 {{(pid=61319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 10:47:19 user devstack@n-api.service[61319]: DEBUG nova.virt.hardware [None req-4ee85eb8-d9c0-4b24-8eee-b9f0337457ab tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Flavor pref 0:0:0 {{(pid=61319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 10:47:19 user devstack@n-api.service[61319]: DEBUG nova.virt.hardware [None req-4ee85eb8-d9c0-4b24-8eee-b9f0337457ab tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Image pref 0:0:0 {{(pid=61319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 10:47:19 user devstack@n-api.service[61319]: DEBUG nova.virt.hardware [None req-4ee85eb8-d9c0-4b24-8eee-b9f0337457ab tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 10:47:19 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-4ee85eb8-d9c0-4b24-8eee-b9f0337457ab tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:47:19 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-4ee85eb8-d9c0-4b24-8eee-b9f0337457ab tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:47:19 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-4ee85eb8-d9c0-4b24-8eee-b9f0337457ab tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:47:19 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-4ee85eb8-d9c0-4b24-8eee-b9f0337457ab tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:47:19 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-4ee85eb8-d9c0-4b24-8eee-b9f0337457ab tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:47:19 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-4ee85eb8-d9c0-4b24-8eee-b9f0337457ab tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:47:19 user devstack@n-api.service[61319]: DEBUG nova.quota [None req-4ee85eb8-d9c0-4b24-8eee-b9f0337457ab tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Getting quotas for project d85f51547e5244e495343281725fe320. Resources: {'cores', 'instances', 'ram'} {{(pid=61319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 10:47:19 user devstack@n-api.service[61319]: DEBUG nova.quota [None req-4ee85eb8-d9c0-4b24-8eee-b9f0337457ab tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Getting quotas for user 25fb0d890b594080bb1bb99dd6294ff1 and project d85f51547e5244e495343281725fe320. Resources: {'cores', 'instances', 'ram'} {{(pid=61319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 10:47:19 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-4ee85eb8-d9c0-4b24-8eee-b9f0337457ab tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Going to run 1 instances... {{(pid=61319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 10:47:19 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-4ee85eb8-d9c0-4b24-8eee-b9f0337457ab tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] [instance: dd4d15a1-3a71-49e8-9851-9b49fec6a9e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3b29a01a-1fc0-4d0d-89fb-23d22b2de02e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 10:47:20 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-4ee85eb8-d9c0-4b24-8eee-b9f0337457ab tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 2.829226 Apr 21 10:47:20 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 21/65] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 10:47:17 2023] POST /compute/v2.1/servers => generated 399 bytes in 2831 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 10:47:20 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-228e76ef-3101-4c39-a115-b701e7836043 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:47:20 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-228e76ef-3101-4c39-a115-b701e7836043 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] [instance: dd4d15a1-3a71-49e8-9851-9b49fec6a9e3] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:47:20 user devstack@n-api.service[61318]: DEBUG nova.policy [None req-228e76ef-3101-4c39-a115-b701e7836043 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fb0d890b594080bb1bb99dd6294ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd85f51547e5244e495343281725fe320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61318) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:47:20 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-228e76ef-3101-4c39-a115-b701e7836043 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dd4d15a1-3a71-49e8-9851-9b49fec6a9e3" status: 200 len: 1230 microversion: 2.1 time: 0.155158 Apr 21 10:47:20 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 22/66] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:47:20 2023] GET /compute/v2.1/servers/dd4d15a1-3a71-49e8-9851-9b49fec6a9e3 => generated 1230 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:47:21 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [req-78f7508e-82e2-477a-aec1-83b81219f7fe req-23ebb90c-411e-4596-8103-5003bb8a2ec8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84b55fc0-e748-4c05-97ad-a6994c0487d2", "name": "network-vif-plugged", "status": "completed", "tag": "2a49817a-aed1-49bd-96b6-36286ff71e1c"}, {"name": "network-changed", "server_uuid": "dd34ae7e-dcf2-4bb2-8ea3-0a3ee553efd8", "tag": "781dee4b-a8ca-4469-aa8c-a2c3c1bd21b3"}]} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:47:21 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-78f7508e-82e2-477a-aec1-83b81219f7fe req-23ebb90c-411e-4596-8103-5003bb8a2ec8 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:47:21 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-78f7508e-82e2-477a-aec1-83b81219f7fe req-23ebb90c-411e-4596-8103-5003bb8a2ec8 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:47:21 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-78f7508e-82e2-477a-aec1-83b81219f7fe req-23ebb90c-411e-4596-8103-5003bb8a2ec8 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:47:21 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-78f7508e-82e2-477a-aec1-83b81219f7fe req-23ebb90c-411e-4596-8103-5003bb8a2ec8 service nova] Creating event network-vif-plugged:2a49817a-aed1-49bd-96b6-36286ff71e1c for instance 84b55fc0-e748-4c05-97ad-a6994c0487d2 on user Apr 21 10:47:21 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-78f7508e-82e2-477a-aec1-83b81219f7fe req-23ebb90c-411e-4596-8103-5003bb8a2ec8 service nova] Creating event network-changed:781dee4b-a8ca-4469-aa8c-a2c3c1bd21b3 for instance dd34ae7e-dcf2-4bb2-8ea3-0a3ee553efd8 on user Apr 21 10:47:21 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [req-78f7508e-82e2-477a-aec1-83b81219f7fe req-23ebb90c-411e-4596-8103-5003bb8a2ec8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.132473 Apr 21 10:47:21 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 24/67] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:47:21 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:47:23 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-04cb7474-2a77-42a0-9bf3-9fd67a447a7f req-5e254789-4b10-4ef5-a78f-ead30df9534a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8609da3-c26d-482a-bc03-017baf4bce22", "tag": "f210779b-302b-4a17-8b57-07837ea54e12"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:47:23 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-04cb7474-2a77-42a0-9bf3-9fd67a447a7f req-5e254789-4b10-4ef5-a78f-ead30df9534a service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:47:23 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-04cb7474-2a77-42a0-9bf3-9fd67a447a7f req-5e254789-4b10-4ef5-a78f-ead30df9534a service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:47:23 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-04cb7474-2a77-42a0-9bf3-9fd67a447a7f req-5e254789-4b10-4ef5-a78f-ead30df9534a service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:47:24 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-04cb7474-2a77-42a0-9bf3-9fd67a447a7f req-5e254789-4b10-4ef5-a78f-ead30df9534a service nova] Creating event network-changed:f210779b-302b-4a17-8b57-07837ea54e12 for instance f8609da3-c26d-482a-bc03-017baf4bce22 on user Apr 21 10:47:24 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-04cb7474-2a77-42a0-9bf3-9fd67a447a7f req-5e254789-4b10-4ef5-a78f-ead30df9534a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61319) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 21 10:47:24 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-04cb7474-2a77-42a0-9bf3-9fd67a447a7f req-5e254789-4b10-4ef5-a78f-ead30df9534a service nova] Acquired lock "compute-rpcapi-router" {{(pid=61319) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 21 10:47:24 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-9b8778ce-723f-4593-8f5d-93bd3c512945 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:47:24 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-9b8778ce-723f-4593-8f5d-93bd3c512945 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:47:24 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-9b8778ce-723f-4593-8f5d-93bd3c512945 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:47:24 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-9b8778ce-723f-4593-8f5d-93bd3c512945 None None] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:47:24 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-9b8778ce-723f-4593-8f5d-93bd3c512945 None None] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:47:24 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-9b8778ce-723f-4593-8f5d-93bd3c512945 None None] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:47:24 user devstack@n-api.service[61319]: INFO nova.compute.rpcapi [None req-9b8778ce-723f-4593-8f5d-93bd3c512945 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 21 10:47:24 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-9b8778ce-723f-4593-8f5d-93bd3c512945 None None] Releasing lock "compute-rpcapi-router" {{(pid=61319) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 21 10:47:24 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-9b8778ce-723f-4593-8f5d-93bd3c512945 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.228077 Apr 21 10:47:24 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 22/68] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:47:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:47:25 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-725e0bf9-99e8-4876-a311-10c7b78ebe4b tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1366625366", "imageRef": "140913c9-4f31-4f27-b107-9d11bf6d2801", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "db5893fb-88b3-400d-8c55-c8f24d5b9084"}], "security_groups": [{"name": "tempest-securitygroup--1167860126"}], "key_name": "tempest-keypair-538215549", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:47:25 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=5 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:47:25 user devstack@n-api.service[61318]: DEBUG nova.network.neutron [None req-725e0bf9-99e8-4876-a311-10c7b78ebe4b tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] validate_networks() for [('db5893fb-88b3-400d-8c55-c8f24d5b9084', None, None, None, None, None)] {{(pid=61318) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 10:47:25 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [req-34d9bf6e-4fe9-4f92-aa58-648774ca3946 req-5e83364c-8816-4d6d-90d8-413d735ad1a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd34ae7e-dcf2-4bb2-8ea3-0a3ee553efd8", "name": "network-vif-plugged", "status": "completed", "tag": "781dee4b-a8ca-4469-aa8c-a2c3c1bd21b3"}]} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:47:25 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-34d9bf6e-4fe9-4f92-aa58-648774ca3946 req-5e83364c-8816-4d6d-90d8-413d735ad1a8 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:47:25 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-34d9bf6e-4fe9-4f92-aa58-648774ca3946 req-5e83364c-8816-4d6d-90d8-413d735ad1a8 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:47:25 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-34d9bf6e-4fe9-4f92-aa58-648774ca3946 req-5e83364c-8816-4d6d-90d8-413d735ad1a8 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:47:25 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-34d9bf6e-4fe9-4f92-aa58-648774ca3946 req-5e83364c-8816-4d6d-90d8-413d735ad1a8 service nova] Creating event network-vif-plugged:781dee4b-a8ca-4469-aa8c-a2c3c1bd21b3 for instance dd34ae7e-dcf2-4bb2-8ea3-0a3ee553efd8 on user Apr 21 10:47:25 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [req-34d9bf6e-4fe9-4f92-aa58-648774ca3946 req-5e83364c-8816-4d6d-90d8-413d735ad1a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118299 Apr 21 10:47:25 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 25/69] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:47:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:47:26 user devstack@n-api.service[61318]: DEBUG nova.virt.hardware [None req-725e0bf9-99e8-4876-a311-10c7b78ebe4b tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Flavor limits 0:0:0 {{(pid=61318) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 10:47:26 user devstack@n-api.service[61318]: DEBUG nova.virt.hardware [None req-725e0bf9-99e8-4876-a311-10c7b78ebe4b tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Image limits 0:0:0 {{(pid=61318) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 10:47:26 user devstack@n-api.service[61318]: DEBUG nova.virt.hardware [None req-725e0bf9-99e8-4876-a311-10c7b78ebe4b tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Flavor pref 0:0:0 {{(pid=61318) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 10:47:26 user devstack@n-api.service[61318]: DEBUG nova.virt.hardware [None req-725e0bf9-99e8-4876-a311-10c7b78ebe4b tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Image pref 0:0:0 {{(pid=61318) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 10:47:26 user devstack@n-api.service[61318]: DEBUG nova.virt.hardware [None req-725e0bf9-99e8-4876-a311-10c7b78ebe4b tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61318) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 10:47:26 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-725e0bf9-99e8-4876-a311-10c7b78ebe4b tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:47:26 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-725e0bf9-99e8-4876-a311-10c7b78ebe4b tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:47:26 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-725e0bf9-99e8-4876-a311-10c7b78ebe4b tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:47:26 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-725e0bf9-99e8-4876-a311-10c7b78ebe4b tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:47:26 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-725e0bf9-99e8-4876-a311-10c7b78ebe4b tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:47:26 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-725e0bf9-99e8-4876-a311-10c7b78ebe4b tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:47:26 user devstack@n-api.service[61318]: DEBUG nova.quota [None req-725e0bf9-99e8-4876-a311-10c7b78ebe4b tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Getting quotas for project a3d2c4f2fb9f45559c4e51e86339a0e0. Resources: {'cores', 'instances', 'ram'} {{(pid=61318) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 10:47:26 user devstack@n-api.service[61318]: DEBUG nova.quota [None req-725e0bf9-99e8-4876-a311-10c7b78ebe4b tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Getting quotas for user c0b1fae0fc8d4b9a998ab0679bace1a1 and project a3d2c4f2fb9f45559c4e51e86339a0e0. Resources: {'cores', 'instances', 'ram'} {{(pid=61318) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 10:47:26 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-725e0bf9-99e8-4876-a311-10c7b78ebe4b tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Going to run 1 instances... {{(pid=61318) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 10:47:26 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-725e0bf9-99e8-4876-a311-10c7b78ebe4b tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] [instance: aecf1ba8-9675-4535-874b-9084361b7693] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='140913c9-4f31-4f27-b107-9d11bf6d2801',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61318) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 10:47:26 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-725e0bf9-99e8-4876-a311-10c7b78ebe4b tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.232617 Apr 21 10:47:26 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 23/70] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 10:47:25 2023] POST /compute/v2.1/servers => generated 404 bytes in 1236 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 10:47:26 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-895ead31-6728-4dcb-956a-feaefe98fd4c tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:47:26 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-895ead31-6728-4dcb-956a-feaefe98fd4c tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] [instance: aecf1ba8-9675-4535-874b-9084361b7693] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:47:26 user devstack@n-api.service[61319]: DEBUG nova.policy [None req-895ead31-6728-4dcb-956a-feaefe98fd4c tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b1fae0fc8d4b9a998ab0679bace1a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d2c4f2fb9f45559c4e51e86339a0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61319) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:47:26 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-895ead31-6728-4dcb-956a-feaefe98fd4c tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aecf1ba8-9675-4535-874b-9084361b7693" status: 200 len: 1239 microversion: 2.1 time: 0.458354 Apr 21 10:47:26 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 23/71] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:47:26 2023] GET /compute/v2.1/servers/aecf1ba8-9675-4535-874b-9084361b7693 => generated 1239 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:47:27 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [req-b1eb8dc9-aada-4665-9f06-a70807e2c84a req-c3a1da01-1115-467b-bd39-f9d8b27c10f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd34ae7e-dcf2-4bb2-8ea3-0a3ee553efd8", "name": "network-vif-plugged", "status": "completed", "tag": "781dee4b-a8ca-4469-aa8c-a2c3c1bd21b3"}]} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:47:27 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-b1eb8dc9-aada-4665-9f06-a70807e2c84a req-c3a1da01-1115-467b-bd39-f9d8b27c10f0 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:47:27 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-b1eb8dc9-aada-4665-9f06-a70807e2c84a req-c3a1da01-1115-467b-bd39-f9d8b27c10f0 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:47:27 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-b1eb8dc9-aada-4665-9f06-a70807e2c84a req-c3a1da01-1115-467b-bd39-f9d8b27c10f0 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:47:27 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-b1eb8dc9-aada-4665-9f06-a70807e2c84a req-c3a1da01-1115-467b-bd39-f9d8b27c10f0 service nova] Creating event network-vif-plugged:781dee4b-a8ca-4469-aa8c-a2c3c1bd21b3 for instance dd34ae7e-dcf2-4bb2-8ea3-0a3ee553efd8 on user Apr 21 10:47:27 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [req-b1eb8dc9-aada-4665-9f06-a70807e2c84a req-c3a1da01-1115-467b-bd39-f9d8b27c10f0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049298 Apr 21 10:47:27 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 26/72] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:47:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:47:29 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-122e2cc7-59c3-4a75-bbb5-7ab040a46380 req-c4bb832e-bfb2-4f0e-bc9b-1cc0c4807d87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15bf9321-a92e-4be2-bcae-a943988c811a", "tag": "fca8b6a6-fd45-4ba5-b1b1-fc40da2fc33d"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:47:29 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-122e2cc7-59c3-4a75-bbb5-7ab040a46380 req-c4bb832e-bfb2-4f0e-bc9b-1cc0c4807d87 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:47:29 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-122e2cc7-59c3-4a75-bbb5-7ab040a46380 req-c4bb832e-bfb2-4f0e-bc9b-1cc0c4807d87 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:47:29 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-122e2cc7-59c3-4a75-bbb5-7ab040a46380 req-c4bb832e-bfb2-4f0e-bc9b-1cc0c4807d87 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:47:29 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-4c7f7a87-c23e-4b28-82ea-1220ae592ccb tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Action: 'create', calling method: .version_select at 0x7f91a618e3b0>, body: {"keypair": {"name": "tempest-keypair-1275342497", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBzw1O+hOmmy5NgPW3bdNxqbqSrhNejvipkwcp0JQTVAJHNzFgSc6wLIdKA9lC+AU3ZJ2MAGprLUKfW+mBKTjT3fZH2AvICL2uFFTJNA7ynActmX3XPF5TRREc2oNq2DWg=="}} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:47:29 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-122e2cc7-59c3-4a75-bbb5-7ab040a46380 req-c4bb832e-bfb2-4f0e-bc9b-1cc0c4807d87 service nova] Creating event network-changed:fca8b6a6-fd45-4ba5-b1b1-fc40da2fc33d for instance 15bf9321-a92e-4be2-bcae-a943988c811a on user Apr 21 10:47:29 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-122e2cc7-59c3-4a75-bbb5-7ab040a46380 req-c4bb832e-bfb2-4f0e-bc9b-1cc0c4807d87 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063832 Apr 21 10:47:29 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 24/73] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:47:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:47:29 user devstack@n-api.service[61318]: DEBUG nova.quota [None req-4c7f7a87-c23e-4b28-82ea-1220ae592ccb tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Getting quotas for project 94e77e1735854e0c966c42e9a613017f. Resources: {'key_pairs'} {{(pid=61318) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 10:47:29 user devstack@n-api.service[61318]: DEBUG nova.quota [None req-4c7f7a87-c23e-4b28-82ea-1220ae592ccb tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Getting quotas for user c600e01acfe140cabcdfe54958e66108 and project 94e77e1735854e0c966c42e9a613017f. Resources: {'key_pairs'} {{(pid=61318) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 10:47:29 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-4c7f7a87-c23e-4b28-82ea-1220ae592ccb tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.514809 Apr 21 10:47:29 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 24/74] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 21 10:47:28 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:47:29 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell0:SELECT=6 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:47:29 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell0:SELECT=18 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:47:29 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [req-d9fc2c83-2f60-43c1-b23a-be724824ad2c req-fec729b3-99d8-4785-927c-bf35667e7bd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8609da3-c26d-482a-bc03-017baf4bce22", "name": "network-vif-plugged", "status": "completed", "tag": "f210779b-302b-4a17-8b57-07837ea54e12"}]} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:47:29 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-d9fc2c83-2f60-43c1-b23a-be724824ad2c req-fec729b3-99d8-4785-927c-bf35667e7bd5 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:47:29 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-d9fc2c83-2f60-43c1-b23a-be724824ad2c req-fec729b3-99d8-4785-927c-bf35667e7bd5 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:47:29 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-d9fc2c83-2f60-43c1-b23a-be724824ad2c req-fec729b3-99d8-4785-927c-bf35667e7bd5 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:47:29 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-d9fc2c83-2f60-43c1-b23a-be724824ad2c req-fec729b3-99d8-4785-927c-bf35667e7bd5 service nova] Creating event network-vif-plugged:f210779b-302b-4a17-8b57-07837ea54e12 for instance f8609da3-c26d-482a-bc03-017baf4bce22 on user Apr 21 10:47:29 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [req-d9fc2c83-2f60-43c1-b23a-be724824ad2c req-fec729b3-99d8-4785-927c-bf35667e7bd5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045402 Apr 21 10:47:29 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 27/75] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:47:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:47:31 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-fdf54860-9b04-419a-96d4-fdd3477b2a75 req-946c63b7-60be-47d6-80fe-3a705abdaa0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd4d15a1-3a71-49e8-9851-9b49fec6a9e3", "tag": "b08cd847-5a3c-4ebf-ac8d-0a8dfd13f57c"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:47:31 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-fdf54860-9b04-419a-96d4-fdd3477b2a75 req-946c63b7-60be-47d6-80fe-3a705abdaa0c service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:47:31 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-fdf54860-9b04-419a-96d4-fdd3477b2a75 req-946c63b7-60be-47d6-80fe-3a705abdaa0c service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:47:31 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-50ced96b-a2aa-490c-8f59-c57f9c72851e tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1501895670", "imageRef": "3b29a01a-1fc0-4d0d-89fb-23d22b2de02e", "flavorRef": "42", "networks": [{"uuid": "fcf7861e-296e-4706-871b-557b594e17c3"}], "security_groups": [{"name": "tempest-securitygroup--344239548"}], "key_name": "tempest-keypair-1275342497", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:47:31 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-fdf54860-9b04-419a-96d4-fdd3477b2a75 req-946c63b7-60be-47d6-80fe-3a705abdaa0c service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:47:31 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-fdf54860-9b04-419a-96d4-fdd3477b2a75 req-946c63b7-60be-47d6-80fe-3a705abdaa0c service nova] Creating event network-changed:b08cd847-5a3c-4ebf-ac8d-0a8dfd13f57c for instance dd4d15a1-3a71-49e8-9851-9b49fec6a9e3 on user Apr 21 10:47:31 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-fdf54860-9b04-419a-96d4-fdd3477b2a75 req-946c63b7-60be-47d6-80fe-3a705abdaa0c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043664 Apr 21 10:47:31 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 25/76] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:47:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:47:31 user devstack@n-api.service[61318]: DEBUG nova.network.neutron [None req-50ced96b-a2aa-490c-8f59-c57f9c72851e tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] validate_networks() for [('fcf7861e-296e-4706-871b-557b594e17c3', None, None, None, None, None)] {{(pid=61318) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 10:47:31 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [req-9b5b030c-52bd-4a2f-80af-522db964cd0c req-b256ed78-eafc-4b0c-b43e-f8e31a5b01c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8609da3-c26d-482a-bc03-017baf4bce22", "name": "network-vif-plugged", "status": "completed", "tag": "f210779b-302b-4a17-8b57-07837ea54e12"}]} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:47:31 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=7 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:47:31 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-9b5b030c-52bd-4a2f-80af-522db964cd0c req-b256ed78-eafc-4b0c-b43e-f8e31a5b01c5 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:47:31 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-9b5b030c-52bd-4a2f-80af-522db964cd0c req-b256ed78-eafc-4b0c-b43e-f8e31a5b01c5 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:47:31 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-9b5b030c-52bd-4a2f-80af-522db964cd0c req-b256ed78-eafc-4b0c-b43e-f8e31a5b01c5 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:47:31 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-9b5b030c-52bd-4a2f-80af-522db964cd0c req-b256ed78-eafc-4b0c-b43e-f8e31a5b01c5 service nova] Creating event network-vif-plugged:f210779b-302b-4a17-8b57-07837ea54e12 for instance f8609da3-c26d-482a-bc03-017baf4bce22 on user Apr 21 10:47:31 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [req-9b5b030c-52bd-4a2f-80af-522db964cd0c req-b256ed78-eafc-4b0c-b43e-f8e31a5b01c5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038615 Apr 21 10:47:31 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 28/77] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:47:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:47:32 user devstack@n-api.service[61318]: DEBUG nova.virt.hardware [None req-50ced96b-a2aa-490c-8f59-c57f9c72851e tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Flavor limits 0:0:0 {{(pid=61318) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 10:47:32 user devstack@n-api.service[61318]: DEBUG nova.virt.hardware [None req-50ced96b-a2aa-490c-8f59-c57f9c72851e tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Image limits 0:0:0 {{(pid=61318) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 10:47:32 user devstack@n-api.service[61318]: DEBUG nova.virt.hardware [None req-50ced96b-a2aa-490c-8f59-c57f9c72851e tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Flavor pref 0:0:0 {{(pid=61318) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 10:47:32 user devstack@n-api.service[61318]: DEBUG nova.virt.hardware [None req-50ced96b-a2aa-490c-8f59-c57f9c72851e tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Image pref 0:0:0 {{(pid=61318) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 10:47:32 user devstack@n-api.service[61318]: DEBUG nova.virt.hardware [None req-50ced96b-a2aa-490c-8f59-c57f9c72851e tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61318) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 10:47:32 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell0:SELECT=31 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:47:32 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-50ced96b-a2aa-490c-8f59-c57f9c72851e tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:47:32 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-50ced96b-a2aa-490c-8f59-c57f9c72851e tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:47:32 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-50ced96b-a2aa-490c-8f59-c57f9c72851e tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:47:32 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-50ced96b-a2aa-490c-8f59-c57f9c72851e tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:47:32 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-50ced96b-a2aa-490c-8f59-c57f9c72851e tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:47:32 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-50ced96b-a2aa-490c-8f59-c57f9c72851e tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:47:32 user devstack@n-api.service[61318]: DEBUG nova.quota [None req-50ced96b-a2aa-490c-8f59-c57f9c72851e tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Getting quotas for project 94e77e1735854e0c966c42e9a613017f. Resources: {'cores', 'instances', 'ram'} {{(pid=61318) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 10:47:32 user devstack@n-api.service[61318]: DEBUG nova.quota [None req-50ced96b-a2aa-490c-8f59-c57f9c72851e tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Getting quotas for user c600e01acfe140cabcdfe54958e66108 and project 94e77e1735854e0c966c42e9a613017f. Resources: {'cores', 'instances', 'ram'} {{(pid=61318) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 10:47:32 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-50ced96b-a2aa-490c-8f59-c57f9c72851e tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Going to run 1 instances... {{(pid=61318) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 10:47:32 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-50ced96b-a2aa-490c-8f59-c57f9c72851e tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] [instance: 8ae797bd-c587-43a3-b941-e6d6d6c74e51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3b29a01a-1fc0-4d0d-89fb-23d22b2de02e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61318) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 10:47:32 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-50ced96b-a2aa-490c-8f59-c57f9c72851e tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.358315 Apr 21 10:47:32 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 25/78] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 10:47:31 2023] POST /compute/v2.1/servers => generated 403 bytes in 1360 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 10:47:32 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-e3fad8f4-8543-4c73-ba6b-23ab3e7a98ba tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:47:32 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-e3fad8f4-8543-4c73-ba6b-23ab3e7a98ba tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] [instance: 8ae797bd-c587-43a3-b941-e6d6d6c74e51] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:47:32 user devstack@n-api.service[61319]: DEBUG nova.policy [None req-e3fad8f4-8543-4c73-ba6b-23ab3e7a98ba tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c600e01acfe140cabcdfe54958e66108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e77e1735854e0c966c42e9a613017f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61319) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:47:32 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-e3fad8f4-8543-4c73-ba6b-23ab3e7a98ba tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8ae797bd-c587-43a3-b941-e6d6d6c74e51" status: 200 len: 1236 microversion: 2.1 time: 0.376721 Apr 21 10:47:32 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 26/79] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:47:32 2023] GET /compute/v2.1/servers/8ae797bd-c587-43a3-b941-e6d6d6c74e51 => generated 1236 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:47:34 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [req-b2e7db6f-7790-4001-ba3c-e9e41848b688 req-92364ab3-77f6-48da-ada1-dc68215c50bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15bf9321-a92e-4be2-bcae-a943988c811a", "name": "network-vif-plugged", "status": "completed", "tag": "fca8b6a6-fd45-4ba5-b1b1-fc40da2fc33d"}]} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:47:34 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-b2e7db6f-7790-4001-ba3c-e9e41848b688 req-92364ab3-77f6-48da-ada1-dc68215c50bd service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:47:34 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-b2e7db6f-7790-4001-ba3c-e9e41848b688 req-92364ab3-77f6-48da-ada1-dc68215c50bd service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:47:34 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-b2e7db6f-7790-4001-ba3c-e9e41848b688 req-92364ab3-77f6-48da-ada1-dc68215c50bd service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:47:34 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-b2e7db6f-7790-4001-ba3c-e9e41848b688 req-92364ab3-77f6-48da-ada1-dc68215c50bd service nova] Creating event network-vif-plugged:fca8b6a6-fd45-4ba5-b1b1-fc40da2fc33d for instance 15bf9321-a92e-4be2-bcae-a943988c811a on user Apr 21 10:47:34 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [req-b2e7db6f-7790-4001-ba3c-e9e41848b688 req-92364ab3-77f6-48da-ada1-dc68215c50bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042659 Apr 21 10:47:34 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 29/80] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:47:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:47:35 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [req-659ed031-bb52-427c-ba3a-b0bda3d29727 req-9e10b87b-49bc-4720-96c7-970b9f8b1e12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd4d15a1-3a71-49e8-9851-9b49fec6a9e3", "name": "network-vif-plugged", "status": "completed", "tag": "b08cd847-5a3c-4ebf-ac8d-0a8dfd13f57c"}]} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:47:35 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-659ed031-bb52-427c-ba3a-b0bda3d29727 req-9e10b87b-49bc-4720-96c7-970b9f8b1e12 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:47:35 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-659ed031-bb52-427c-ba3a-b0bda3d29727 req-9e10b87b-49bc-4720-96c7-970b9f8b1e12 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:47:35 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-659ed031-bb52-427c-ba3a-b0bda3d29727 req-9e10b87b-49bc-4720-96c7-970b9f8b1e12 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:47:35 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-659ed031-bb52-427c-ba3a-b0bda3d29727 req-9e10b87b-49bc-4720-96c7-970b9f8b1e12 service nova] Creating event network-vif-plugged:b08cd847-5a3c-4ebf-ac8d-0a8dfd13f57c for instance dd4d15a1-3a71-49e8-9851-9b49fec6a9e3 on user Apr 21 10:47:35 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-659ed031-bb52-427c-ba3a-b0bda3d29727 req-9e10b87b-49bc-4720-96c7-970b9f8b1e12 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61318) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 21 10:47:35 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-659ed031-bb52-427c-ba3a-b0bda3d29727 req-9e10b87b-49bc-4720-96c7-970b9f8b1e12 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61318) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 21 10:47:35 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-2b5a86d3-0576-4f72-8d60-f489b954da14 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:47:35 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-2b5a86d3-0576-4f72-8d60-f489b954da14 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:47:35 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-2b5a86d3-0576-4f72-8d60-f489b954da14 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:47:35 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-2b5a86d3-0576-4f72-8d60-f489b954da14 None None] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:47:35 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-2b5a86d3-0576-4f72-8d60-f489b954da14 None None] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:47:35 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-2b5a86d3-0576-4f72-8d60-f489b954da14 None None] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:47:35 user devstack@n-api.service[61318]: INFO nova.compute.rpcapi [None req-2b5a86d3-0576-4f72-8d60-f489b954da14 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 21 10:47:35 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-2b5a86d3-0576-4f72-8d60-f489b954da14 None None] Releasing lock "compute-rpcapi-router" {{(pid=61318) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 21 10:47:35 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-2b5a86d3-0576-4f72-8d60-f489b954da14 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139589 Apr 21 10:47:35 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 26/81] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:47:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:47:36 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-7c9bd302-a93e-4fb5-b244-ee3604229246 req-3671626f-851f-44b2-940f-0a9cdf89847d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15bf9321-a92e-4be2-bcae-a943988c811a", "name": "network-vif-plugged", "status": "completed", "tag": "fca8b6a6-fd45-4ba5-b1b1-fc40da2fc33d"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:47:36 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell0:SELECT=6 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:47:36 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-7c9bd302-a93e-4fb5-b244-ee3604229246 req-3671626f-851f-44b2-940f-0a9cdf89847d service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:47:36 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-7c9bd302-a93e-4fb5-b244-ee3604229246 req-3671626f-851f-44b2-940f-0a9cdf89847d service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:47:36 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-7c9bd302-a93e-4fb5-b244-ee3604229246 req-3671626f-851f-44b2-940f-0a9cdf89847d service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:47:36 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-7c9bd302-a93e-4fb5-b244-ee3604229246 req-3671626f-851f-44b2-940f-0a9cdf89847d service nova] Creating event network-vif-plugged:fca8b6a6-fd45-4ba5-b1b1-fc40da2fc33d for instance 15bf9321-a92e-4be2-bcae-a943988c811a on user Apr 21 10:47:36 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-7c9bd302-a93e-4fb5-b244-ee3604229246 req-3671626f-851f-44b2-940f-0a9cdf89847d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046007 Apr 21 10:47:36 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 27/82] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:47:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:47:37 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [req-3ae92414-403f-4130-a20a-d37934f0472b req-6b2fbb80-1a95-47e3-8dba-f1f536bb44ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd4d15a1-3a71-49e8-9851-9b49fec6a9e3", "name": "network-vif-plugged", "status": "completed", "tag": "b08cd847-5a3c-4ebf-ac8d-0a8dfd13f57c"}, {"name": "network-changed", "server_uuid": "aecf1ba8-9675-4535-874b-9084361b7693", "tag": "892719ba-88a5-4998-9b27-c47babc15f5c"}]} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:47:37 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-3ae92414-403f-4130-a20a-d37934f0472b req-6b2fbb80-1a95-47e3-8dba-f1f536bb44ec service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:47:37 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-3ae92414-403f-4130-a20a-d37934f0472b req-6b2fbb80-1a95-47e3-8dba-f1f536bb44ec service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:47:37 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-3ae92414-403f-4130-a20a-d37934f0472b req-6b2fbb80-1a95-47e3-8dba-f1f536bb44ec service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:47:37 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-3ae92414-403f-4130-a20a-d37934f0472b req-6b2fbb80-1a95-47e3-8dba-f1f536bb44ec service nova] Creating event network-vif-plugged:b08cd847-5a3c-4ebf-ac8d-0a8dfd13f57c for instance dd4d15a1-3a71-49e8-9851-9b49fec6a9e3 on user Apr 21 10:47:37 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-3ae92414-403f-4130-a20a-d37934f0472b req-6b2fbb80-1a95-47e3-8dba-f1f536bb44ec service nova] Creating event network-changed:892719ba-88a5-4998-9b27-c47babc15f5c for instance aecf1ba8-9675-4535-874b-9084361b7693 on user Apr 21 10:47:37 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [req-3ae92414-403f-4130-a20a-d37934f0472b req-6b2fbb80-1a95-47e3-8dba-f1f536bb44ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.059994 Apr 21 10:47:37 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 30/83] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:47:37 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:47:41 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [req-0f3fbc4f-fa29-4d2f-a417-e74a6d8a601c req-a4de7bfc-6e6d-4031-b79c-3e16175c6efd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ae797bd-c587-43a3-b941-e6d6d6c74e51", "tag": "44d4e2d5-0850-4b05-9d97-f3916611f340"}]} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:47:41 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-0f3fbc4f-fa29-4d2f-a417-e74a6d8a601c req-a4de7bfc-6e6d-4031-b79c-3e16175c6efd service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:47:41 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-0f3fbc4f-fa29-4d2f-a417-e74a6d8a601c req-a4de7bfc-6e6d-4031-b79c-3e16175c6efd service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:47:41 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-0f3fbc4f-fa29-4d2f-a417-e74a6d8a601c req-a4de7bfc-6e6d-4031-b79c-3e16175c6efd service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:47:41 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-0f3fbc4f-fa29-4d2f-a417-e74a6d8a601c req-a4de7bfc-6e6d-4031-b79c-3e16175c6efd service nova] Creating event network-changed:44d4e2d5-0850-4b05-9d97-f3916611f340 for instance 8ae797bd-c587-43a3-b941-e6d6d6c74e51 on user Apr 21 10:47:41 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [req-0f3fbc4f-fa29-4d2f-a417-e74a6d8a601c req-a4de7bfc-6e6d-4031-b79c-3e16175c6efd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101454 Apr 21 10:47:41 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 27/84] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:47:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:47:43 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell0:SELECT=20 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:47:43 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-9930cee4-45e7-4e0b-a715-88d3f29bc3e0 req-3674185d-2165-4027-b6ac-d37e2648ec1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aecf1ba8-9675-4535-874b-9084361b7693", "name": "network-vif-plugged", "status": "completed", "tag": "892719ba-88a5-4998-9b27-c47babc15f5c"}, {"server_uuid": "aecf1ba8-9675-4535-874b-9084361b7693", "name": "network-vif-plugged", "status": "completed", "tag": "892719ba-88a5-4998-9b27-c47babc15f5c"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:47:43 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=7 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:47:43 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-9930cee4-45e7-4e0b-a715-88d3f29bc3e0 req-3674185d-2165-4027-b6ac-d37e2648ec1d service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:47:43 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-9930cee4-45e7-4e0b-a715-88d3f29bc3e0 req-3674185d-2165-4027-b6ac-d37e2648ec1d service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:47:43 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-9930cee4-45e7-4e0b-a715-88d3f29bc3e0 req-3674185d-2165-4027-b6ac-d37e2648ec1d service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:47:43 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell1:SELECT=15 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:47:43 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-9930cee4-45e7-4e0b-a715-88d3f29bc3e0 req-3674185d-2165-4027-b6ac-d37e2648ec1d service nova] Creating event network-vif-plugged:892719ba-88a5-4998-9b27-c47babc15f5c for instance aecf1ba8-9675-4535-874b-9084361b7693 on user Apr 21 10:47:43 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-9930cee4-45e7-4e0b-a715-88d3f29bc3e0 req-3674185d-2165-4027-b6ac-d37e2648ec1d service nova] Creating event network-vif-plugged:892719ba-88a5-4998-9b27-c47babc15f5c for instance aecf1ba8-9675-4535-874b-9084361b7693 on user Apr 21 10:47:43 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-9930cee4-45e7-4e0b-a715-88d3f29bc3e0 req-3674185d-2165-4027-b6ac-d37e2648ec1d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.043030 Apr 21 10:47:43 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 28/85] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:47:43 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:47:45 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [req-5f30a128-f2e2-43aa-8b3f-169fe9d04c32 req-6ffec14e-e37b-4ce8-82a5-22d662a05604 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ae797bd-c587-43a3-b941-e6d6d6c74e51", "name": "network-vif-plugged", "status": "completed", "tag": "44d4e2d5-0850-4b05-9d97-f3916611f340"}]} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:47:45 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-5f30a128-f2e2-43aa-8b3f-169fe9d04c32 req-6ffec14e-e37b-4ce8-82a5-22d662a05604 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:47:45 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-5f30a128-f2e2-43aa-8b3f-169fe9d04c32 req-6ffec14e-e37b-4ce8-82a5-22d662a05604 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:47:45 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-5f30a128-f2e2-43aa-8b3f-169fe9d04c32 req-6ffec14e-e37b-4ce8-82a5-22d662a05604 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:47:45 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell1:SELECT=25 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:47:45 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-5f30a128-f2e2-43aa-8b3f-169fe9d04c32 req-6ffec14e-e37b-4ce8-82a5-22d662a05604 service nova] Creating event network-vif-plugged:44d4e2d5-0850-4b05-9d97-f3916611f340 for instance 8ae797bd-c587-43a3-b941-e6d6d6c74e51 on user Apr 21 10:47:45 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [req-5f30a128-f2e2-43aa-8b3f-169fe9d04c32 req-6ffec14e-e37b-4ce8-82a5-22d662a05604 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126130 Apr 21 10:47:45 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 31/86] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:47:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:47:47 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell0:SELECT=5 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:47:47 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell0:SELECT=6 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:47:48 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-517b9baf-6bac-42f8-bf07-af43a796d93c req-a41ade6e-7804-4df4-a58e-7aa2068e2057 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ae797bd-c587-43a3-b941-e6d6d6c74e51", "name": "network-vif-plugged", "status": "completed", "tag": "44d4e2d5-0850-4b05-9d97-f3916611f340"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:47:48 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-517b9baf-6bac-42f8-bf07-af43a796d93c req-a41ade6e-7804-4df4-a58e-7aa2068e2057 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:47:48 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-517b9baf-6bac-42f8-bf07-af43a796d93c req-a41ade6e-7804-4df4-a58e-7aa2068e2057 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:47:48 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-517b9baf-6bac-42f8-bf07-af43a796d93c req-a41ade6e-7804-4df4-a58e-7aa2068e2057 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:47:48 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-517b9baf-6bac-42f8-bf07-af43a796d93c req-a41ade6e-7804-4df4-a58e-7aa2068e2057 service nova] Creating event network-vif-plugged:44d4e2d5-0850-4b05-9d97-f3916611f340 for instance 8ae797bd-c587-43a3-b941-e6d6d6c74e51 on user Apr 21 10:47:48 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-517b9baf-6bac-42f8-bf07-af43a796d93c req-a41ade6e-7804-4df4-a58e-7aa2068e2057 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054671 Apr 21 10:47:48 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 29/87] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:47:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:47:48 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-b248ebc3-8922-4af3-b2a7-dcfb64a93b73 tempest-VolumesNegativeTest-380472319 tempest-VolumesNegativeTest-380472319-project-member] Action: 'create', calling method: .version_select at 0x7f91a618f490>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1529294674", "metadata": {"Type": "work"}}} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:47:48 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-b248ebc3-8922-4af3-b2a7-dcfb64a93b73 tempest-VolumesNegativeTest-380472319 tempest-VolumesNegativeTest-380472319-project-member] Request method failure captured: Apr 21 10:47:48 user devstack@n-api.service[61318]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 21 10:47:48 user devstack@n-api.service[61318]: Accept: application/json Apr 21 10:47:48 user devstack@n-api.service[61318]: Accept-Encoding: identity Apr 21 10:47:48 user devstack@n-api.service[61318]: Connection: close Apr 21 10:47:48 user devstack@n-api.service[61318]: Content-Length: 122 Apr 21 10:47:48 user devstack@n-api.service[61318]: Content-Type: application/json Apr 21 10:47:48 user devstack@n-api.service[61318]: Host: 10.0.0.210 Apr 21 10:47:48 user devstack@n-api.service[61318]: Openstack-System-Scope: None Apr 21 10:47:48 user devstack@n-api.service[61318]: User-Agent: python-urllib3/1.26.15 Apr 21 10:47:48 user devstack@n-api.service[61318]: X-Auth-Token: gAAAAABkQmnTqifCd9iFAqP5A7zLzF8ngozM7KKJGdCZ8_BFLuhni6cJ_HXsm8veEZ48YMG5hJxwpROsg5cqh_PjxCKYsVu3d_Kzdm90tVAnSSX0r2nFtIkVrg4xgHMyGbX0F5pwcoI916gfIKzGkQskT0hi9pGqybhPwMNyRKml4Lk7Fvk2sAk Apr 21 10:47:48 user devstack@n-api.service[61318]: X-Domain-Id: None Apr 21 10:47:48 user devstack@n-api.service[61318]: X-Domain-Name: None Apr 21 10:47:48 user devstack@n-api.service[61318]: X-Identity-Status: Confirmed Apr 21 10:47:48 user devstack@n-api.service[61318]: X-Is-Admin-Project: True Apr 21 10:47:48 user devstack@n-api.service[61318]: X-Project-Domain-Id: default Apr 21 10:47:48 user devstack@n-api.service[61318]: X-Project-Domain-Name: Default Apr 21 10:47:48 user devstack@n-api.service[61318]: X-Project-Id: b17771d455f7488d899e5c099a480920 Apr 21 10:47:48 user devstack@n-api.service[61318]: X-Project-Name: tempest-VolumesNegativeTest-380472319 Apr 21 10:47:48 user devstack@n-api.service[61318]: X-Role: reader,member Apr 21 10:47:48 user devstack@n-api.service[61318]: X-Roles: reader,member Apr 21 10:47:48 user devstack@n-api.service[61318]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b17771d455f7488d899e5c099a480920"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b17771d455f7488d899e5c099a480920"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b17771d455f7488d899e5c099a480920"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 10:47:48 user devstack@n-api.service[61318]: X-Tenant: tempest-VolumesNegativeTest-380472319 Apr 21 10:47:48 user devstack@n-api.service[61318]: X-Tenant-Id: b17771d455f7488d899e5c099a480920 Apr 21 10:47:48 user devstack@n-api.service[61318]: X-Tenant-Name: tempest-VolumesNegativeTest-380472319 Apr 21 10:47:48 user devstack@n-api.service[61318]: X-User: tempest-VolumesNegativeTest-380472319-project-member Apr 21 10:47:48 user devstack@n-api.service[61318]: X-User-Domain-Id: default Apr 21 10:47:48 user devstack@n-api.service[61318]: X-User-Domain-Name: Default Apr 21 10:47:48 user devstack@n-api.service[61318]: X-User-Id: 39ff64e3e10c4290b7bfcee65c796d8d Apr 21 10:47:48 user devstack@n-api.service[61318]: X-User-Name: tempest-VolumesNegativeTest-380472319-project-member Apr 21 10:47:48 user devstack@n-api.service[61318]: Apr 21 10:47:48 user devstack@n-api.service[61318]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1529294674", "metadata": {"Type": "work"}}} Apr 21 10:47:48 user devstack@n-api.service[61318]: method: Apr 21 10:47:48 user devstack@n-api.service[61318]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 21 10:47:48 user devstack@n-api.service[61318]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1529294674', 'metadata': {'Type': 'work'}}}} Apr 21 10:47:48 user devstack@n-api.service[61318]: {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise error Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi '#$%' Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:47:48 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-b248ebc3-8922-4af3-b2a7-dcfb64a93b73 tempest-VolumesNegativeTest-380472319 tempest-VolumesNegativeTest-380472319-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61318) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 10:47:48 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-b248ebc3-8922-4af3-b2a7-dcfb64a93b73 tempest-VolumesNegativeTest-380472319 tempest-VolumesNegativeTest-380472319-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.188432 Apr 21 10:47:48 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 28/88] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 21 10:47:47 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 191 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 21 10:47:48 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-8979fe84-737a-4913-9387-368b0382b138 tempest-VolumesNegativeTest-380472319 tempest-VolumesNegativeTest-380472319-project-member] Action: 'create', calling method: .version_select at 0x7f91a69cca60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1077306008", "metadata": {"Type": "work"}}} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:47:48 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-8979fe84-737a-4913-9387-368b0382b138 tempest-VolumesNegativeTest-380472319 tempest-VolumesNegativeTest-380472319-project-member] Request method failure captured: Apr 21 10:47:48 user devstack@n-api.service[61320]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 21 10:47:48 user devstack@n-api.service[61320]: Accept: application/json Apr 21 10:47:48 user devstack@n-api.service[61320]: Accept-Encoding: identity Apr 21 10:47:48 user devstack@n-api.service[61320]: Connection: close Apr 21 10:47:48 user devstack@n-api.service[61320]: Content-Length: 120 Apr 21 10:47:48 user devstack@n-api.service[61320]: Content-Type: application/json Apr 21 10:47:48 user devstack@n-api.service[61320]: Host: 10.0.0.210 Apr 21 10:47:48 user devstack@n-api.service[61320]: Openstack-System-Scope: None Apr 21 10:47:48 user devstack@n-api.service[61320]: User-Agent: python-urllib3/1.26.15 Apr 21 10:47:48 user devstack@n-api.service[61320]: X-Auth-Token: gAAAAABkQmnTqifCd9iFAqP5A7zLzF8ngozM7KKJGdCZ8_BFLuhni6cJ_HXsm8veEZ48YMG5hJxwpROsg5cqh_PjxCKYsVu3d_Kzdm90tVAnSSX0r2nFtIkVrg4xgHMyGbX0F5pwcoI916gfIKzGkQskT0hi9pGqybhPwMNyRKml4Lk7Fvk2sAk Apr 21 10:47:48 user devstack@n-api.service[61320]: X-Domain-Id: None Apr 21 10:47:48 user devstack@n-api.service[61320]: X-Domain-Name: None Apr 21 10:47:48 user devstack@n-api.service[61320]: X-Identity-Status: Confirmed Apr 21 10:47:48 user devstack@n-api.service[61320]: X-Is-Admin-Project: True Apr 21 10:47:48 user devstack@n-api.service[61320]: X-Project-Domain-Id: default Apr 21 10:47:48 user devstack@n-api.service[61320]: X-Project-Domain-Name: Default Apr 21 10:47:48 user devstack@n-api.service[61320]: X-Project-Id: b17771d455f7488d899e5c099a480920 Apr 21 10:47:48 user devstack@n-api.service[61320]: X-Project-Name: tempest-VolumesNegativeTest-380472319 Apr 21 10:47:48 user devstack@n-api.service[61320]: X-Role: reader,member Apr 21 10:47:48 user devstack@n-api.service[61320]: X-Roles: reader,member Apr 21 10:47:48 user devstack@n-api.service[61320]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b17771d455f7488d899e5c099a480920"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b17771d455f7488d899e5c099a480920"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b17771d455f7488d899e5c099a480920"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 10:47:48 user devstack@n-api.service[61320]: X-Tenant: tempest-VolumesNegativeTest-380472319 Apr 21 10:47:48 user devstack@n-api.service[61320]: X-Tenant-Id: b17771d455f7488d899e5c099a480920 Apr 21 10:47:48 user devstack@n-api.service[61320]: X-Tenant-Name: tempest-VolumesNegativeTest-380472319 Apr 21 10:47:48 user devstack@n-api.service[61320]: X-User: tempest-VolumesNegativeTest-380472319-project-member Apr 21 10:47:48 user devstack@n-api.service[61320]: X-User-Domain-Id: default Apr 21 10:47:48 user devstack@n-api.service[61320]: X-User-Domain-Name: Default Apr 21 10:47:48 user devstack@n-api.service[61320]: X-User-Id: 39ff64e3e10c4290b7bfcee65c796d8d Apr 21 10:47:48 user devstack@n-api.service[61320]: X-User-Name: tempest-VolumesNegativeTest-380472319-project-member Apr 21 10:47:48 user devstack@n-api.service[61320]: Apr 21 10:47:48 user devstack@n-api.service[61320]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1077306008", "metadata": {"Type": "work"}}} Apr 21 10:47:48 user devstack@n-api.service[61320]: method: Apr 21 10:47:48 user devstack@n-api.service[61320]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 21 10:47:48 user devstack@n-api.service[61320]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1077306008', 'metadata': {'Type': 'work'}}}} Apr 21 10:47:48 user devstack@n-api.service[61320]: {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise error Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi '0' Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:47:48 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-8979fe84-737a-4913-9387-368b0382b138 tempest-VolumesNegativeTest-380472319 tempest-VolumesNegativeTest-380472319-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 10:47:48 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-8979fe84-737a-4913-9387-368b0382b138 tempest-VolumesNegativeTest-380472319 tempest-VolumesNegativeTest-380472319-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.022242 Apr 21 10:47:48 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 32/89] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 21 10:47:48 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 21 10:47:48 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-1c76c1e5-9209-485f-ac09-f9104443c1fd tempest-VolumesNegativeTest-380472319 tempest-VolumesNegativeTest-380472319-project-member] Action: 'create', calling method: .version_select at 0x7f91a69c2b00>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-737530316", "metadata": {"Type": "work"}}} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:47:48 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-1c76c1e5-9209-485f-ac09-f9104443c1fd tempest-VolumesNegativeTest-380472319 tempest-VolumesNegativeTest-380472319-project-member] Request method failure captured: Apr 21 10:47:48 user devstack@n-api.service[61319]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 21 10:47:48 user devstack@n-api.service[61319]: Accept: application/json Apr 21 10:47:48 user devstack@n-api.service[61319]: Accept-Encoding: identity Apr 21 10:47:48 user devstack@n-api.service[61319]: Connection: close Apr 21 10:47:48 user devstack@n-api.service[61319]: Content-Length: 118 Apr 21 10:47:48 user devstack@n-api.service[61319]: Content-Type: application/json Apr 21 10:47:48 user devstack@n-api.service[61319]: Host: 10.0.0.210 Apr 21 10:47:48 user devstack@n-api.service[61319]: Openstack-System-Scope: None Apr 21 10:47:48 user devstack@n-api.service[61319]: User-Agent: python-urllib3/1.26.15 Apr 21 10:47:48 user devstack@n-api.service[61319]: X-Auth-Token: gAAAAABkQmnTqifCd9iFAqP5A7zLzF8ngozM7KKJGdCZ8_BFLuhni6cJ_HXsm8veEZ48YMG5hJxwpROsg5cqh_PjxCKYsVu3d_Kzdm90tVAnSSX0r2nFtIkVrg4xgHMyGbX0F5pwcoI916gfIKzGkQskT0hi9pGqybhPwMNyRKml4Lk7Fvk2sAk Apr 21 10:47:48 user devstack@n-api.service[61319]: X-Domain-Id: None Apr 21 10:47:48 user devstack@n-api.service[61319]: X-Domain-Name: None Apr 21 10:47:48 user devstack@n-api.service[61319]: X-Identity-Status: Confirmed Apr 21 10:47:48 user devstack@n-api.service[61319]: X-Is-Admin-Project: True Apr 21 10:47:48 user devstack@n-api.service[61319]: X-Project-Domain-Id: default Apr 21 10:47:48 user devstack@n-api.service[61319]: X-Project-Domain-Name: Default Apr 21 10:47:48 user devstack@n-api.service[61319]: X-Project-Id: b17771d455f7488d899e5c099a480920 Apr 21 10:47:48 user devstack@n-api.service[61319]: X-Project-Name: tempest-VolumesNegativeTest-380472319 Apr 21 10:47:48 user devstack@n-api.service[61319]: X-Role: reader,member Apr 21 10:47:48 user devstack@n-api.service[61319]: X-Roles: reader,member Apr 21 10:47:48 user devstack@n-api.service[61319]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b17771d455f7488d899e5c099a480920"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b17771d455f7488d899e5c099a480920"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b17771d455f7488d899e5c099a480920"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 10:47:48 user devstack@n-api.service[61319]: X-Tenant: tempest-VolumesNegativeTest-380472319 Apr 21 10:47:48 user devstack@n-api.service[61319]: X-Tenant-Id: b17771d455f7488d899e5c099a480920 Apr 21 10:47:48 user devstack@n-api.service[61319]: X-Tenant-Name: tempest-VolumesNegativeTest-380472319 Apr 21 10:47:48 user devstack@n-api.service[61319]: X-User: tempest-VolumesNegativeTest-380472319-project-member Apr 21 10:47:48 user devstack@n-api.service[61319]: X-User-Domain-Id: default Apr 21 10:47:48 user devstack@n-api.service[61319]: X-User-Domain-Name: Default Apr 21 10:47:48 user devstack@n-api.service[61319]: X-User-Id: 39ff64e3e10c4290b7bfcee65c796d8d Apr 21 10:47:48 user devstack@n-api.service[61319]: X-User-Name: tempest-VolumesNegativeTest-380472319-project-member Apr 21 10:47:48 user devstack@n-api.service[61319]: Apr 21 10:47:48 user devstack@n-api.service[61319]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-737530316", "metadata": {"Type": "work"}}} Apr 21 10:47:48 user devstack@n-api.service[61319]: method: Apr 21 10:47:48 user devstack@n-api.service[61319]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 21 10:47:48 user devstack@n-api.service[61319]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-737530316', 'metadata': {'Type': 'work'}}}} Apr 21 10:47:48 user devstack@n-api.service[61319]: {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 10:47:48 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:47:48 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 21 10:47:48 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 21 10:47:48 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 21 10:47:48 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi raise error Apr 21 10:47:48 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 21 10:47:48 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:47:48 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 21 10:47:48 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 21 10:47:48 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:47:48 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 21 10:47:48 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi '' Apr 21 10:47:48 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:47:48 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:47:48 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:47:48 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:47:48 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 10:47:48 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 10:47:48 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 10:47:48 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 10:47:48 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 21 10:47:48 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 21 10:47:48 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 10:47:48 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 10:47:48 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 21 10:47:48 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 21 10:47:48 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 21 10:47:48 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 21 10:47:48 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 21 10:47:48 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 21 10:47:48 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 21 10:47:48 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:47:48 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:47:48 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:47:48 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:47:48 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 10:47:48 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 10:47:48 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 21 10:47:48 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 21 10:47:48 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 21 10:47:48 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:47:48 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-1c76c1e5-9209-485f-ac09-f9104443c1fd tempest-VolumesNegativeTest-380472319 tempest-VolumesNegativeTest-380472319-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 10:47:48 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-1c76c1e5-9209-485f-ac09-f9104443c1fd tempest-VolumesNegativeTest-380472319 tempest-VolumesNegativeTest-380472319-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.021347 Apr 21 10:47:48 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 30/90] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 21 10:47:48 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 21 10:47:48 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-b31de4ee-c4a6-4aa3-9949-7514fa0230cd tempest-VolumesNegativeTest-380472319 tempest-VolumesNegativeTest-380472319-project-member] Calling method '.version_select at 0x7f91a61ed6c0>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:47:48 user devstack@n-api.service[61318]: INFO nova.api.openstack.wsgi [None req-b31de4ee-c4a6-4aa3-9949-7514fa0230cd tempest-VolumesNegativeTest-380472319 tempest-VolumesNegativeTest-380472319-project-member] HTTP exception thrown: Volume tempest-invalid-1008252042 could not be found. Apr 21 10:47:48 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-b31de4ee-c4a6-4aa3-9949-7514fa0230cd tempest-VolumesNegativeTest-380472319 tempest-VolumesNegativeTest-380472319-project-member] Request method failure captured: Apr 21 10:47:48 user devstack@n-api.service[61318]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1008252042 HTTP/1.1 Apr 21 10:47:48 user devstack@n-api.service[61318]: Accept: application/json Apr 21 10:47:48 user devstack@n-api.service[61318]: Accept-Encoding: identity Apr 21 10:47:48 user devstack@n-api.service[61318]: Connection: close Apr 21 10:47:48 user devstack@n-api.service[61318]: Content-Length: 0 Apr 21 10:47:48 user devstack@n-api.service[61318]: Content-Type: application/json Apr 21 10:47:48 user devstack@n-api.service[61318]: Host: 10.0.0.210 Apr 21 10:47:48 user devstack@n-api.service[61318]: Openstack-System-Scope: None Apr 21 10:47:48 user devstack@n-api.service[61318]: User-Agent: python-urllib3/1.26.15 Apr 21 10:47:48 user devstack@n-api.service[61318]: X-Auth-Token: gAAAAABkQmnTqifCd9iFAqP5A7zLzF8ngozM7KKJGdCZ8_BFLuhni6cJ_HXsm8veEZ48YMG5hJxwpROsg5cqh_PjxCKYsVu3d_Kzdm90tVAnSSX0r2nFtIkVrg4xgHMyGbX0F5pwcoI916gfIKzGkQskT0hi9pGqybhPwMNyRKml4Lk7Fvk2sAk Apr 21 10:47:48 user devstack@n-api.service[61318]: X-Domain-Id: None Apr 21 10:47:48 user devstack@n-api.service[61318]: X-Domain-Name: None Apr 21 10:47:48 user devstack@n-api.service[61318]: X-Identity-Status: Confirmed Apr 21 10:47:48 user devstack@n-api.service[61318]: X-Is-Admin-Project: True Apr 21 10:47:48 user devstack@n-api.service[61318]: X-Project-Domain-Id: default Apr 21 10:47:48 user devstack@n-api.service[61318]: X-Project-Domain-Name: Default Apr 21 10:47:48 user devstack@n-api.service[61318]: X-Project-Id: b17771d455f7488d899e5c099a480920 Apr 21 10:47:48 user devstack@n-api.service[61318]: X-Project-Name: tempest-VolumesNegativeTest-380472319 Apr 21 10:47:48 user devstack@n-api.service[61318]: X-Role: reader,member Apr 21 10:47:48 user devstack@n-api.service[61318]: X-Roles: reader,member Apr 21 10:47:48 user devstack@n-api.service[61318]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b17771d455f7488d899e5c099a480920"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b17771d455f7488d899e5c099a480920"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b17771d455f7488d899e5c099a480920"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 10:47:48 user devstack@n-api.service[61318]: X-Tenant: tempest-VolumesNegativeTest-380472319 Apr 21 10:47:48 user devstack@n-api.service[61318]: X-Tenant-Id: b17771d455f7488d899e5c099a480920 Apr 21 10:47:48 user devstack@n-api.service[61318]: X-Tenant-Name: tempest-VolumesNegativeTest-380472319 Apr 21 10:47:48 user devstack@n-api.service[61318]: X-User: tempest-VolumesNegativeTest-380472319-project-member Apr 21 10:47:48 user devstack@n-api.service[61318]: X-User-Domain-Id: default Apr 21 10:47:48 user devstack@n-api.service[61318]: X-User-Domain-Name: Default Apr 21 10:47:48 user devstack@n-api.service[61318]: X-User-Id: 39ff64e3e10c4290b7bfcee65c796d8d Apr 21 10:47:48 user devstack@n-api.service[61318]: X-User-Name: tempest-VolumesNegativeTest-380472319-project-member Apr 21 10:47:48 user devstack@n-api.service[61318]: method: Apr 21 10:47:48 user devstack@n-api.service[61318]: exception: Volume tempest-invalid-1008252042 could not be found. Apr 21 10:47:48 user devstack@n-api.service[61318]: action_args: {'id': 'tempest-invalid-1008252042'} Apr 21 10:47:48 user devstack@n-api.service[61318]: {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1008252042 could not be found. (HTTP 404) (Request-ID: req-ac582c30-8dbb-4528-8ca0-f95771924919) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1008252042 could not be found. Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1008252042 could not be found. Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1008252042 could not be found. Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:47:48 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-b31de4ee-c4a6-4aa3-9949-7514fa0230cd tempest-VolumesNegativeTest-380472319 tempest-VolumesNegativeTest-380472319-project-member] Returning 404 to user: Volume tempest-invalid-1008252042 could not be found. {{(pid=61318) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 10:47:48 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-b31de4ee-c4a6-4aa3-9949-7514fa0230cd tempest-VolumesNegativeTest-380472319 tempest-VolumesNegativeTest-380472319-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1008252042" status: 404 len: 99 microversion: 2.1 time: 0.069592 Apr 21 10:47:48 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 29/91] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 21 10:47:48 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-1008252042 => generated 99 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 21 10:47:48 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-478c213c-289c-4f41-be43-10e30809f29e tempest-VolumesNegativeTest-380472319 tempest-VolumesNegativeTest-380472319-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004642 Apr 21 10:47:48 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 33/92] 10.0.0.210 () {62 vars in 1217 bytes} [Fri Apr 21 10:47:48 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 21 10:47:48 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-6839854a-cf92-4842-883e-0a7ad7289136 tempest-VolumesNegativeTest-380472319 tempest-VolumesNegativeTest-380472319-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005412 Apr 21 10:47:48 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 31/93] 10.0.0.210 () {62 vars in 1214 bytes} [Fri Apr 21 10:47:48 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Apr 21 10:47:48 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-8d6c5376-6f9b-499c-8993-ef8df4b41958 tempest-VolumesNegativeTest-380472319 tempest-VolumesNegativeTest-380472319-project-member] Calling method '.version_select at 0x7f91a61ed120>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:47:48 user devstack@n-api.service[61318]: INFO nova.api.openstack.wsgi [None req-8d6c5376-6f9b-499c-8993-ef8df4b41958 tempest-VolumesNegativeTest-380472319 tempest-VolumesNegativeTest-380472319-project-member] HTTP exception thrown: Volume e627c3da-75c2-4975-b136-2b2017bd572b could not be found. Apr 21 10:47:48 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-8d6c5376-6f9b-499c-8993-ef8df4b41958 tempest-VolumesNegativeTest-380472319 tempest-VolumesNegativeTest-380472319-project-member] Request method failure captured: Apr 21 10:47:48 user devstack@n-api.service[61318]: request: DELETE /compute/v2.1/os-volumes/e627c3da-75c2-4975-b136-2b2017bd572b HTTP/1.1 Apr 21 10:47:48 user devstack@n-api.service[61318]: Accept: application/json Apr 21 10:47:48 user devstack@n-api.service[61318]: Accept-Encoding: identity Apr 21 10:47:48 user devstack@n-api.service[61318]: Connection: close Apr 21 10:47:48 user devstack@n-api.service[61318]: Content-Length: 0 Apr 21 10:47:48 user devstack@n-api.service[61318]: Content-Type: application/json Apr 21 10:47:48 user devstack@n-api.service[61318]: Host: 10.0.0.210 Apr 21 10:47:48 user devstack@n-api.service[61318]: Openstack-System-Scope: None Apr 21 10:47:48 user devstack@n-api.service[61318]: User-Agent: python-urllib3/1.26.15 Apr 21 10:47:48 user devstack@n-api.service[61318]: X-Auth-Token: gAAAAABkQmnTqifCd9iFAqP5A7zLzF8ngozM7KKJGdCZ8_BFLuhni6cJ_HXsm8veEZ48YMG5hJxwpROsg5cqh_PjxCKYsVu3d_Kzdm90tVAnSSX0r2nFtIkVrg4xgHMyGbX0F5pwcoI916gfIKzGkQskT0hi9pGqybhPwMNyRKml4Lk7Fvk2sAk Apr 21 10:47:48 user devstack@n-api.service[61318]: X-Domain-Id: None Apr 21 10:47:48 user devstack@n-api.service[61318]: X-Domain-Name: None Apr 21 10:47:48 user devstack@n-api.service[61318]: X-Identity-Status: Confirmed Apr 21 10:47:48 user devstack@n-api.service[61318]: X-Is-Admin-Project: True Apr 21 10:47:48 user devstack@n-api.service[61318]: X-Project-Domain-Id: default Apr 21 10:47:48 user devstack@n-api.service[61318]: X-Project-Domain-Name: Default Apr 21 10:47:48 user devstack@n-api.service[61318]: X-Project-Id: b17771d455f7488d899e5c099a480920 Apr 21 10:47:48 user devstack@n-api.service[61318]: X-Project-Name: tempest-VolumesNegativeTest-380472319 Apr 21 10:47:48 user devstack@n-api.service[61318]: X-Role: reader,member Apr 21 10:47:48 user devstack@n-api.service[61318]: X-Roles: reader,member Apr 21 10:47:48 user devstack@n-api.service[61318]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b17771d455f7488d899e5c099a480920"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b17771d455f7488d899e5c099a480920"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b17771d455f7488d899e5c099a480920"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 10:47:48 user devstack@n-api.service[61318]: X-Tenant: tempest-VolumesNegativeTest-380472319 Apr 21 10:47:48 user devstack@n-api.service[61318]: X-Tenant-Id: b17771d455f7488d899e5c099a480920 Apr 21 10:47:48 user devstack@n-api.service[61318]: X-Tenant-Name: tempest-VolumesNegativeTest-380472319 Apr 21 10:47:48 user devstack@n-api.service[61318]: X-User: tempest-VolumesNegativeTest-380472319-project-member Apr 21 10:47:48 user devstack@n-api.service[61318]: X-User-Domain-Id: default Apr 21 10:47:48 user devstack@n-api.service[61318]: X-User-Domain-Name: Default Apr 21 10:47:48 user devstack@n-api.service[61318]: X-User-Id: 39ff64e3e10c4290b7bfcee65c796d8d Apr 21 10:47:48 user devstack@n-api.service[61318]: X-User-Name: tempest-VolumesNegativeTest-380472319-project-member Apr 21 10:47:48 user devstack@n-api.service[61318]: method: Apr 21 10:47:48 user devstack@n-api.service[61318]: exception: Volume e627c3da-75c2-4975-b136-2b2017bd572b could not be found. Apr 21 10:47:48 user devstack@n-api.service[61318]: action_args: {'id': 'e627c3da-75c2-4975-b136-2b2017bd572b'} Apr 21 10:47:48 user devstack@n-api.service[61318]: {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e627c3da-75c2-4975-b136-2b2017bd572b could not be found. (HTTP 404) (Request-ID: req-41c21fa2-d6ab-409b-b524-5f9846972987) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e627c3da-75c2-4975-b136-2b2017bd572b could not be found. Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e627c3da-75c2-4975-b136-2b2017bd572b could not be found. Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e627c3da-75c2-4975-b136-2b2017bd572b could not be found. Apr 21 10:47:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:47:48 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-8d6c5376-6f9b-499c-8993-ef8df4b41958 tempest-VolumesNegativeTest-380472319 tempest-VolumesNegativeTest-380472319-project-member] Returning 404 to user: Volume e627c3da-75c2-4975-b136-2b2017bd572b could not be found. {{(pid=61318) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 10:47:48 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-8d6c5376-6f9b-499c-8993-ef8df4b41958 tempest-VolumesNegativeTest-380472319 tempest-VolumesNegativeTest-380472319-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/e627c3da-75c2-4975-b136-2b2017bd572b" status: 404 len: 109 microversion: 2.1 time: 0.047727 Apr 21 10:47:48 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 30/94] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 21 10:47:48 2023] DELETE /compute/v2.1/os-volumes/e627c3da-75c2-4975-b136-2b2017bd572b => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 10:47:48 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-21805d31-fd63-416e-a36a-378aad1ca192 tempest-VolumesNegativeTest-380472319 tempest-VolumesNegativeTest-380472319-project-member] Calling method '.version_select at 0x7f91a6bce9e0>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:47:48 user devstack@n-api.service[61320]: INFO nova.api.openstack.wsgi [None req-21805d31-fd63-416e-a36a-378aad1ca192 tempest-VolumesNegativeTest-380472319 tempest-VolumesNegativeTest-380472319-project-member] HTTP exception thrown: Volume af6ebb41-a655-4df9-87a5-e3db92919ddf could not be found. Apr 21 10:47:48 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-21805d31-fd63-416e-a36a-378aad1ca192 tempest-VolumesNegativeTest-380472319 tempest-VolumesNegativeTest-380472319-project-member] Request method failure captured: Apr 21 10:47:48 user devstack@n-api.service[61320]: request: GET /compute/v2.1/os-volumes/af6ebb41-a655-4df9-87a5-e3db92919ddf HTTP/1.1 Apr 21 10:47:48 user devstack@n-api.service[61320]: Accept: application/json Apr 21 10:47:48 user devstack@n-api.service[61320]: Accept-Encoding: identity Apr 21 10:47:48 user devstack@n-api.service[61320]: Connection: close Apr 21 10:47:48 user devstack@n-api.service[61320]: Content-Length: 0 Apr 21 10:47:48 user devstack@n-api.service[61320]: Content-Type: application/json Apr 21 10:47:48 user devstack@n-api.service[61320]: Host: 10.0.0.210 Apr 21 10:47:48 user devstack@n-api.service[61320]: Openstack-System-Scope: None Apr 21 10:47:48 user devstack@n-api.service[61320]: User-Agent: python-urllib3/1.26.15 Apr 21 10:47:48 user devstack@n-api.service[61320]: X-Auth-Token: gAAAAABkQmnTqifCd9iFAqP5A7zLzF8ngozM7KKJGdCZ8_BFLuhni6cJ_HXsm8veEZ48YMG5hJxwpROsg5cqh_PjxCKYsVu3d_Kzdm90tVAnSSX0r2nFtIkVrg4xgHMyGbX0F5pwcoI916gfIKzGkQskT0hi9pGqybhPwMNyRKml4Lk7Fvk2sAk Apr 21 10:47:48 user devstack@n-api.service[61320]: X-Domain-Id: None Apr 21 10:47:48 user devstack@n-api.service[61320]: X-Domain-Name: None Apr 21 10:47:48 user devstack@n-api.service[61320]: X-Identity-Status: Confirmed Apr 21 10:47:48 user devstack@n-api.service[61320]: X-Is-Admin-Project: True Apr 21 10:47:48 user devstack@n-api.service[61320]: X-Project-Domain-Id: default Apr 21 10:47:48 user devstack@n-api.service[61320]: X-Project-Domain-Name: Default Apr 21 10:47:48 user devstack@n-api.service[61320]: X-Project-Id: b17771d455f7488d899e5c099a480920 Apr 21 10:47:48 user devstack@n-api.service[61320]: X-Project-Name: tempest-VolumesNegativeTest-380472319 Apr 21 10:47:48 user devstack@n-api.service[61320]: X-Role: reader,member Apr 21 10:47:48 user devstack@n-api.service[61320]: X-Roles: reader,member Apr 21 10:47:48 user devstack@n-api.service[61320]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b17771d455f7488d899e5c099a480920"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b17771d455f7488d899e5c099a480920"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b17771d455f7488d899e5c099a480920"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 10:47:48 user devstack@n-api.service[61320]: X-Tenant: tempest-VolumesNegativeTest-380472319 Apr 21 10:47:48 user devstack@n-api.service[61320]: X-Tenant-Id: b17771d455f7488d899e5c099a480920 Apr 21 10:47:48 user devstack@n-api.service[61320]: X-Tenant-Name: tempest-VolumesNegativeTest-380472319 Apr 21 10:47:48 user devstack@n-api.service[61320]: X-User: tempest-VolumesNegativeTest-380472319-project-member Apr 21 10:47:48 user devstack@n-api.service[61320]: X-User-Domain-Id: default Apr 21 10:47:48 user devstack@n-api.service[61320]: X-User-Domain-Name: Default Apr 21 10:47:48 user devstack@n-api.service[61320]: X-User-Id: 39ff64e3e10c4290b7bfcee65c796d8d Apr 21 10:47:48 user devstack@n-api.service[61320]: X-User-Name: tempest-VolumesNegativeTest-380472319-project-member Apr 21 10:47:48 user devstack@n-api.service[61320]: method: Apr 21 10:47:48 user devstack@n-api.service[61320]: exception: Volume af6ebb41-a655-4df9-87a5-e3db92919ddf could not be found. Apr 21 10:47:48 user devstack@n-api.service[61320]: action_args: {'id': 'af6ebb41-a655-4df9-87a5-e3db92919ddf'} Apr 21 10:47:48 user devstack@n-api.service[61320]: {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume af6ebb41-a655-4df9-87a5-e3db92919ddf could not be found. (HTTP 404) (Request-ID: req-0beea917-7281-4333-840a-7d62ba8db247) Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume af6ebb41-a655-4df9-87a5-e3db92919ddf could not be found. Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume af6ebb41-a655-4df9-87a5-e3db92919ddf could not be found. Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume af6ebb41-a655-4df9-87a5-e3db92919ddf could not be found. Apr 21 10:47:48 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:47:48 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-21805d31-fd63-416e-a36a-378aad1ca192 tempest-VolumesNegativeTest-380472319 tempest-VolumesNegativeTest-380472319-project-member] Returning 404 to user: Volume af6ebb41-a655-4df9-87a5-e3db92919ddf could not be found. {{(pid=61320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 10:47:48 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-21805d31-fd63-416e-a36a-378aad1ca192 tempest-VolumesNegativeTest-380472319 tempest-VolumesNegativeTest-380472319-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/af6ebb41-a655-4df9-87a5-e3db92919ddf" status: 404 len: 109 microversion: 2.1 time: 0.071598 Apr 21 10:47:48 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 34/95] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 21 10:47:48 2023] GET /compute/v2.1/os-volumes/af6ebb41-a655-4df9-87a5-e3db92919ddf => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 10:47:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-807c745e-09d7-433b-bdbf-801df5913df9 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:47:51 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-807c745e-09d7-433b-bdbf-801df5913df9 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] [instance: 84b55fc0-e748-4c05-97ad-a6994c0487d2] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:47:51 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-807c745e-09d7-433b-bdbf-801df5913df9 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:47:51 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-807c745e-09d7-433b-bdbf-801df5913df9 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:47:51 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-807c745e-09d7-433b-bdbf-801df5913df9 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:47:51 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-807c745e-09d7-433b-bdbf-801df5913df9 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:47:51 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-807c745e-09d7-433b-bdbf-801df5913df9 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:47:51 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-807c745e-09d7-433b-bdbf-801df5913df9 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:47:52 user devstack@n-api.service[61319]: DEBUG nova.policy [None req-807c745e-09d7-433b-bdbf-801df5913df9 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c67d90b6014d9ea24ef2552006bc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad84a0e014f47ddaeaddc88bf16b0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61319) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:47:52 user devstack@n-api.service[61319]: DEBUG nova.policy [None req-807c745e-09d7-433b-bdbf-801df5913df9 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c67d90b6014d9ea24ef2552006bc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad84a0e014f47ddaeaddc88bf16b0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61319) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:47:52 user devstack@n-api.service[61319]: DEBUG nova.policy [None req-807c745e-09d7-433b-bdbf-801df5913df9 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c67d90b6014d9ea24ef2552006bc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad84a0e014f47ddaeaddc88bf16b0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61319) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:47:52 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-807c745e-09d7-433b-bdbf-801df5913df9 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84b55fc0-e748-4c05-97ad-a6994c0487d2" status: 200 len: 1690 microversion: 2.87 time: 0.810735 Apr 21 10:47:52 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 32/96] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 10:47:51 2023] GET /compute/v2.1/servers/84b55fc0-e748-4c05-97ad-a6994c0487d2 => generated 1690 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 10:47:58 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=7 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:47:58 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell1:SELECT=10 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:47:58 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-b0ad385b-a3b7-418f-8bc2-0c06dc57749b tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Action: 'create', calling method: .version_select at 0x7f91a61ec160>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-1505495754", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOI+lxaYCiJ6Cakfh0d0/M3EQtNn7ayCKiNgO3J0ChauJCxkwfuH2I2Rjm736o1FW/bz/bZeZnhFBJEXMyBImhjphifTfaav3xqO3xhVAU45T4aDHcFYSZ0q9YF9LVtTWQ=="}} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:47:58 user devstack@n-api.service[61318]: DEBUG nova.quota [None req-b0ad385b-a3b7-418f-8bc2-0c06dc57749b tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Getting quotas for project 52aece0e34a3451da50638e2930424e7. Resources: {'key_pairs'} {{(pid=61318) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 10:47:58 user devstack@n-api.service[61318]: DEBUG nova.quota [None req-b0ad385b-a3b7-418f-8bc2-0c06dc57749b tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Getting quotas for user 0d7234a4dcce4289a84f5060f546efb6 and project 52aece0e34a3451da50638e2930424e7. Resources: {'key_pairs'} {{(pid=61318) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 10:47:58 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-b0ad385b-a3b7-418f-8bc2-0c06dc57749b tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.287050 Apr 21 10:47:58 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 31/97] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 21 10:47:58 2023] POST /compute/v2.1/os-keypairs => generated 405 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:48:01 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_api:SELECT=7 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:48:01 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell1:SELECT=1 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:48:01 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-1eec999c-a5bd-438a-ba6d-170d6fd47370 tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-1967603297", "imageRef": "3b29a01a-1fc0-4d0d-89fb-23d22b2de02e", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-1505495754", "security_groups": [{"name": "tempest-secgroup-smoke-719375638"}], "networks": [{"uuid": "624bf70c-30f1-41f5-b380-69af8cfb5fd6"}]}} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:48:01 user devstack@n-api.service[61320]: DEBUG nova.network.neutron [None req-1eec999c-a5bd-438a-ba6d-170d6fd47370 tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] validate_networks() for [('624bf70c-30f1-41f5-b380-69af8cfb5fd6', None, None, None, None, None)] {{(pid=61320) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 10:48:02 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-1eec999c-a5bd-438a-ba6d-170d6fd47370 tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Flavor limits 0:0:0 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 10:48:02 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-1eec999c-a5bd-438a-ba6d-170d6fd47370 tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Image limits 0:0:0 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 10:48:02 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-1eec999c-a5bd-438a-ba6d-170d6fd47370 tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Flavor pref 0:0:0 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 10:48:02 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-1eec999c-a5bd-438a-ba6d-170d6fd47370 tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Image pref 0:0:0 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 10:48:02 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-1eec999c-a5bd-438a-ba6d-170d6fd47370 tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 10:48:02 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-1eec999c-a5bd-438a-ba6d-170d6fd47370 tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:48:02 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-1eec999c-a5bd-438a-ba6d-170d6fd47370 tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:48:02 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-1eec999c-a5bd-438a-ba6d-170d6fd47370 tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:48:02 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-1eec999c-a5bd-438a-ba6d-170d6fd47370 tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:48:02 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-1eec999c-a5bd-438a-ba6d-170d6fd47370 tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:48:02 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-1eec999c-a5bd-438a-ba6d-170d6fd47370 tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:48:02 user devstack@n-api.service[61320]: DEBUG nova.quota [None req-1eec999c-a5bd-438a-ba6d-170d6fd47370 tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Getting quotas for project 52aece0e34a3451da50638e2930424e7. Resources: {'cores', 'instances', 'ram'} {{(pid=61320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 10:48:02 user devstack@n-api.service[61320]: DEBUG nova.quota [None req-1eec999c-a5bd-438a-ba6d-170d6fd47370 tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Getting quotas for user 0d7234a4dcce4289a84f5060f546efb6 and project 52aece0e34a3451da50638e2930424e7. Resources: {'cores', 'instances', 'ram'} {{(pid=61320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 10:48:02 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-1eec999c-a5bd-438a-ba6d-170d6fd47370 tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Going to run 1 instances... {{(pid=61320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 10:48:02 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-1eec999c-a5bd-438a-ba6d-170d6fd47370 tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] [instance: c3100b42-46b3-4371-89f2-e511ca1ce6cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3b29a01a-1fc0-4d0d-89fb-23d22b2de02e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 10:48:02 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-1eec999c-a5bd-438a-ba6d-170d6fd47370 tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.066216 Apr 21 10:48:02 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 35/98] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 10:48:01 2023] POST /compute/v2.1/servers => generated 403 bytes in 1068 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 10:48:02 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-1b0cb6c7-73d9-4e77-a4ba-f3698c4162fb tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:48:02 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-1b0cb6c7-73d9-4e77-a4ba-f3698c4162fb tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] [instance: c3100b42-46b3-4371-89f2-e511ca1ce6cd] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:48:02 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell1:SELECT=9 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:48:02 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_api:SELECT=7 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:48:02 user devstack@n-api.service[61319]: DEBUG nova.policy [None req-1b0cb6c7-73d9-4e77-a4ba-f3698c4162fb tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7234a4dcce4289a84f5060f546efb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aece0e34a3451da50638e2930424e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61319) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:48:02 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-1b0cb6c7-73d9-4e77-a4ba-f3698c4162fb tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c3100b42-46b3-4371-89f2-e511ca1ce6cd" status: 200 len: 1257 microversion: 2.1 time: 0.110777 Apr 21 10:48:02 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 33/99] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:48:02 2023] GET /compute/v2.1/servers/c3100b42-46b3-4371-89f2-e511ca1ce6cd => generated 1257 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:48:03 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-0952021d-3b66-4c83-b3cb-3aab3e82ef45 tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:48:03 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-0952021d-3b66-4c83-b3cb-3aab3e82ef45 tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] [instance: dd34ae7e-dcf2-4bb2-8ea3-0a3ee553efd8] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:48:03 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-0952021d-3b66-4c83-b3cb-3aab3e82ef45 tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:48:03 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-0952021d-3b66-4c83-b3cb-3aab3e82ef45 tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:48:03 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-0952021d-3b66-4c83-b3cb-3aab3e82ef45 tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:48:03 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-0952021d-3b66-4c83-b3cb-3aab3e82ef45 tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:48:03 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-0952021d-3b66-4c83-b3cb-3aab3e82ef45 tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:48:03 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-0952021d-3b66-4c83-b3cb-3aab3e82ef45 tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:48:04 user devstack@n-api.service[61318]: DEBUG nova.policy [None req-0952021d-3b66-4c83-b3cb-3aab3e82ef45 tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7625e4107240d5a92379ace66052fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12ec80f50254e5bbc5afd5470546c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61318) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:48:04 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-0952021d-3b66-4c83-b3cb-3aab3e82ef45 tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dd34ae7e-dcf2-4bb2-8ea3-0a3ee553efd8" status: 200 len: 1490 microversion: 2.1 time: 0.425018 Apr 21 10:48:04 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 32/100] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:48:03 2023] GET /compute/v2.1/servers/dd34ae7e-dcf2-4bb2-8ea3-0a3ee553efd8 => generated 1490 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:48:05 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-033492ff-3047-49b2-9bdf-738703d8f2e3 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:48:05 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-033492ff-3047-49b2-9bdf-738703d8f2e3 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] [instance: f8609da3-c26d-482a-bc03-017baf4bce22] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:48:05 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-033492ff-3047-49b2-9bdf-738703d8f2e3 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:48:05 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-033492ff-3047-49b2-9bdf-738703d8f2e3 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:48:05 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-033492ff-3047-49b2-9bdf-738703d8f2e3 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:48:05 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-033492ff-3047-49b2-9bdf-738703d8f2e3 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:48:05 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-033492ff-3047-49b2-9bdf-738703d8f2e3 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:48:05 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-033492ff-3047-49b2-9bdf-738703d8f2e3 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:48:05 user devstack@n-api.service[61320]: DEBUG nova.policy [None req-033492ff-3047-49b2-9bdf-738703d8f2e3 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced216baa4a64c72946cf3f71eb873dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648163a728fc4b28b85a24e9198d356b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61320) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:48:05 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-033492ff-3047-49b2-9bdf-738703d8f2e3 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8609da3-c26d-482a-bc03-017baf4bce22" status: 200 len: 1538 microversion: 2.1 time: 0.475020 Apr 21 10:48:05 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 36/101] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:48:05 2023] GET /compute/v2.1/servers/f8609da3-c26d-482a-bc03-017baf4bce22 => generated 1538 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:48:06 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-f07c9b91-9d61-42f9-9430-847c77d5b3ef req-2c6bd6e5-2fdf-4acb-bcfe-0e9f17ca7f7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3100b42-46b3-4371-89f2-e511ca1ce6cd", "tag": "be8924d4-464a-4572-8b2f-96b2f230297f"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:48:06 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-f07c9b91-9d61-42f9-9430-847c77d5b3ef req-2c6bd6e5-2fdf-4acb-bcfe-0e9f17ca7f7c service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:48:06 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-f07c9b91-9d61-42f9-9430-847c77d5b3ef req-2c6bd6e5-2fdf-4acb-bcfe-0e9f17ca7f7c service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:48:06 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-f07c9b91-9d61-42f9-9430-847c77d5b3ef req-2c6bd6e5-2fdf-4acb-bcfe-0e9f17ca7f7c service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:48:06 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-f07c9b91-9d61-42f9-9430-847c77d5b3ef req-2c6bd6e5-2fdf-4acb-bcfe-0e9f17ca7f7c service nova] Creating event network-changed:be8924d4-464a-4572-8b2f-96b2f230297f for instance c3100b42-46b3-4371-89f2-e511ca1ce6cd on user Apr 21 10:48:06 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-f07c9b91-9d61-42f9-9430-847c77d5b3ef req-2c6bd6e5-2fdf-4acb-bcfe-0e9f17ca7f7c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032339 Apr 21 10:48:06 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 34/102] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:48:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 10:48:08 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [req-93c3ddf9-daff-4e0a-916d-bc6cf30f1fe4 req-5cb1dc16-1f57-4c83-ac93-af894a4ac9cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3100b42-46b3-4371-89f2-e511ca1ce6cd", "name": "network-vif-plugged", "status": "completed", "tag": "be8924d4-464a-4572-8b2f-96b2f230297f"}]} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:48:08 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-93c3ddf9-daff-4e0a-916d-bc6cf30f1fe4 req-5cb1dc16-1f57-4c83-ac93-af894a4ac9cb service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:48:08 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-93c3ddf9-daff-4e0a-916d-bc6cf30f1fe4 req-5cb1dc16-1f57-4c83-ac93-af894a4ac9cb service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:48:08 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-93c3ddf9-daff-4e0a-916d-bc6cf30f1fe4 req-5cb1dc16-1f57-4c83-ac93-af894a4ac9cb service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:48:08 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-93c3ddf9-daff-4e0a-916d-bc6cf30f1fe4 req-5cb1dc16-1f57-4c83-ac93-af894a4ac9cb service nova] Creating event network-vif-plugged:be8924d4-464a-4572-8b2f-96b2f230297f for instance c3100b42-46b3-4371-89f2-e511ca1ce6cd on user Apr 21 10:48:08 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [req-93c3ddf9-daff-4e0a-916d-bc6cf30f1fe4 req-5cb1dc16-1f57-4c83-ac93-af894a4ac9cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052895 Apr 21 10:48:08 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 33/103] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:48:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:48:09 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-655bce27-3408-4b8e-9af9-cf5b37dec53b tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:48:09 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-655bce27-3408-4b8e-9af9-cf5b37dec53b tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] [instance: 15bf9321-a92e-4be2-bcae-a943988c811a] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:48:09 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-655bce27-3408-4b8e-9af9-cf5b37dec53b tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:48:09 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-655bce27-3408-4b8e-9af9-cf5b37dec53b tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:48:09 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-655bce27-3408-4b8e-9af9-cf5b37dec53b tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:48:09 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-655bce27-3408-4b8e-9af9-cf5b37dec53b tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:48:09 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-655bce27-3408-4b8e-9af9-cf5b37dec53b tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:48:09 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-655bce27-3408-4b8e-9af9-cf5b37dec53b tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:48:09 user devstack@n-api.service[61320]: DEBUG nova.policy [None req-655bce27-3408-4b8e-9af9-cf5b37dec53b tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd172d648a9474db082646a47a2840214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdd7a4ccfc340aa9c1b02c57f7a0e70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61320) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:48:09 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-655bce27-3408-4b8e-9af9-cf5b37dec53b tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15bf9321-a92e-4be2-bcae-a943988c811a" status: 200 len: 1552 microversion: 2.1 time: 0.391154 Apr 21 10:48:09 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 37/104] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:48:09 2023] GET /compute/v2.1/servers/15bf9321-a92e-4be2-bcae-a943988c811a => generated 1552 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:48:10 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-a4f52280-fd9e-403e-92e2-f06e4943695f tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:48:10 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-a4f52280-fd9e-403e-92e2-f06e4943695f tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] [instance: dd4d15a1-3a71-49e8-9851-9b49fec6a9e3] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:48:10 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-a4f52280-fd9e-403e-92e2-f06e4943695f tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:48:10 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-a4f52280-fd9e-403e-92e2-f06e4943695f tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:48:10 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-a4f52280-fd9e-403e-92e2-f06e4943695f tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:48:10 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-a4f52280-fd9e-403e-92e2-f06e4943695f tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:48:10 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-a4f52280-fd9e-403e-92e2-f06e4943695f tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:48:10 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-a4f52280-fd9e-403e-92e2-f06e4943695f tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:48:10 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [req-131f19ae-9241-4ce4-b881-b81ffffe89b9 req-32a91e1d-6cb7-40cf-b689-06e8f79d7f8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3100b42-46b3-4371-89f2-e511ca1ce6cd", "name": "network-vif-plugged", "status": "completed", "tag": "be8924d4-464a-4572-8b2f-96b2f230297f"}]} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:48:10 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell0:SELECT=4 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:48:10 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-131f19ae-9241-4ce4-b881-b81ffffe89b9 req-32a91e1d-6cb7-40cf-b689-06e8f79d7f8d service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:48:10 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-131f19ae-9241-4ce4-b881-b81ffffe89b9 req-32a91e1d-6cb7-40cf-b689-06e8f79d7f8d service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:48:10 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-131f19ae-9241-4ce4-b881-b81ffffe89b9 req-32a91e1d-6cb7-40cf-b689-06e8f79d7f8d service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:48:10 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-131f19ae-9241-4ce4-b881-b81ffffe89b9 req-32a91e1d-6cb7-40cf-b689-06e8f79d7f8d service nova] Creating event network-vif-plugged:be8924d4-464a-4572-8b2f-96b2f230297f for instance c3100b42-46b3-4371-89f2-e511ca1ce6cd on user Apr 21 10:48:10 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [req-131f19ae-9241-4ce4-b881-b81ffffe89b9 req-32a91e1d-6cb7-40cf-b689-06e8f79d7f8d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040202 Apr 21 10:48:10 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 34/105] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:48:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:48:10 user devstack@n-api.service[61319]: DEBUG nova.policy [None req-a4f52280-fd9e-403e-92e2-f06e4943695f tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fb0d890b594080bb1bb99dd6294ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd85f51547e5244e495343281725fe320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61319) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:48:10 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-a4f52280-fd9e-403e-92e2-f06e4943695f tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dd4d15a1-3a71-49e8-9851-9b49fec6a9e3" status: 200 len: 1536 microversion: 2.1 time: 0.263300 Apr 21 10:48:10 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 35/106] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:48:10 2023] GET /compute/v2.1/servers/dd4d15a1-3a71-49e8-9851-9b49fec6a9e3 => generated 1536 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:48:16 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-b756572d-9ed4-4ec3-b892-840994eec26d tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:48:16 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-b756572d-9ed4-4ec3-b892-840994eec26d tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] [instance: aecf1ba8-9675-4535-874b-9084361b7693] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:48:16 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell0:SELECT=2 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:48:16 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell0:SELECT=6 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:48:16 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-b756572d-9ed4-4ec3-b892-840994eec26d tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:48:16 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-b756572d-9ed4-4ec3-b892-840994eec26d tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:48:16 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-b756572d-9ed4-4ec3-b892-840994eec26d tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:48:16 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-b756572d-9ed4-4ec3-b892-840994eec26d tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:48:16 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-b756572d-9ed4-4ec3-b892-840994eec26d tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:48:16 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-b756572d-9ed4-4ec3-b892-840994eec26d tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:48:17 user devstack@n-api.service[61320]: DEBUG nova.policy [None req-b756572d-9ed4-4ec3-b892-840994eec26d tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b1fae0fc8d4b9a998ab0679bace1a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d2c4f2fb9f45559c4e51e86339a0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61320) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:48:17 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-b756572d-9ed4-4ec3-b892-840994eec26d tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aecf1ba8-9675-4535-874b-9084361b7693" status: 200 len: 1548 microversion: 2.1 time: 0.739785 Apr 21 10:48:17 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 38/107] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:48:16 2023] GET /compute/v2.1/servers/aecf1ba8-9675-4535-874b-9084361b7693 => generated 1548 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:48:22 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:48:22 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell1:SELECT=10 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:48:22 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-97f54c0c-0cf6-4436-9867-8e3dd9c0175e tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:48:22 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-97f54c0c-0cf6-4436-9867-8e3dd9c0175e tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] [instance: 8ae797bd-c587-43a3-b941-e6d6d6c74e51] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:48:22 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-97f54c0c-0cf6-4436-9867-8e3dd9c0175e tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:48:23 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-97f54c0c-0cf6-4436-9867-8e3dd9c0175e tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:48:23 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-97f54c0c-0cf6-4436-9867-8e3dd9c0175e tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:48:23 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-97f54c0c-0cf6-4436-9867-8e3dd9c0175e tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:48:23 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-97f54c0c-0cf6-4436-9867-8e3dd9c0175e tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:48:23 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-97f54c0c-0cf6-4436-9867-8e3dd9c0175e tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:48:23 user devstack@n-api.service[61318]: DEBUG nova.policy [None req-97f54c0c-0cf6-4436-9867-8e3dd9c0175e tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c600e01acfe140cabcdfe54958e66108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e77e1735854e0c966c42e9a613017f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61318) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:48:23 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-97f54c0c-0cf6-4436-9867-8e3dd9c0175e tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8ae797bd-c587-43a3-b941-e6d6d6c74e51" status: 200 len: 1545 microversion: 2.1 time: 0.243007 Apr 21 10:48:23 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 35/108] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:48:22 2023] GET /compute/v2.1/servers/8ae797bd-c587-43a3-b941-e6d6d6c74e51 => generated 1545 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:48:26 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell0:SELECT=2 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:48:26 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_api:SELECT=8 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:48:26 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell1:SELECT=8 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:48:26 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-171f8fad-5edb-4ca5-b52f-8e4aac1f895b tempest-TestStampPattern-1159477670 tempest-TestStampPattern-1159477670-project-member] Action: 'create', calling method: .version_select at 0x7f91a6067400>, body: {"keypair": {"name": "tempest-TestStampPattern-285148942", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCq5u7B7UGuorFeQsXHhz4qqyy67tQpolyWQnxLkloz+1Rt6/Bu5ZGbapL+VoIZ8dRD6Hvj3oK3ThIlaub5EqzCemXFwDzABbAUwBGJiwwf9Vq018TtMEMPhHpLRlfEiQ=="}} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:48:26 user devstack@n-api.service[61319]: DEBUG nova.quota [None req-171f8fad-5edb-4ca5-b52f-8e4aac1f895b tempest-TestStampPattern-1159477670 tempest-TestStampPattern-1159477670-project-member] Getting quotas for project ff958a7a6e294a2494126c5b07fc1324. Resources: {'key_pairs'} {{(pid=61319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 10:48:27 user devstack@n-api.service[61319]: DEBUG nova.quota [None req-171f8fad-5edb-4ca5-b52f-8e4aac1f895b tempest-TestStampPattern-1159477670 tempest-TestStampPattern-1159477670-project-member] Getting quotas for user 8b50e165f9d54ba0aaa88ba7442049f4 and project ff958a7a6e294a2494126c5b07fc1324. Resources: {'key_pairs'} {{(pid=61319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 10:48:27 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-171f8fad-5edb-4ca5-b52f-8e4aac1f895b tempest-TestStampPattern-1159477670 tempest-TestStampPattern-1159477670-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 394 microversion: 2.1 time: 0.440390 Apr 21 10:48:27 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 36/109] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 21 10:48:26 2023] POST /compute/v2.1/os-keypairs => generated 394 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:48:29 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-88aeeee8-ff7a-4d97-9492-5cfe3a825f33 tempest-TestStampPattern-1159477670 tempest-TestStampPattern-1159477670-project-member] Calling method '.version_select at 0x7f91a69cd090>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:48:29 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:48:29 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell1:SELECT=20 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:48:29 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-88aeeee8-ff7a-4d97-9492-5cfe3a825f33 tempest-TestStampPattern-1159477670 tempest-TestStampPattern-1159477670-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-285148942" status: 202 len: 0 microversion: 2.1 time: 0.026477 Apr 21 10:48:29 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 39/110] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 21 10:48:29 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-285148942 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 10:48:52 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-9766eae8-9767-4d6e-a4c3-df3d5361d124 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-793476704"}} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:48:52 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-9766eae8-9767-4d6e-a4c3-df3d5361d124 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] [instance: 84b55fc0-e748-4c05-97ad-a6994c0487d2] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:48:52 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_api:SELECT=2 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:48:52 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell1:SELECT=6 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:48:52 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-9766eae8-9767-4d6e-a4c3-df3d5361d124 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:48:52 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-9766eae8-9767-4d6e-a4c3-df3d5361d124 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:48:52 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-9766eae8-9767-4d6e-a4c3-df3d5361d124 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:48:52 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-9766eae8-9767-4d6e-a4c3-df3d5361d124 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:48:52 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-9766eae8-9767-4d6e-a4c3-df3d5361d124 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:48:52 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-9766eae8-9767-4d6e-a4c3-df3d5361d124 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:48:52 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell0:SELECT=4 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:48:52 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:48:52 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-af4912c9-2cf5-461f-8eaa-2178003bd0dc tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:48:52 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-af4912c9-2cf5-461f-8eaa-2178003bd0dc tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] [instance: c3100b42-46b3-4371-89f2-e511ca1ce6cd] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:48:52 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-af4912c9-2cf5-461f-8eaa-2178003bd0dc tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:48:52 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-af4912c9-2cf5-461f-8eaa-2178003bd0dc tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:48:52 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-af4912c9-2cf5-461f-8eaa-2178003bd0dc tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:48:52 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-af4912c9-2cf5-461f-8eaa-2178003bd0dc tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:48:52 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-af4912c9-2cf5-461f-8eaa-2178003bd0dc tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:48:52 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-af4912c9-2cf5-461f-8eaa-2178003bd0dc tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:48:52 user devstack@n-api.service[61319]: DEBUG nova.policy [None req-af4912c9-2cf5-461f-8eaa-2178003bd0dc tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7234a4dcce4289a84f5060f546efb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aece0e34a3451da50638e2930424e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61319) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:48:52 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-af4912c9-2cf5-461f-8eaa-2178003bd0dc tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c3100b42-46b3-4371-89f2-e511ca1ce6cd" status: 200 len: 1567 microversion: 2.1 time: 0.349931 Apr 21 10:48:52 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 37/111] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:48:52 2023] GET /compute/v2.1/servers/c3100b42-46b3-4371-89f2-e511ca1ce6cd => generated 1567 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:48:53 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-9766eae8-9767-4d6e-a4c3-df3d5361d124 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] 10.0.0.210 "POST /compute/v2.1/servers/84b55fc0-e748-4c05-97ad-a6994c0487d2/action" status: 202 len: 52 microversion: 2.87 time: 1.139272 Apr 21 10:48:53 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 36/112] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 21 10:48:52 2023] POST /compute/v2.1/servers/84b55fc0-e748-4c05-97ad-a6994c0487d2/action => generated 52 bytes in 1144 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 21 10:48:59 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:48:59 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-795de143-f20d-4bac-bdd1-0a5769d8bab0 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:48:59 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-795de143-f20d-4bac-bdd1-0a5769d8bab0 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] [instance: 84b55fc0-e748-4c05-97ad-a6994c0487d2] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:48:59 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-795de143-f20d-4bac-bdd1-0a5769d8bab0 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:48:59 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-795de143-f20d-4bac-bdd1-0a5769d8bab0 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:48:59 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-795de143-f20d-4bac-bdd1-0a5769d8bab0 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:48:59 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-795de143-f20d-4bac-bdd1-0a5769d8bab0 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:48:59 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-795de143-f20d-4bac-bdd1-0a5769d8bab0 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:48:59 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-795de143-f20d-4bac-bdd1-0a5769d8bab0 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:48:59 user devstack@n-api.service[61320]: DEBUG nova.policy [None req-795de143-f20d-4bac-bdd1-0a5769d8bab0 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c67d90b6014d9ea24ef2552006bc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad84a0e014f47ddaeaddc88bf16b0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61320) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:48:59 user devstack@n-api.service[61320]: DEBUG nova.policy [None req-795de143-f20d-4bac-bdd1-0a5769d8bab0 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c67d90b6014d9ea24ef2552006bc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad84a0e014f47ddaeaddc88bf16b0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61320) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:48:59 user devstack@n-api.service[61320]: DEBUG nova.policy [None req-795de143-f20d-4bac-bdd1-0a5769d8bab0 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c67d90b6014d9ea24ef2552006bc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad84a0e014f47ddaeaddc88bf16b0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61320) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:48:59 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-795de143-f20d-4bac-bdd1-0a5769d8bab0 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84b55fc0-e748-4c05-97ad-a6994c0487d2" status: 200 len: 1690 microversion: 2.87 time: 0.335419 Apr 21 10:48:59 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 40/113] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 10:48:59 2023] GET /compute/v2.1/servers/84b55fc0-e748-4c05-97ad-a6994c0487d2 => generated 1690 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 10:49:05 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-066dc04f-b23d-46a0-a04c-dc1664ca24de tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:49:05 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-066dc04f-b23d-46a0-a04c-dc1664ca24de tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] [instance: dd34ae7e-dcf2-4bb2-8ea3-0a3ee553efd8] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:49:05 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_api:SELECT=2 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:49:05 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell1:SELECT=6 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:49:05 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-066dc04f-b23d-46a0-a04c-dc1664ca24de tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:05 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-066dc04f-b23d-46a0-a04c-dc1664ca24de tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:05 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-066dc04f-b23d-46a0-a04c-dc1664ca24de tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:05 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-066dc04f-b23d-46a0-a04c-dc1664ca24de tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:05 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-066dc04f-b23d-46a0-a04c-dc1664ca24de tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:05 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-066dc04f-b23d-46a0-a04c-dc1664ca24de tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:05 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-066dc04f-b23d-46a0-a04c-dc1664ca24de tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] [instance: dd34ae7e-dcf2-4bb2-8ea3-0a3ee553efd8] Going to try to terminate instance {{(pid=61319) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 10:49:05 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-066dc04f-b23d-46a0-a04c-dc1664ca24de tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dd34ae7e-dcf2-4bb2-8ea3-0a3ee553efd8" status: 204 len: 0 microversion: 2.1 time: 0.162395 Apr 21 10:49:05 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 38/114] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 10:49:05 2023] DELETE /compute/v2.1/servers/dd34ae7e-dcf2-4bb2-8ea3-0a3ee553efd8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 10:49:05 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_api:SELECT=2 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:49:05 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:49:05 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-1bff6fee-3f0c-4b2e-96e9-68e7d045971f tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:49:05 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-1bff6fee-3f0c-4b2e-96e9-68e7d045971f tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] [instance: dd34ae7e-dcf2-4bb2-8ea3-0a3ee553efd8] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:49:06 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-a5d687b1-add2-4389-8572-caac1b0c650e tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:49:06 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-a5d687b1-add2-4389-8572-caac1b0c650e tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] [instance: f8609da3-c26d-482a-bc03-017baf4bce22] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:49:06 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-a5d687b1-add2-4389-8572-caac1b0c650e tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:06 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-a5d687b1-add2-4389-8572-caac1b0c650e tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:06 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-a5d687b1-add2-4389-8572-caac1b0c650e tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:06 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-a5d687b1-add2-4389-8572-caac1b0c650e tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:06 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-a5d687b1-add2-4389-8572-caac1b0c650e tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:06 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-a5d687b1-add2-4389-8572-caac1b0c650e tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:06 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-8358e0ea-2ace-4549-88a3-3fe4a5c37377 req-a35f1cb8-443e-4eec-aff9-58a00b3eca70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd34ae7e-dcf2-4bb2-8ea3-0a3ee553efd8", "name": "network-vif-unplugged", "status": "completed", "tag": "781dee4b-a8ca-4469-aa8c-a2c3c1bd21b3"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:49:06 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-8358e0ea-2ace-4549-88a3-3fe4a5c37377 req-a35f1cb8-443e-4eec-aff9-58a00b3eca70 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:06 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-8358e0ea-2ace-4549-88a3-3fe4a5c37377 req-a35f1cb8-443e-4eec-aff9-58a00b3eca70 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:06 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-8358e0ea-2ace-4549-88a3-3fe4a5c37377 req-a35f1cb8-443e-4eec-aff9-58a00b3eca70 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:06 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-8358e0ea-2ace-4549-88a3-3fe4a5c37377 req-a35f1cb8-443e-4eec-aff9-58a00b3eca70 service nova] Creating event network-vif-unplugged:781dee4b-a8ca-4469-aa8c-a2c3c1bd21b3 for instance dd34ae7e-dcf2-4bb2-8ea3-0a3ee553efd8 on user Apr 21 10:49:06 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-8358e0ea-2ace-4549-88a3-3fe4a5c37377 req-a35f1cb8-443e-4eec-aff9-58a00b3eca70 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031900 Apr 21 10:49:06 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 39/115] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:49:06 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:49:06 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-1bff6fee-3f0c-4b2e-96e9-68e7d045971f tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:06 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-1bff6fee-3f0c-4b2e-96e9-68e7d045971f tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:06 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-1bff6fee-3f0c-4b2e-96e9-68e7d045971f tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:06 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-1bff6fee-3f0c-4b2e-96e9-68e7d045971f tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:06 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-1bff6fee-3f0c-4b2e-96e9-68e7d045971f tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:06 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-1bff6fee-3f0c-4b2e-96e9-68e7d045971f tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:06 user devstack@n-api.service[61318]: DEBUG nova.policy [None req-1bff6fee-3f0c-4b2e-96e9-68e7d045971f tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7625e4107240d5a92379ace66052fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12ec80f50254e5bbc5afd5470546c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61318) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:49:06 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-1bff6fee-3f0c-4b2e-96e9-68e7d045971f tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dd34ae7e-dcf2-4bb2-8ea3-0a3ee553efd8" status: 200 len: 1496 microversion: 2.1 time: 0.626244 Apr 21 10:49:06 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 37/116] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:49:05 2023] GET /compute/v2.1/servers/dd34ae7e-dcf2-4bb2-8ea3-0a3ee553efd8 => generated 1496 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:49:06 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-a5d687b1-add2-4389-8572-caac1b0c650e tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8609da3-c26d-482a-bc03-017baf4bce22/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.624044 Apr 21 10:49:06 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 41/117] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 21 10:49:06 2023] GET /compute/v2.1/servers/f8609da3-c26d-482a-bc03-017baf4bce22/os-interface => generated 282 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:49:07 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-e5466b4e-2656-49aa-813d-fe92be761b5e req-e5134d6b-1973-474a-b226-7dfe8fe509c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd34ae7e-dcf2-4bb2-8ea3-0a3ee553efd8", "name": "network-vif-deleted", "tag": "781dee4b-a8ca-4469-aa8c-a2c3c1bd21b3"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:49:07 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-e5466b4e-2656-49aa-813d-fe92be761b5e req-e5134d6b-1973-474a-b226-7dfe8fe509c8 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:07 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-e5466b4e-2656-49aa-813d-fe92be761b5e req-e5134d6b-1973-474a-b226-7dfe8fe509c8 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:07 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-e5466b4e-2656-49aa-813d-fe92be761b5e req-e5134d6b-1973-474a-b226-7dfe8fe509c8 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:07 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-e5466b4e-2656-49aa-813d-fe92be761b5e req-e5134d6b-1973-474a-b226-7dfe8fe509c8 service nova] Creating event network-vif-deleted:781dee4b-a8ca-4469-aa8c-a2c3c1bd21b3 for instance dd34ae7e-dcf2-4bb2-8ea3-0a3ee553efd8 on user Apr 21 10:49:07 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-e5466b4e-2656-49aa-813d-fe92be761b5e req-e5134d6b-1973-474a-b226-7dfe8fe509c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033166 Apr 21 10:49:07 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 40/118] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:49:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:49:08 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [req-3eaee887-5d95-4001-ae9a-6286f77a7b79 req-c2c82a93-81b1-4e31-a087-a7e01852df26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8609da3-c26d-482a-bc03-017baf4bce22", "tag": "f210779b-302b-4a17-8b57-07837ea54e12"}]} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:49:08 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-3eaee887-5d95-4001-ae9a-6286f77a7b79 req-c2c82a93-81b1-4e31-a087-a7e01852df26 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:08 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-3eaee887-5d95-4001-ae9a-6286f77a7b79 req-c2c82a93-81b1-4e31-a087-a7e01852df26 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:08 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-3eaee887-5d95-4001-ae9a-6286f77a7b79 req-c2c82a93-81b1-4e31-a087-a7e01852df26 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:08 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-3eaee887-5d95-4001-ae9a-6286f77a7b79 req-c2c82a93-81b1-4e31-a087-a7e01852df26 service nova] Creating event network-changed:f210779b-302b-4a17-8b57-07837ea54e12 for instance f8609da3-c26d-482a-bc03-017baf4bce22 on user Apr 21 10:49:08 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [req-3eaee887-5d95-4001-ae9a-6286f77a7b79 req-c2c82a93-81b1-4e31-a087-a7e01852df26 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033066 Apr 21 10:49:08 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 38/119] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:49:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:49:08 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-1a131378-c231-4399-b9d8-681059761635 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:49:08 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-1a131378-c231-4399-b9d8-681059761635 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] [instance: f8609da3-c26d-482a-bc03-017baf4bce22] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:49:08 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-1a131378-c231-4399-b9d8-681059761635 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:08 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-1a131378-c231-4399-b9d8-681059761635 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:08 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-1a131378-c231-4399-b9d8-681059761635 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:08 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-1a131378-c231-4399-b9d8-681059761635 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:08 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-1a131378-c231-4399-b9d8-681059761635 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:08 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-1a131378-c231-4399-b9d8-681059761635 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:08 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-b4ad13d5-bb0a-4ab6-8493-7f5cddb58081 req-d036aa55-1292-4ea3-92c1-dccdc95c6521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd34ae7e-dcf2-4bb2-8ea3-0a3ee553efd8", "name": "network-vif-plugged", "status": "completed", "tag": "781dee4b-a8ca-4469-aa8c-a2c3c1bd21b3"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:49:08 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-b4ad13d5-bb0a-4ab6-8493-7f5cddb58081 req-d036aa55-1292-4ea3-92c1-dccdc95c6521 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:08 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-b4ad13d5-bb0a-4ab6-8493-7f5cddb58081 req-d036aa55-1292-4ea3-92c1-dccdc95c6521 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:08 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-b4ad13d5-bb0a-4ab6-8493-7f5cddb58081 req-d036aa55-1292-4ea3-92c1-dccdc95c6521 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:08 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-b4ad13d5-bb0a-4ab6-8493-7f5cddb58081 req-d036aa55-1292-4ea3-92c1-dccdc95c6521 service nova] Creating event network-vif-plugged:781dee4b-a8ca-4469-aa8c-a2c3c1bd21b3 for instance dd34ae7e-dcf2-4bb2-8ea3-0a3ee553efd8 on user Apr 21 10:49:08 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-b4ad13d5-bb0a-4ab6-8493-7f5cddb58081 req-d036aa55-1292-4ea3-92c1-dccdc95c6521 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038130 Apr 21 10:49:08 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 41/120] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:49:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:49:08 user devstack@n-api.service[61320]: DEBUG nova.policy [None req-1a131378-c231-4399-b9d8-681059761635 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced216baa4a64c72946cf3f71eb873dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648163a728fc4b28b85a24e9198d356b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61320) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:49:08 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-1a131378-c231-4399-b9d8-681059761635 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8609da3-c26d-482a-bc03-017baf4bce22" status: 200 len: 1538 microversion: 2.1 time: 0.228405 Apr 21 10:49:08 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 42/121] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:49:08 2023] GET /compute/v2.1/servers/f8609da3-c26d-482a-bc03-017baf4bce22 => generated 1538 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:49:08 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-2cf62297-cd61-4290-b413-addccd99ef43 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:49:08 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-2cf62297-cd61-4290-b413-addccd99ef43 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] [instance: f8609da3-c26d-482a-bc03-017baf4bce22] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:49:08 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-2cf62297-cd61-4290-b413-addccd99ef43 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:08 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-2cf62297-cd61-4290-b413-addccd99ef43 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:08 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-2cf62297-cd61-4290-b413-addccd99ef43 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:08 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-2cf62297-cd61-4290-b413-addccd99ef43 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:08 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-2cf62297-cd61-4290-b413-addccd99ef43 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:08 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-2cf62297-cd61-4290-b413-addccd99ef43 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:08 user devstack@n-api.service[61318]: DEBUG nova.policy [None req-2cf62297-cd61-4290-b413-addccd99ef43 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced216baa4a64c72946cf3f71eb873dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648163a728fc4b28b85a24e9198d356b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61318) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:49:08 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-2cf62297-cd61-4290-b413-addccd99ef43 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8609da3-c26d-482a-bc03-017baf4bce22" status: 200 len: 1538 microversion: 2.1 time: 0.216100 Apr 21 10:49:08 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 39/122] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:49:08 2023] GET /compute/v2.1/servers/f8609da3-c26d-482a-bc03-017baf4bce22 => generated 1538 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:49:10 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-cf5e009e-f955-4379-87fd-8490b98320b0 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:49:10 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-cf5e009e-f955-4379-87fd-8490b98320b0 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] [instance: 15bf9321-a92e-4be2-bcae-a943988c811a] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:49:10 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-cf5e009e-f955-4379-87fd-8490b98320b0 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:10 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-cf5e009e-f955-4379-87fd-8490b98320b0 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:10 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-cf5e009e-f955-4379-87fd-8490b98320b0 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:10 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-cf5e009e-f955-4379-87fd-8490b98320b0 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:10 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-cf5e009e-f955-4379-87fd-8490b98320b0 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:10 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-cf5e009e-f955-4379-87fd-8490b98320b0 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:10 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-cf5e009e-f955-4379-87fd-8490b98320b0 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15bf9321-a92e-4be2-bcae-a943988c811a/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.536035 Apr 21 10:49:10 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 42/123] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 21 10:49:10 2023] GET /compute/v2.1/servers/15bf9321-a92e-4be2-bcae-a943988c811a/os-interface => generated 283 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:49:10 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-ea31718c-c7c9-4385-a72e-610049e80617 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:49:10 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-ea31718c-c7c9-4385-a72e-610049e80617 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] [instance: dd4d15a1-3a71-49e8-9851-9b49fec6a9e3] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:49:10 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-ea31718c-c7c9-4385-a72e-610049e80617 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:10 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-ea31718c-c7c9-4385-a72e-610049e80617 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:10 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-ea31718c-c7c9-4385-a72e-610049e80617 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:10 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-ea31718c-c7c9-4385-a72e-610049e80617 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:10 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-ea31718c-c7c9-4385-a72e-610049e80617 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:10 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-ea31718c-c7c9-4385-a72e-610049e80617 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:10 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-ea31718c-c7c9-4385-a72e-610049e80617 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dd4d15a1-3a71-49e8-9851-9b49fec6a9e3/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.168380 Apr 21 10:49:10 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 43/124] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 21 10:49:10 2023] GET /compute/v2.1/servers/dd4d15a1-3a71-49e8-9851-9b49fec6a9e3/os-interface => generated 283 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:49:11 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [req-ad6474b0-7eb4-44ac-8387-32524acf0391 req-2b0be916-1019-45cc-9b1c-f646faf33254 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15bf9321-a92e-4be2-bcae-a943988c811a", "tag": "fca8b6a6-fd45-4ba5-b1b1-fc40da2fc33d"}]} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:49:11 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-a5a5bc16-5dc5-4876-9f5a-f30d6257994a req-2f86e8f8-749c-4413-936b-7eef9f22cdc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd4d15a1-3a71-49e8-9851-9b49fec6a9e3", "tag": "b08cd847-5a3c-4ebf-ac8d-0a8dfd13f57c"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:49:11 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-ad6474b0-7eb4-44ac-8387-32524acf0391 req-2b0be916-1019-45cc-9b1c-f646faf33254 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:11 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-ad6474b0-7eb4-44ac-8387-32524acf0391 req-2b0be916-1019-45cc-9b1c-f646faf33254 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:11 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-ad6474b0-7eb4-44ac-8387-32524acf0391 req-2b0be916-1019-45cc-9b1c-f646faf33254 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:11 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-a5a5bc16-5dc5-4876-9f5a-f30d6257994a req-2f86e8f8-749c-4413-936b-7eef9f22cdc1 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:11 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-a5a5bc16-5dc5-4876-9f5a-f30d6257994a req-2f86e8f8-749c-4413-936b-7eef9f22cdc1 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:11 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-a5a5bc16-5dc5-4876-9f5a-f30d6257994a req-2f86e8f8-749c-4413-936b-7eef9f22cdc1 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:11 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-ad6474b0-7eb4-44ac-8387-32524acf0391 req-2b0be916-1019-45cc-9b1c-f646faf33254 service nova] Creating event network-changed:fca8b6a6-fd45-4ba5-b1b1-fc40da2fc33d for instance 15bf9321-a92e-4be2-bcae-a943988c811a on user Apr 21 10:49:11 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-a5a5bc16-5dc5-4876-9f5a-f30d6257994a req-2f86e8f8-749c-4413-936b-7eef9f22cdc1 service nova] Creating event network-changed:b08cd847-5a3c-4ebf-ac8d-0a8dfd13f57c for instance dd4d15a1-3a71-49e8-9851-9b49fec6a9e3 on user Apr 21 10:49:11 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [req-ad6474b0-7eb4-44ac-8387-32524acf0391 req-2b0be916-1019-45cc-9b1c-f646faf33254 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048384 Apr 21 10:49:11 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 40/125] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:49:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:49:11 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-611b72c8-7c24-48aa-90f8-0c753abbe1a2 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:49:11 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-611b72c8-7c24-48aa-90f8-0c753abbe1a2 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] [instance: dd4d15a1-3a71-49e8-9851-9b49fec6a9e3] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:49:11 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-a5a5bc16-5dc5-4876-9f5a-f30d6257994a req-2f86e8f8-749c-4413-936b-7eef9f22cdc1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046854 Apr 21 10:49:11 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 43/126] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:49:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:49:11 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-611b72c8-7c24-48aa-90f8-0c753abbe1a2 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:11 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-611b72c8-7c24-48aa-90f8-0c753abbe1a2 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:11 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-611b72c8-7c24-48aa-90f8-0c753abbe1a2 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:11 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-611b72c8-7c24-48aa-90f8-0c753abbe1a2 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:11 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-611b72c8-7c24-48aa-90f8-0c753abbe1a2 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:11 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-611b72c8-7c24-48aa-90f8-0c753abbe1a2 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:11 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-e4461d2c-0b1c-4a23-a7ab-75529a26ff4b tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-1474465036"}} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:49:11 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-e4461d2c-0b1c-4a23-a7ab-75529a26ff4b tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] [instance: 15bf9321-a92e-4be2-bcae-a943988c811a] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:49:11 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-e4461d2c-0b1c-4a23-a7ab-75529a26ff4b tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:11 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-e4461d2c-0b1c-4a23-a7ab-75529a26ff4b tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:11 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-e4461d2c-0b1c-4a23-a7ab-75529a26ff4b tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:11 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-e4461d2c-0b1c-4a23-a7ab-75529a26ff4b tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:11 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-e4461d2c-0b1c-4a23-a7ab-75529a26ff4b tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:11 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-e4461d2c-0b1c-4a23-a7ab-75529a26ff4b tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:12 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-611b72c8-7c24-48aa-90f8-0c753abbe1a2 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dd4d15a1-3a71-49e8-9851-9b49fec6a9e3/ips" status: 200 len: 105 microversion: 2.1 time: 0.150690 Apr 21 10:49:12 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 44/127] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 21 10:49:11 2023] GET /compute/v2.1/servers/dd4d15a1-3a71-49e8-9851-9b49fec6a9e3/ips => generated 105 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:49:12 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-e4461d2c-0b1c-4a23-a7ab-75529a26ff4b tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] 10.0.0.210 "POST /compute/v2.1/servers/15bf9321-a92e-4be2-bcae-a943988c811a/action" status: 202 len: 0 microversion: 2.1 time: 0.846729 Apr 21 10:49:12 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 41/128] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 21 10:49:11 2023] POST /compute/v2.1/servers/15bf9321-a92e-4be2-bcae-a943988c811a/action => generated 0 bytes in 849 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 21 10:49:12 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-2a5c8c15-6021-46a3-a6f9-523ce40943d5 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Calling method '.version_select at 0x7f91a5f10430>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:49:12 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-2a5c8c15-6021-46a3-a6f9-523ce40943d5 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] 10.0.0.210 "GET /compute/v2.1/images/3c3de79a-9b9a-4806-a09d-d95df36a6231" status: 200 len: 1609 microversion: 2.1 time: 0.048017 Apr 21 10:49:12 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 44/129] 10.0.0.210 () {62 vars in 1310 bytes} [Fri Apr 21 10:49:12 2023] GET /compute/v2.1/images/3c3de79a-9b9a-4806-a09d-d95df36a6231 => generated 1609 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:49:13 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-6cc952c3-df66-444a-8db5-4fa91baa8d1c tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:49:13 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-6cc952c3-df66-444a-8db5-4fa91baa8d1c tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] [instance: dd4d15a1-3a71-49e8-9851-9b49fec6a9e3] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:49:13 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-6cc952c3-df66-444a-8db5-4fa91baa8d1c tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:13 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-6cc952c3-df66-444a-8db5-4fa91baa8d1c tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:13 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-6cc952c3-df66-444a-8db5-4fa91baa8d1c tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:13 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-6cc952c3-df66-444a-8db5-4fa91baa8d1c tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:13 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-6cc952c3-df66-444a-8db5-4fa91baa8d1c tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:13 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-6cc952c3-df66-444a-8db5-4fa91baa8d1c tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:13 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-6cc952c3-df66-444a-8db5-4fa91baa8d1c tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] [instance: dd4d15a1-3a71-49e8-9851-9b49fec6a9e3] Going to try to terminate instance {{(pid=61320) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 10:49:13 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-6cc952c3-df66-444a-8db5-4fa91baa8d1c tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dd4d15a1-3a71-49e8-9851-9b49fec6a9e3" status: 204 len: 0 microversion: 2.1 time: 0.131073 Apr 21 10:49:13 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 45/130] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 10:49:13 2023] DELETE /compute/v2.1/servers/dd4d15a1-3a71-49e8-9851-9b49fec6a9e3 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 10:49:13 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-1b0088f2-13fc-4de4-84f6-0570cfefbeea tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:49:13 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-1b0088f2-13fc-4de4-84f6-0570cfefbeea tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] [instance: dd4d15a1-3a71-49e8-9851-9b49fec6a9e3] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:49:13 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-1b0088f2-13fc-4de4-84f6-0570cfefbeea tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:13 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-1b0088f2-13fc-4de4-84f6-0570cfefbeea tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:13 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-1b0088f2-13fc-4de4-84f6-0570cfefbeea tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:13 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-1b0088f2-13fc-4de4-84f6-0570cfefbeea tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:13 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-1b0088f2-13fc-4de4-84f6-0570cfefbeea tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:13 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-1b0088f2-13fc-4de4-84f6-0570cfefbeea tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:13 user devstack@n-api.service[61318]: DEBUG nova.policy [None req-1b0088f2-13fc-4de4-84f6-0570cfefbeea tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fb0d890b594080bb1bb99dd6294ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd85f51547e5244e495343281725fe320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61318) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:49:13 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-1b0088f2-13fc-4de4-84f6-0570cfefbeea tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dd4d15a1-3a71-49e8-9851-9b49fec6a9e3" status: 200 len: 1659 microversion: 2.1 time: 0.264711 Apr 21 10:49:13 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 42/131] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:49:13 2023] GET /compute/v2.1/servers/dd4d15a1-3a71-49e8-9851-9b49fec6a9e3 => generated 1659 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:49:13 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-4a52db10-5aa4-4e70-a668-fab9ea05941a req-1f017dd4-1942-462a-847c-312d03659657 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd4d15a1-3a71-49e8-9851-9b49fec6a9e3", "name": "network-vif-unplugged", "status": "completed", "tag": "b08cd847-5a3c-4ebf-ac8d-0a8dfd13f57c"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:49:13 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-4a52db10-5aa4-4e70-a668-fab9ea05941a req-1f017dd4-1942-462a-847c-312d03659657 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:13 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-4a52db10-5aa4-4e70-a668-fab9ea05941a req-1f017dd4-1942-462a-847c-312d03659657 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:13 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-4a52db10-5aa4-4e70-a668-fab9ea05941a req-1f017dd4-1942-462a-847c-312d03659657 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:13 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-4a52db10-5aa4-4e70-a668-fab9ea05941a req-1f017dd4-1942-462a-847c-312d03659657 service nova] Creating event network-vif-unplugged:b08cd847-5a3c-4ebf-ac8d-0a8dfd13f57c for instance dd4d15a1-3a71-49e8-9851-9b49fec6a9e3 on user Apr 21 10:49:13 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-4a52db10-5aa4-4e70-a668-fab9ea05941a req-1f017dd4-1942-462a-847c-312d03659657 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.026885 Apr 21 10:49:13 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 45/132] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:49:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:49:15 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [req-65631f93-6c5f-4f17-b07d-2e8081d1e90f req-0e68a69a-a26c-493e-b355-cda22a7897c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd4d15a1-3a71-49e8-9851-9b49fec6a9e3", "name": "network-vif-plugged", "status": "completed", "tag": "b08cd847-5a3c-4ebf-ac8d-0a8dfd13f57c"}, {"server_uuid": "dd4d15a1-3a71-49e8-9851-9b49fec6a9e3", "name": "network-vif-deleted", "tag": "b08cd847-5a3c-4ebf-ac8d-0a8dfd13f57c"}]} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:49:15 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-65631f93-6c5f-4f17-b07d-2e8081d1e90f req-0e68a69a-a26c-493e-b355-cda22a7897c4 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:15 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-65631f93-6c5f-4f17-b07d-2e8081d1e90f req-0e68a69a-a26c-493e-b355-cda22a7897c4 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:15 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-65631f93-6c5f-4f17-b07d-2e8081d1e90f req-0e68a69a-a26c-493e-b355-cda22a7897c4 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:15 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-65631f93-6c5f-4f17-b07d-2e8081d1e90f req-0e68a69a-a26c-493e-b355-cda22a7897c4 service nova] Creating event network-vif-plugged:b08cd847-5a3c-4ebf-ac8d-0a8dfd13f57c for instance dd4d15a1-3a71-49e8-9851-9b49fec6a9e3 on user Apr 21 10:49:15 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-65631f93-6c5f-4f17-b07d-2e8081d1e90f req-0e68a69a-a26c-493e-b355-cda22a7897c4 service nova] Creating event network-vif-deleted:b08cd847-5a3c-4ebf-ac8d-0a8dfd13f57c for instance dd4d15a1-3a71-49e8-9851-9b49fec6a9e3 on user Apr 21 10:49:15 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [req-65631f93-6c5f-4f17-b07d-2e8081d1e90f req-0e68a69a-a26c-493e-b355-cda22a7897c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033207 Apr 21 10:49:15 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 46/133] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:49:15 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:49:17 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-071a2066-0605-4a27-a905-52910ec687b7 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:49:17 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-071a2066-0605-4a27-a905-52910ec687b7 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] [instance: aecf1ba8-9675-4535-874b-9084361b7693] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:49:17 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-071a2066-0605-4a27-a905-52910ec687b7 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:17 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-071a2066-0605-4a27-a905-52910ec687b7 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:17 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-071a2066-0605-4a27-a905-52910ec687b7 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:17 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-071a2066-0605-4a27-a905-52910ec687b7 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:17 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-071a2066-0605-4a27-a905-52910ec687b7 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:17 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-071a2066-0605-4a27-a905-52910ec687b7 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:17 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-071a2066-0605-4a27-a905-52910ec687b7 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aecf1ba8-9675-4535-874b-9084361b7693/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.157612 Apr 21 10:49:17 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 43/134] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 21 10:49:17 2023] GET /compute/v2.1/servers/aecf1ba8-9675-4535-874b-9084361b7693/os-interface => generated 282 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:49:18 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-ca600245-9ce5-48fd-ab27-b617abe09bda req-774dc6a0-e9ee-46f0-8949-f713ba01f283 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aecf1ba8-9675-4535-874b-9084361b7693", "tag": "892719ba-88a5-4998-9b27-c47babc15f5c"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:49:18 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-ca600245-9ce5-48fd-ab27-b617abe09bda req-774dc6a0-e9ee-46f0-8949-f713ba01f283 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:18 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-ca600245-9ce5-48fd-ab27-b617abe09bda req-774dc6a0-e9ee-46f0-8949-f713ba01f283 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:18 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-ca600245-9ce5-48fd-ab27-b617abe09bda req-774dc6a0-e9ee-46f0-8949-f713ba01f283 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:18 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-ca600245-9ce5-48fd-ab27-b617abe09bda req-774dc6a0-e9ee-46f0-8949-f713ba01f283 service nova] Creating event network-changed:892719ba-88a5-4998-9b27-c47babc15f5c for instance aecf1ba8-9675-4535-874b-9084361b7693 on user Apr 21 10:49:18 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-ca600245-9ce5-48fd-ab27-b617abe09bda req-774dc6a0-e9ee-46f0-8949-f713ba01f283 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030157 Apr 21 10:49:18 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 46/135] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:49:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:49:20 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-c4065aa8-1fcb-406a-8b42-fc30bf71de4c tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:49:20 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-c4065aa8-1fcb-406a-8b42-fc30bf71de4c tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] [instance: aecf1ba8-9675-4535-874b-9084361b7693] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:49:20 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-c4065aa8-1fcb-406a-8b42-fc30bf71de4c tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:20 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-c4065aa8-1fcb-406a-8b42-fc30bf71de4c tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:20 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-c4065aa8-1fcb-406a-8b42-fc30bf71de4c tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:20 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-c4065aa8-1fcb-406a-8b42-fc30bf71de4c tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:20 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-c4065aa8-1fcb-406a-8b42-fc30bf71de4c tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:20 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-c4065aa8-1fcb-406a-8b42-fc30bf71de4c tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:20 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-c4065aa8-1fcb-406a-8b42-fc30bf71de4c tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] [instance: aecf1ba8-9675-4535-874b-9084361b7693] Going to try to terminate instance {{(pid=61320) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 10:49:20 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-c4065aa8-1fcb-406a-8b42-fc30bf71de4c tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/aecf1ba8-9675-4535-874b-9084361b7693" status: 204 len: 0 microversion: 2.1 time: 0.125375 Apr 21 10:49:20 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 47/136] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 10:49:20 2023] DELETE /compute/v2.1/servers/aecf1ba8-9675-4535-874b-9084361b7693 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 21 10:49:20 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-bb759a32-6e2d-41c4-b8e8-1505400df3fb tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:49:20 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-bb759a32-6e2d-41c4-b8e8-1505400df3fb tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] [instance: aecf1ba8-9675-4535-874b-9084361b7693] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:49:20 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-bb759a32-6e2d-41c4-b8e8-1505400df3fb tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:20 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-bb759a32-6e2d-41c4-b8e8-1505400df3fb tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:20 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-bb759a32-6e2d-41c4-b8e8-1505400df3fb tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:20 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-bb759a32-6e2d-41c4-b8e8-1505400df3fb tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:20 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-bb759a32-6e2d-41c4-b8e8-1505400df3fb tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:20 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-bb759a32-6e2d-41c4-b8e8-1505400df3fb tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:20 user devstack@n-api.service[61318]: DEBUG nova.policy [None req-bb759a32-6e2d-41c4-b8e8-1505400df3fb tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b1fae0fc8d4b9a998ab0679bace1a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d2c4f2fb9f45559c4e51e86339a0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61318) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:49:20 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-bb759a32-6e2d-41c4-b8e8-1505400df3fb tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aecf1ba8-9675-4535-874b-9084361b7693" status: 200 len: 1673 microversion: 2.1 time: 0.163828 Apr 21 10:49:20 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 44/137] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:49:20 2023] GET /compute/v2.1/servers/aecf1ba8-9675-4535-874b-9084361b7693 => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:49:20 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-b5899609-ace2-4e53-a931-09878a03fc57 req-c3df1ddc-814b-4ced-8068-05d87f720a37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aecf1ba8-9675-4535-874b-9084361b7693", "name": "network-vif-unplugged", "status": "completed", "tag": "892719ba-88a5-4998-9b27-c47babc15f5c"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:49:20 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-b5899609-ace2-4e53-a931-09878a03fc57 req-c3df1ddc-814b-4ced-8068-05d87f720a37 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:20 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-b5899609-ace2-4e53-a931-09878a03fc57 req-c3df1ddc-814b-4ced-8068-05d87f720a37 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:20 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-b5899609-ace2-4e53-a931-09878a03fc57 req-c3df1ddc-814b-4ced-8068-05d87f720a37 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:20 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-b5899609-ace2-4e53-a931-09878a03fc57 req-c3df1ddc-814b-4ced-8068-05d87f720a37 service nova] Creating event network-vif-unplugged:892719ba-88a5-4998-9b27-c47babc15f5c for instance aecf1ba8-9675-4535-874b-9084361b7693 on user Apr 21 10:49:20 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-b5899609-ace2-4e53-a931-09878a03fc57 req-c3df1ddc-814b-4ced-8068-05d87f720a37 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040978 Apr 21 10:49:20 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 47/138] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:49:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:49:22 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [req-0855b1d6-74e3-4042-9ed0-718bd0f8537c req-c4911d29-111c-4c5d-add7-02176e4df01f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aecf1ba8-9675-4535-874b-9084361b7693", "name": "network-vif-plugged", "status": "completed", "tag": "892719ba-88a5-4998-9b27-c47babc15f5c"}, {"server_uuid": "aecf1ba8-9675-4535-874b-9084361b7693", "name": "network-vif-plugged", "status": "completed", "tag": "892719ba-88a5-4998-9b27-c47babc15f5c"}, {"server_uuid": "aecf1ba8-9675-4535-874b-9084361b7693", "name": "network-vif-plugged", "status": "completed", "tag": "892719ba-88a5-4998-9b27-c47babc15f5c"}, {"server_uuid": "aecf1ba8-9675-4535-874b-9084361b7693", "name": "network-vif-unplugged", "status": "completed", "tag": "892719ba-88a5-4998-9b27-c47babc15f5c"}, {"server_uuid": "aecf1ba8-9675-4535-874b-9084361b7693", "name": "network-vif-plugged", "status": "completed", "tag": "892719ba-88a5-4998-9b27-c47babc15f5c"}, {"server_uuid": "aecf1ba8-9675-4535-874b-9084361b7693", "name": "network-vif-deleted", "tag": "892719ba-88a5-4998-9b27-c47babc15f5c"}]} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:49:22 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-0855b1d6-74e3-4042-9ed0-718bd0f8537c req-c4911d29-111c-4c5d-add7-02176e4df01f service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:22 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-0855b1d6-74e3-4042-9ed0-718bd0f8537c req-c4911d29-111c-4c5d-add7-02176e4df01f service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:22 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-0855b1d6-74e3-4042-9ed0-718bd0f8537c req-c4911d29-111c-4c5d-add7-02176e4df01f service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:22 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-0855b1d6-74e3-4042-9ed0-718bd0f8537c req-c4911d29-111c-4c5d-add7-02176e4df01f service nova] Creating event network-vif-plugged:892719ba-88a5-4998-9b27-c47babc15f5c for instance aecf1ba8-9675-4535-874b-9084361b7693 on user Apr 21 10:49:22 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-0855b1d6-74e3-4042-9ed0-718bd0f8537c req-c4911d29-111c-4c5d-add7-02176e4df01f service nova] Creating event network-vif-plugged:892719ba-88a5-4998-9b27-c47babc15f5c for instance aecf1ba8-9675-4535-874b-9084361b7693 on user Apr 21 10:49:22 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-0855b1d6-74e3-4042-9ed0-718bd0f8537c req-c4911d29-111c-4c5d-add7-02176e4df01f service nova] Creating event network-vif-plugged:892719ba-88a5-4998-9b27-c47babc15f5c for instance aecf1ba8-9675-4535-874b-9084361b7693 on user Apr 21 10:49:22 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-0855b1d6-74e3-4042-9ed0-718bd0f8537c req-c4911d29-111c-4c5d-add7-02176e4df01f service nova] Creating event network-vif-unplugged:892719ba-88a5-4998-9b27-c47babc15f5c for instance aecf1ba8-9675-4535-874b-9084361b7693 on user Apr 21 10:49:22 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-0855b1d6-74e3-4042-9ed0-718bd0f8537c req-c4911d29-111c-4c5d-add7-02176e4df01f service nova] Creating event network-vif-plugged:892719ba-88a5-4998-9b27-c47babc15f5c for instance aecf1ba8-9675-4535-874b-9084361b7693 on user Apr 21 10:49:22 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-0855b1d6-74e3-4042-9ed0-718bd0f8537c req-c4911d29-111c-4c5d-add7-02176e4df01f service nova] Creating event network-vif-deleted:892719ba-88a5-4998-9b27-c47babc15f5c for instance aecf1ba8-9675-4535-874b-9084361b7693 on user Apr 21 10:49:22 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [req-0855b1d6-74e3-4042-9ed0-718bd0f8537c req-c4911d29-111c-4c5d-add7-02176e4df01f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1040 microversion: 2.1 time: 0.032753 Apr 21 10:49:22 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 48/139] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:49:22 2023] POST /compute/v2.1/os-server-external-events => generated 1040 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:49:23 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-6f18bcc8-8ec6-4c69-94c8-686d1076b7a0 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:49:23 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-6f18bcc8-8ec6-4c69-94c8-686d1076b7a0 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] [instance: 8ae797bd-c587-43a3-b941-e6d6d6c74e51] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:49:23 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-6f18bcc8-8ec6-4c69-94c8-686d1076b7a0 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:23 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-6f18bcc8-8ec6-4c69-94c8-686d1076b7a0 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:23 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-6f18bcc8-8ec6-4c69-94c8-686d1076b7a0 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:23 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-6f18bcc8-8ec6-4c69-94c8-686d1076b7a0 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:23 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-6f18bcc8-8ec6-4c69-94c8-686d1076b7a0 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:23 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-6f18bcc8-8ec6-4c69-94c8-686d1076b7a0 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:23 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-6f18bcc8-8ec6-4c69-94c8-686d1076b7a0 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8ae797bd-c587-43a3-b941-e6d6d6c74e51/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.163270 Apr 21 10:49:23 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 45/140] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 21 10:49:23 2023] GET /compute/v2.1/servers/8ae797bd-c587-43a3-b941-e6d6d6c74e51/os-interface => generated 283 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:49:24 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-4c934d8b-d3df-42ad-bf87-bbd673083357 req-cdb2a2e9-7908-47c3-97ea-57b26a6776ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ae797bd-c587-43a3-b941-e6d6d6c74e51", "tag": "44d4e2d5-0850-4b05-9d97-f3916611f340"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:49:24 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-4c934d8b-d3df-42ad-bf87-bbd673083357 req-cdb2a2e9-7908-47c3-97ea-57b26a6776ee service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:24 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-4c934d8b-d3df-42ad-bf87-bbd673083357 req-cdb2a2e9-7908-47c3-97ea-57b26a6776ee service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:24 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-4c934d8b-d3df-42ad-bf87-bbd673083357 req-cdb2a2e9-7908-47c3-97ea-57b26a6776ee service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:24 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-4c934d8b-d3df-42ad-bf87-bbd673083357 req-cdb2a2e9-7908-47c3-97ea-57b26a6776ee service nova] Creating event network-changed:44d4e2d5-0850-4b05-9d97-f3916611f340 for instance 8ae797bd-c587-43a3-b941-e6d6d6c74e51 on user Apr 21 10:49:24 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-4c934d8b-d3df-42ad-bf87-bbd673083357 req-cdb2a2e9-7908-47c3-97ea-57b26a6776ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030313 Apr 21 10:49:24 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 48/141] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:49:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:49:26 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-d1953efa-c961-4dce-9abd-afa4e66c6439 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1890729888", "imageRef": "3b29a01a-1fc0-4d0d-89fb-23d22b2de02e", "flavorRef": "42", "networks": [{"uuid": "fcf7861e-296e-4706-871b-557b594e17c3"}]}} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:49:26 user devstack@n-api.service[61320]: DEBUG nova.network.neutron [None req-d1953efa-c961-4dce-9abd-afa4e66c6439 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] validate_networks() for [('fcf7861e-296e-4706-871b-557b594e17c3', None, None, None, None, None)] {{(pid=61320) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 10:49:26 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-d1953efa-c961-4dce-9abd-afa4e66c6439 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Flavor limits 0:0:0 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 10:49:26 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-d1953efa-c961-4dce-9abd-afa4e66c6439 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Image limits 0:0:0 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 10:49:26 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-d1953efa-c961-4dce-9abd-afa4e66c6439 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Flavor pref 0:0:0 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 10:49:26 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-d1953efa-c961-4dce-9abd-afa4e66c6439 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Image pref 0:0:0 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 10:49:26 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-d1953efa-c961-4dce-9abd-afa4e66c6439 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 10:49:26 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-d1953efa-c961-4dce-9abd-afa4e66c6439 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:26 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-d1953efa-c961-4dce-9abd-afa4e66c6439 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:26 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-d1953efa-c961-4dce-9abd-afa4e66c6439 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:26 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-d1953efa-c961-4dce-9abd-afa4e66c6439 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:26 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-d1953efa-c961-4dce-9abd-afa4e66c6439 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:26 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-d1953efa-c961-4dce-9abd-afa4e66c6439 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:26 user devstack@n-api.service[61320]: DEBUG nova.quota [None req-d1953efa-c961-4dce-9abd-afa4e66c6439 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Getting quotas for project 94e77e1735854e0c966c42e9a613017f. Resources: {'cores', 'instances', 'ram'} {{(pid=61320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 10:49:26 user devstack@n-api.service[61320]: DEBUG nova.quota [None req-d1953efa-c961-4dce-9abd-afa4e66c6439 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Getting quotas for user c600e01acfe140cabcdfe54958e66108 and project 94e77e1735854e0c966c42e9a613017f. Resources: {'cores', 'instances', 'ram'} {{(pid=61320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 10:49:26 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-d1953efa-c961-4dce-9abd-afa4e66c6439 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Going to run 1 instances... {{(pid=61320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 10:49:26 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-d1953efa-c961-4dce-9abd-afa4e66c6439 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] [instance: 3dd95a26-8652-40f5-b357-3cbc8a38628a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3b29a01a-1fc0-4d0d-89fb-23d22b2de02e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 10:49:26 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-d1953efa-c961-4dce-9abd-afa4e66c6439 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.583644 Apr 21 10:49:26 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 49/142] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 10:49:26 2023] POST /compute/v2.1/servers => generated 378 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 10:49:26 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-7fc186a6-8200-44a0-bd9d-860b0c1a1633 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:49:26 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-7fc186a6-8200-44a0-bd9d-860b0c1a1633 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] [instance: 3dd95a26-8652-40f5-b357-3cbc8a38628a] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:49:26 user devstack@n-api.service[61318]: DEBUG nova.policy [None req-7fc186a6-8200-44a0-bd9d-860b0c1a1633 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c600e01acfe140cabcdfe54958e66108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e77e1735854e0c966c42e9a613017f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61318) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:49:26 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-7fc186a6-8200-44a0-bd9d-860b0c1a1633 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3dd95a26-8652-40f5-b357-3cbc8a38628a" status: 200 len: 1212 microversion: 2.1 time: 0.086017 Apr 21 10:49:26 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 46/143] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:49:26 2023] GET /compute/v2.1/servers/3dd95a26-8652-40f5-b357-3cbc8a38628a => generated 1212 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 10:49:29 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-5c4c4293-e4c9-4c42-930e-ed7b503dca74 req-4613b2d3-3c8e-4f8c-b67d-6481c527c3b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dd95a26-8652-40f5-b357-3cbc8a38628a", "tag": "76364ccf-028e-4291-b953-431265bcfabb"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:49:29 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-5c4c4293-e4c9-4c42-930e-ed7b503dca74 req-4613b2d3-3c8e-4f8c-b67d-6481c527c3b2 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:29 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-5c4c4293-e4c9-4c42-930e-ed7b503dca74 req-4613b2d3-3c8e-4f8c-b67d-6481c527c3b2 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:29 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-5c4c4293-e4c9-4c42-930e-ed7b503dca74 req-4613b2d3-3c8e-4f8c-b67d-6481c527c3b2 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:29 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-5c4c4293-e4c9-4c42-930e-ed7b503dca74 req-4613b2d3-3c8e-4f8c-b67d-6481c527c3b2 service nova] Creating event network-changed:76364ccf-028e-4291-b953-431265bcfabb for instance 3dd95a26-8652-40f5-b357-3cbc8a38628a on user Apr 21 10:49:29 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-5c4c4293-e4c9-4c42-930e-ed7b503dca74 req-4613b2d3-3c8e-4f8c-b67d-6481c527c3b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030286 Apr 21 10:49:29 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 49/144] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:49:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:49:31 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [req-2af8a62d-c358-4fbb-a46c-f86d31faed7c req-a81e189e-d3d0-4fe4-ae0e-976b51eac39f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dd95a26-8652-40f5-b357-3cbc8a38628a", "name": "network-vif-plugged", "status": "completed", "tag": "76364ccf-028e-4291-b953-431265bcfabb"}]} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:49:31 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:49:31 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-2af8a62d-c358-4fbb-a46c-f86d31faed7c req-a81e189e-d3d0-4fe4-ae0e-976b51eac39f service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:31 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-2af8a62d-c358-4fbb-a46c-f86d31faed7c req-a81e189e-d3d0-4fe4-ae0e-976b51eac39f service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:31 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-2af8a62d-c358-4fbb-a46c-f86d31faed7c req-a81e189e-d3d0-4fe4-ae0e-976b51eac39f service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:31 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:49:31 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-2af8a62d-c358-4fbb-a46c-f86d31faed7c req-a81e189e-d3d0-4fe4-ae0e-976b51eac39f service nova] Creating event network-vif-plugged:76364ccf-028e-4291-b953-431265bcfabb for instance 3dd95a26-8652-40f5-b357-3cbc8a38628a on user Apr 21 10:49:31 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [req-2af8a62d-c358-4fbb-a46c-f86d31faed7c req-a81e189e-d3d0-4fe4-ae0e-976b51eac39f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033018 Apr 21 10:49:31 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 50/145] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:49:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 10:49:33 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [req-ee1868bb-f2a8-4a00-82c6-339872839ab2 req-82a7f9e9-d4ae-45c3-8bc9-5f7fe6d94935 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dd95a26-8652-40f5-b357-3cbc8a38628a", "name": "network-vif-plugged", "status": "completed", "tag": "76364ccf-028e-4291-b953-431265bcfabb"}]} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:49:33 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:49:33 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-ee1868bb-f2a8-4a00-82c6-339872839ab2 req-82a7f9e9-d4ae-45c3-8bc9-5f7fe6d94935 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:33 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-ee1868bb-f2a8-4a00-82c6-339872839ab2 req-82a7f9e9-d4ae-45c3-8bc9-5f7fe6d94935 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:33 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-ee1868bb-f2a8-4a00-82c6-339872839ab2 req-82a7f9e9-d4ae-45c3-8bc9-5f7fe6d94935 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:33 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-ee1868bb-f2a8-4a00-82c6-339872839ab2 req-82a7f9e9-d4ae-45c3-8bc9-5f7fe6d94935 service nova] Creating event network-vif-plugged:76364ccf-028e-4291-b953-431265bcfabb for instance 3dd95a26-8652-40f5-b357-3cbc8a38628a on user Apr 21 10:49:33 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [req-ee1868bb-f2a8-4a00-82c6-339872839ab2 req-82a7f9e9-d4ae-45c3-8bc9-5f7fe6d94935 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029597 Apr 21 10:49:33 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 47/146] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:49:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:49:52 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:49:52 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:49:52 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-844399b6-604d-4c9f-8ff3-0097a9e46838 tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:49:52 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-844399b6-604d-4c9f-8ff3-0097a9e46838 tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] [instance: c3100b42-46b3-4371-89f2-e511ca1ce6cd] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:49:52 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-844399b6-604d-4c9f-8ff3-0097a9e46838 tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:52 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-844399b6-604d-4c9f-8ff3-0097a9e46838 tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:52 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-844399b6-604d-4c9f-8ff3-0097a9e46838 tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:52 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-844399b6-604d-4c9f-8ff3-0097a9e46838 tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:52 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-844399b6-604d-4c9f-8ff3-0097a9e46838 tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:52 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-844399b6-604d-4c9f-8ff3-0097a9e46838 tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:53 user devstack@n-api.service[61319]: DEBUG nova.policy [None req-844399b6-604d-4c9f-8ff3-0097a9e46838 tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7234a4dcce4289a84f5060f546efb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aece0e34a3451da50638e2930424e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61319) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:49:53 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-844399b6-604d-4c9f-8ff3-0097a9e46838 tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c3100b42-46b3-4371-89f2-e511ca1ce6cd" status: 200 len: 1567 microversion: 2.1 time: 0.231752 Apr 21 10:49:53 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 50/147] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:49:52 2023] GET /compute/v2.1/servers/c3100b42-46b3-4371-89f2-e511ca1ce6cd => generated 1567 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:49:54 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell0:SELECT=2 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:49:54 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell0:SELECT=6 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:49:54 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_api:SELECT=1 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:49:54 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-88f383d3-7f6c-41fc-a57c-36204d733a3e tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:49:54 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-88f383d3-7f6c-41fc-a57c-36204d733a3e tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] [instance: c3100b42-46b3-4371-89f2-e511ca1ce6cd] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:49:54 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-88f383d3-7f6c-41fc-a57c-36204d733a3e tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:54 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-88f383d3-7f6c-41fc-a57c-36204d733a3e tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:54 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-88f383d3-7f6c-41fc-a57c-36204d733a3e tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:54 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-88f383d3-7f6c-41fc-a57c-36204d733a3e tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:54 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-88f383d3-7f6c-41fc-a57c-36204d733a3e tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:54 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-88f383d3-7f6c-41fc-a57c-36204d733a3e tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:54 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-88f383d3-7f6c-41fc-a57c-36204d733a3e tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] [instance: c3100b42-46b3-4371-89f2-e511ca1ce6cd] Going to try to terminate instance {{(pid=61320) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 10:49:54 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-88f383d3-7f6c-41fc-a57c-36204d733a3e tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c3100b42-46b3-4371-89f2-e511ca1ce6cd" status: 204 len: 0 microversion: 2.1 time: 0.130437 Apr 21 10:49:54 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 51/148] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 10:49:54 2023] DELETE /compute/v2.1/servers/c3100b42-46b3-4371-89f2-e511ca1ce6cd => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 10:49:54 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell0:SELECT=2 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:49:54 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_api:SELECT=24 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:49:54 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-9dce97b5-c579-4b5e-b932-e630b2db9d8f tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:49:54 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-9dce97b5-c579-4b5e-b932-e630b2db9d8f tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] [instance: c3100b42-46b3-4371-89f2-e511ca1ce6cd] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:49:54 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-9dce97b5-c579-4b5e-b932-e630b2db9d8f tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:54 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-9dce97b5-c579-4b5e-b932-e630b2db9d8f tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:54 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-9dce97b5-c579-4b5e-b932-e630b2db9d8f tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:54 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-9dce97b5-c579-4b5e-b932-e630b2db9d8f tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:54 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-9dce97b5-c579-4b5e-b932-e630b2db9d8f tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:54 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-9dce97b5-c579-4b5e-b932-e630b2db9d8f tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:55 user devstack@n-api.service[61318]: DEBUG nova.policy [None req-9dce97b5-c579-4b5e-b932-e630b2db9d8f tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7234a4dcce4289a84f5060f546efb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aece0e34a3451da50638e2930424e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61318) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:49:55 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-9dce97b5-c579-4b5e-b932-e630b2db9d8f tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c3100b42-46b3-4371-89f2-e511ca1ce6cd" status: 200 len: 1573 microversion: 2.1 time: 0.288692 Apr 21 10:49:55 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 48/149] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:49:54 2023] GET /compute/v2.1/servers/c3100b42-46b3-4371-89f2-e511ca1ce6cd => generated 1573 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:49:55 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-ccd1db8b-7566-487e-b26c-904cf50a7391 req-947ea6ce-1e1d-40e4-a7ca-d82cf38b1da2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3100b42-46b3-4371-89f2-e511ca1ce6cd", "name": "network-vif-unplugged", "status": "completed", "tag": "be8924d4-464a-4572-8b2f-96b2f230297f"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:49:55 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-ccd1db8b-7566-487e-b26c-904cf50a7391 req-947ea6ce-1e1d-40e4-a7ca-d82cf38b1da2 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:55 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-ccd1db8b-7566-487e-b26c-904cf50a7391 req-947ea6ce-1e1d-40e4-a7ca-d82cf38b1da2 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:55 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-ccd1db8b-7566-487e-b26c-904cf50a7391 req-947ea6ce-1e1d-40e4-a7ca-d82cf38b1da2 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:55 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-ccd1db8b-7566-487e-b26c-904cf50a7391 req-947ea6ce-1e1d-40e4-a7ca-d82cf38b1da2 service nova] Creating event network-vif-unplugged:be8924d4-464a-4572-8b2f-96b2f230297f for instance c3100b42-46b3-4371-89f2-e511ca1ce6cd on user Apr 21 10:49:55 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-ccd1db8b-7566-487e-b26c-904cf50a7391 req-947ea6ce-1e1d-40e4-a7ca-d82cf38b1da2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028979 Apr 21 10:49:55 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 51/150] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:49:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:49:56 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-98c478a6-b5f0-4675-91a1-e061619e6fa3 tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:49:56 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-98c478a6-b5f0-4675-91a1-e061619e6fa3 tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] [instance: dd34ae7e-dcf2-4bb2-8ea3-0a3ee553efd8] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:49:56 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-98c478a6-b5f0-4675-91a1-e061619e6fa3 tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:56 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-98c478a6-b5f0-4675-91a1-e061619e6fa3 tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:56 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-98c478a6-b5f0-4675-91a1-e061619e6fa3 tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:56 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-98c478a6-b5f0-4675-91a1-e061619e6fa3 tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:56 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-98c478a6-b5f0-4675-91a1-e061619e6fa3 tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:56 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-98c478a6-b5f0-4675-91a1-e061619e6fa3 tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:56 user devstack@n-api.service[61320]: INFO nova.api.openstack.wsgi [None req-98c478a6-b5f0-4675-91a1-e061619e6fa3 tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] HTTP exception thrown: Instance dd34ae7e-dcf2-4bb2-8ea3-0a3ee553efd8 could not be found. Apr 21 10:49:56 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-98c478a6-b5f0-4675-91a1-e061619e6fa3 tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Request method failure captured: Apr 21 10:49:56 user devstack@n-api.service[61320]: request: GET /compute/v2.1/servers/dd34ae7e-dcf2-4bb2-8ea3-0a3ee553efd8 HTTP/1.1 Apr 21 10:49:56 user devstack@n-api.service[61320]: Accept: application/json Apr 21 10:49:56 user devstack@n-api.service[61320]: Accept-Encoding: identity Apr 21 10:49:56 user devstack@n-api.service[61320]: Connection: close Apr 21 10:49:56 user devstack@n-api.service[61320]: Content-Length: 0 Apr 21 10:49:56 user devstack@n-api.service[61320]: Content-Type: application/json Apr 21 10:49:56 user devstack@n-api.service[61320]: Host: 10.0.0.210 Apr 21 10:49:56 user devstack@n-api.service[61320]: Openstack-System-Scope: None Apr 21 10:49:56 user devstack@n-api.service[61320]: User-Agent: python-urllib3/1.26.15 Apr 21 10:49:56 user devstack@n-api.service[61320]: X-Auth-Token: gAAAAABkQmmtbjbuSZokMTDjri2wLTFKkbGQtb-8zs9FcM-QLkIZe-u9GJyasdg73ftuYRfpUc0_d1oGjGwWTVTAJrmN3KdZUhzVF5eI74zZMIwJ8oMf5V0Vccj6QtrWN3gLVfV7jHIC96ENJ3KNLkM-F-bKzijcJ9Hld3kIruYMn1zyjCtcrr8 Apr 21 10:49:56 user devstack@n-api.service[61320]: X-Domain-Id: None Apr 21 10:49:56 user devstack@n-api.service[61320]: X-Domain-Name: None Apr 21 10:49:56 user devstack@n-api.service[61320]: X-Identity-Status: Confirmed Apr 21 10:49:56 user devstack@n-api.service[61320]: X-Is-Admin-Project: True Apr 21 10:49:56 user devstack@n-api.service[61320]: X-Project-Domain-Id: default Apr 21 10:49:56 user devstack@n-api.service[61320]: X-Project-Domain-Name: Default Apr 21 10:49:56 user devstack@n-api.service[61320]: X-Project-Id: f12ec80f50254e5bbc5afd5470546c71 Apr 21 10:49:56 user devstack@n-api.service[61320]: X-Project-Name: tempest-DeleteServersTestJSON-1827381813 Apr 21 10:49:56 user devstack@n-api.service[61320]: X-Role: reader,member Apr 21 10:49:56 user devstack@n-api.service[61320]: X-Roles: reader,member Apr 21 10:49:56 user devstack@n-api.service[61320]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f12ec80f50254e5bbc5afd5470546c71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f12ec80f50254e5bbc5afd5470546c71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f12ec80f50254e5bbc5afd5470546c71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 10:49:56 user devstack@n-api.service[61320]: X-Tenant: tempest-DeleteServersTestJSON-1827381813 Apr 21 10:49:56 user devstack@n-api.service[61320]: X-Tenant-Id: f12ec80f50254e5bbc5afd5470546c71 Apr 21 10:49:56 user devstack@n-api.service[61320]: X-Tenant-Name: tempest-DeleteServersTestJSON-1827381813 Apr 21 10:49:56 user devstack@n-api.service[61320]: X-User: tempest-DeleteServersTestJSON-1827381813-project-member Apr 21 10:49:56 user devstack@n-api.service[61320]: X-User-Domain-Id: default Apr 21 10:49:56 user devstack@n-api.service[61320]: X-User-Domain-Name: Default Apr 21 10:49:56 user devstack@n-api.service[61320]: X-User-Id: eb7625e4107240d5a92379ace66052fa Apr 21 10:49:56 user devstack@n-api.service[61320]: X-User-Name: tempest-DeleteServersTestJSON-1827381813-project-member Apr 21 10:49:56 user devstack@n-api.service[61320]: method: > Apr 21 10:49:56 user devstack@n-api.service[61320]: exception: Instance dd34ae7e-dcf2-4bb2-8ea3-0a3ee553efd8 could not be found. Apr 21 10:49:56 user devstack@n-api.service[61320]: action_args: {'id': 'dd34ae7e-dcf2-4bb2-8ea3-0a3ee553efd8'} Apr 21 10:49:56 user devstack@n-api.service[61320]: {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 10:49:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:49:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 10:49:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 10:49:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 10:49:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 10:49:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 10:49:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 10:49:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 10:49:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 10:49:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd34ae7e-dcf2-4bb2-8ea3-0a3ee553efd8 could not be found. Apr 21 10:49:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:49:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:49:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:49:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:49:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 10:49:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 10:49:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 10:49:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 10:49:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 10:49:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 10:49:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 10:49:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 10:49:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 10:49:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 10:49:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 10:49:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 10:49:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd34ae7e-dcf2-4bb2-8ea3-0a3ee553efd8 could not be found. Apr 21 10:49:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:49:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:49:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:49:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:49:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 10:49:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 10:49:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 10:49:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 10:49:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd34ae7e-dcf2-4bb2-8ea3-0a3ee553efd8 could not be found. Apr 21 10:49:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:49:56 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-98c478a6-b5f0-4675-91a1-e061619e6fa3 tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] Returning 404 to user: Instance dd34ae7e-dcf2-4bb2-8ea3-0a3ee553efd8 could not be found. {{(pid=61320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 10:49:56 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-98c478a6-b5f0-4675-91a1-e061619e6fa3 tempest-DeleteServersTestJSON-1827381813 tempest-DeleteServersTestJSON-1827381813-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dd34ae7e-dcf2-4bb2-8ea3-0a3ee553efd8" status: 404 len: 111 microversion: 2.1 time: 0.034096 Apr 21 10:49:56 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 52/151] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:49:56 2023] GET /compute/v2.1/servers/dd34ae7e-dcf2-4bb2-8ea3-0a3ee553efd8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 10:49:57 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [req-bc93ff9f-0af6-4f4d-a182-a762cf76f882 req-e0a28607-0eab-45b0-8b68-b888cdbc6fab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3100b42-46b3-4371-89f2-e511ca1ce6cd", "name": "network-vif-plugged", "status": "completed", "tag": "be8924d4-464a-4572-8b2f-96b2f230297f"}, {"server_uuid": "c3100b42-46b3-4371-89f2-e511ca1ce6cd", "name": "network-vif-deleted", "tag": "be8924d4-464a-4572-8b2f-96b2f230297f"}]} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:49:57 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-bc93ff9f-0af6-4f4d-a182-a762cf76f882 req-e0a28607-0eab-45b0-8b68-b888cdbc6fab service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:57 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-bc93ff9f-0af6-4f4d-a182-a762cf76f882 req-e0a28607-0eab-45b0-8b68-b888cdbc6fab service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:57 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-bc93ff9f-0af6-4f4d-a182-a762cf76f882 req-e0a28607-0eab-45b0-8b68-b888cdbc6fab service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:57 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-bc93ff9f-0af6-4f4d-a182-a762cf76f882 req-e0a28607-0eab-45b0-8b68-b888cdbc6fab service nova] Creating event network-vif-plugged:be8924d4-464a-4572-8b2f-96b2f230297f for instance c3100b42-46b3-4371-89f2-e511ca1ce6cd on user Apr 21 10:49:57 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-bc93ff9f-0af6-4f4d-a182-a762cf76f882 req-e0a28607-0eab-45b0-8b68-b888cdbc6fab service nova] Creating event network-vif-deleted:be8924d4-464a-4572-8b2f-96b2f230297f for instance c3100b42-46b3-4371-89f2-e511ca1ce6cd on user Apr 21 10:49:57 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [req-bc93ff9f-0af6-4f4d-a182-a762cf76f882 req-e0a28607-0eab-45b0-8b68-b888cdbc6fab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031376 Apr 21 10:49:57 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 49/152] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:49:57 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:49:58 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-c558c520-fd9e-46aa-8862-1ba2746b0d6f tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:49:58 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-c558c520-fd9e-46aa-8862-1ba2746b0d6f tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] [instance: f8609da3-c26d-482a-bc03-017baf4bce22] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:49:58 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-c558c520-fd9e-46aa-8862-1ba2746b0d6f tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:58 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-c558c520-fd9e-46aa-8862-1ba2746b0d6f tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:58 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-c558c520-fd9e-46aa-8862-1ba2746b0d6f tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:58 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-c558c520-fd9e-46aa-8862-1ba2746b0d6f tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:58 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-c558c520-fd9e-46aa-8862-1ba2746b0d6f tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:58 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-c558c520-fd9e-46aa-8862-1ba2746b0d6f tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:58 user devstack@n-api.service[61319]: DEBUG nova.policy [None req-c558c520-fd9e-46aa-8862-1ba2746b0d6f tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced216baa4a64c72946cf3f71eb873dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648163a728fc4b28b85a24e9198d356b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61319) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:49:58 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-c558c520-fd9e-46aa-8862-1ba2746b0d6f tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8609da3-c26d-482a-bc03-017baf4bce22" status: 200 len: 1656 microversion: 2.1 time: 0.235158 Apr 21 10:49:58 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 52/153] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:49:58 2023] GET /compute/v2.1/servers/f8609da3-c26d-482a-bc03-017baf4bce22 => generated 1656 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:49:58 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-8154c836-26d4-4e17-82bc-e64fbe30028e tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:49:58 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-8154c836-26d4-4e17-82bc-e64fbe30028e tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] [instance: f8609da3-c26d-482a-bc03-017baf4bce22] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:49:58 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-8154c836-26d4-4e17-82bc-e64fbe30028e tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:58 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-8154c836-26d4-4e17-82bc-e64fbe30028e tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:58 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-8154c836-26d4-4e17-82bc-e64fbe30028e tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:58 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-8154c836-26d4-4e17-82bc-e64fbe30028e tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:49:58 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-8154c836-26d4-4e17-82bc-e64fbe30028e tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:49:58 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-8154c836-26d4-4e17-82bc-e64fbe30028e tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:49:59 user devstack@n-api.service[61320]: DEBUG nova.policy [None req-8154c836-26d4-4e17-82bc-e64fbe30028e tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced216baa4a64c72946cf3f71eb873dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648163a728fc4b28b85a24e9198d356b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61320) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:49:59 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-8154c836-26d4-4e17-82bc-e64fbe30028e tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8609da3-c26d-482a-bc03-017baf4bce22" status: 200 len: 1656 microversion: 2.1 time: 0.198301 Apr 21 10:49:59 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 53/154] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:49:58 2023] GET /compute/v2.1/servers/f8609da3-c26d-482a-bc03-017baf4bce22 => generated 1656 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:50:00 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-d5f9eeb7-5367-4991-af65-0e08d21c6508 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1063701166", "imageRef": "3b29a01a-1fc0-4d0d-89fb-23d22b2de02e", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "cfb4de90-44ea-486a-b5c4-c3b1111aa2bd"}]}} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:50:00 user devstack@n-api.service[61318]: DEBUG nova.network.neutron [None req-d5f9eeb7-5367-4991-af65-0e08d21c6508 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] validate_networks() for [('cfb4de90-44ea-486a-b5c4-c3b1111aa2bd', None, None, None, None, None)] {{(pid=61318) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 10:50:00 user devstack@n-api.service[61318]: DEBUG nova.virt.hardware [None req-d5f9eeb7-5367-4991-af65-0e08d21c6508 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Flavor limits 0:0:0 {{(pid=61318) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 10:50:00 user devstack@n-api.service[61318]: DEBUG nova.virt.hardware [None req-d5f9eeb7-5367-4991-af65-0e08d21c6508 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Image limits 0:0:0 {{(pid=61318) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 10:50:00 user devstack@n-api.service[61318]: DEBUG nova.virt.hardware [None req-d5f9eeb7-5367-4991-af65-0e08d21c6508 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Flavor pref 0:0:0 {{(pid=61318) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 10:50:00 user devstack@n-api.service[61318]: DEBUG nova.virt.hardware [None req-d5f9eeb7-5367-4991-af65-0e08d21c6508 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Image pref 0:0:0 {{(pid=61318) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 10:50:00 user devstack@n-api.service[61318]: DEBUG nova.virt.hardware [None req-d5f9eeb7-5367-4991-af65-0e08d21c6508 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61318) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 10:50:00 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-d5f9eeb7-5367-4991-af65-0e08d21c6508 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:50:00 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-d5f9eeb7-5367-4991-af65-0e08d21c6508 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:50:00 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-d5f9eeb7-5367-4991-af65-0e08d21c6508 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:50:00 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-d5f9eeb7-5367-4991-af65-0e08d21c6508 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:50:00 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-d5f9eeb7-5367-4991-af65-0e08d21c6508 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:50:00 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-d5f9eeb7-5367-4991-af65-0e08d21c6508 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:50:00 user devstack@n-api.service[61318]: DEBUG nova.quota [None req-d5f9eeb7-5367-4991-af65-0e08d21c6508 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Getting quotas for project aad84a0e014f47ddaeaddc88bf16b0a8. Resources: {'cores', 'instances', 'ram'} {{(pid=61318) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 10:50:00 user devstack@n-api.service[61318]: DEBUG nova.quota [None req-d5f9eeb7-5367-4991-af65-0e08d21c6508 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Getting quotas for user 54c67d90b6014d9ea24ef2552006bc04 and project aad84a0e014f47ddaeaddc88bf16b0a8. Resources: {'cores', 'instances', 'ram'} {{(pid=61318) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 10:50:00 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-d5f9eeb7-5367-4991-af65-0e08d21c6508 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Going to run 1 instances... {{(pid=61318) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 10:50:00 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-d5f9eeb7-5367-4991-af65-0e08d21c6508 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] [instance: db58ccab-48e9-499e-a916-9a68709958d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61318) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 10:50:00 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-d5f9eeb7-5367-4991-af65-0e08d21c6508 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.790513 Apr 21 10:50:00 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 50/155] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 21 10:50:00 2023] POST /compute/v2.1/servers => generated 378 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 21 10:50:00 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-15b6b973-f841-4997-b78f-c3e985e3ac43 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:50:00 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-15b6b973-f841-4997-b78f-c3e985e3ac43 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] [instance: db58ccab-48e9-499e-a916-9a68709958d6] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:50:00 user devstack@n-api.service[61319]: DEBUG nova.policy [None req-15b6b973-f841-4997-b78f-c3e985e3ac43 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c67d90b6014d9ea24ef2552006bc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad84a0e014f47ddaeaddc88bf16b0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61319) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:50:00 user devstack@n-api.service[61319]: DEBUG nova.policy [None req-15b6b973-f841-4997-b78f-c3e985e3ac43 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c67d90b6014d9ea24ef2552006bc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad84a0e014f47ddaeaddc88bf16b0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61319) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:50:00 user devstack@n-api.service[61319]: DEBUG nova.policy [None req-15b6b973-f841-4997-b78f-c3e985e3ac43 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c67d90b6014d9ea24ef2552006bc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad84a0e014f47ddaeaddc88bf16b0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61319) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:50:00 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-15b6b973-f841-4997-b78f-c3e985e3ac43 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db58ccab-48e9-499e-a916-9a68709958d6" status: 200 len: 1395 microversion: 2.87 time: 0.099431 Apr 21 10:50:00 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 53/156] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 10:50:00 2023] GET /compute/v2.1/servers/db58ccab-48e9-499e-a916-9a68709958d6 => generated 1395 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 10:50:01 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-3791989e-9f91-48bd-a661-1e398cac6f95 tempest-VolumesSnapshotsTestJSON-1305297199 tempest-VolumesSnapshotsTestJSON-1305297199-project-member] Action: 'create', calling method: .version_select at 0x7f91a60a1f30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-134286023"}} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:50:01 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-3791989e-9f91-48bd-a661-1e398cac6f95 tempest-VolumesSnapshotsTestJSON-1305297199 tempest-VolumesSnapshotsTestJSON-1305297199-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.448553 Apr 21 10:50:01 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 54/157] 10.0.0.210 () {64 vars in 1232 bytes} [Fri Apr 21 10:50:01 2023] POST /compute/v2.1/os-volumes => generated 344 bytes in 451 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 21 10:50:01 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-a667fb0f-5b83-4f3c-9894-c8806862256f tempest-VolumesSnapshotsTestJSON-1305297199 tempest-VolumesSnapshotsTestJSON-1305297199-project-member] Calling method '.version_select at 0x7f91a61eeb90>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:50:01 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-a667fb0f-5b83-4f3c-9894-c8806862256f tempest-VolumesSnapshotsTestJSON-1305297199 tempest-VolumesSnapshotsTestJSON-1305297199-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/2f56f2f6-a380-4f7a-9623-6464da37f03c" status: 200 len: 341 microversion: 2.1 time: 0.050002 Apr 21 10:50:01 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 51/158] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 21 10:50:01 2023] GET /compute/v2.1/os-volumes/2f56f2f6-a380-4f7a-9623-6464da37f03c => generated 341 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:50:02 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-34ef2616-671a-4141-8205-409cd7d13007 tempest-VolumesSnapshotsTestJSON-1305297199 tempest-VolumesSnapshotsTestJSON-1305297199-project-member] Calling method '.version_select at 0x7f91a5f115a0>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:50:02 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-34ef2616-671a-4141-8205-409cd7d13007 tempest-VolumesSnapshotsTestJSON-1305297199 tempest-VolumesSnapshotsTestJSON-1305297199-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/2f56f2f6-a380-4f7a-9623-6464da37f03c" status: 200 len: 341 microversion: 2.1 time: 0.045989 Apr 21 10:50:02 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 54/159] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 21 10:50:02 2023] GET /compute/v2.1/os-volumes/2f56f2f6-a380-4f7a-9623-6464da37f03c => generated 341 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:50:02 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-d6121194-2f8e-4d9a-ad3c-254e5dc86063 tempest-VolumesSnapshotsTestJSON-1305297199 tempest-VolumesSnapshotsTestJSON-1305297199-project-member] Calling method '.version_select at 0x7f91a5d44ee0>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:50:02 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-d6121194-2f8e-4d9a-ad3c-254e5dc86063 tempest-VolumesSnapshotsTestJSON-1305297199 tempest-VolumesSnapshotsTestJSON-1305297199-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/2f56f2f6-a380-4f7a-9623-6464da37f03c" status: 202 len: 0 microversion: 2.1 time: 0.113992 Apr 21 10:50:02 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 55/160] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 21 10:50:02 2023] DELETE /compute/v2.1/os-volumes/2f56f2f6-a380-4f7a-9623-6464da37f03c => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 10:50:02 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-253b6f62-38a8-491a-8830-2702ef9bc3fe tempest-VolumesSnapshotsTestJSON-1305297199 tempest-VolumesSnapshotsTestJSON-1305297199-project-member] Calling method '.version_select at 0x7f91a60db520>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:50:02 user devstack@n-api.service[61318]: INFO nova.api.openstack.wsgi [None req-253b6f62-38a8-491a-8830-2702ef9bc3fe tempest-VolumesSnapshotsTestJSON-1305297199 tempest-VolumesSnapshotsTestJSON-1305297199-project-member] HTTP exception thrown: Volume 2f56f2f6-a380-4f7a-9623-6464da37f03c could not be found. Apr 21 10:50:02 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-253b6f62-38a8-491a-8830-2702ef9bc3fe tempest-VolumesSnapshotsTestJSON-1305297199 tempest-VolumesSnapshotsTestJSON-1305297199-project-member] Request method failure captured: Apr 21 10:50:02 user devstack@n-api.service[61318]: request: GET /compute/v2.1/os-volumes/2f56f2f6-a380-4f7a-9623-6464da37f03c HTTP/1.1 Apr 21 10:50:02 user devstack@n-api.service[61318]: Accept: application/json Apr 21 10:50:02 user devstack@n-api.service[61318]: Accept-Encoding: identity Apr 21 10:50:02 user devstack@n-api.service[61318]: Connection: close Apr 21 10:50:02 user devstack@n-api.service[61318]: Content-Length: 0 Apr 21 10:50:02 user devstack@n-api.service[61318]: Content-Type: application/json Apr 21 10:50:02 user devstack@n-api.service[61318]: Host: 10.0.0.210 Apr 21 10:50:02 user devstack@n-api.service[61318]: Openstack-System-Scope: None Apr 21 10:50:02 user devstack@n-api.service[61318]: User-Agent: python-urllib3/1.26.15 Apr 21 10:50:02 user devstack@n-api.service[61318]: X-Auth-Token: gAAAAABkQmpZc4TIi1iZSln7RisXOzRV7y1MjDiwjzlO9_TmKch3ggvg2itdTtxBBo5i3pAkXSzZxo7-9g3_ja2EVhDOTdSiruiCUcBhgZB3m9W4iLvKsY8dthXksm8oStTNZVWSwhgPxDdskRCrLH5KDqZhGEmaVPtoDSbJqSk4nEdOnpdkgo0 Apr 21 10:50:02 user devstack@n-api.service[61318]: X-Domain-Id: None Apr 21 10:50:02 user devstack@n-api.service[61318]: X-Domain-Name: None Apr 21 10:50:02 user devstack@n-api.service[61318]: X-Identity-Status: Confirmed Apr 21 10:50:02 user devstack@n-api.service[61318]: X-Is-Admin-Project: True Apr 21 10:50:02 user devstack@n-api.service[61318]: X-Project-Domain-Id: default Apr 21 10:50:02 user devstack@n-api.service[61318]: X-Project-Domain-Name: Default Apr 21 10:50:02 user devstack@n-api.service[61318]: X-Project-Id: c1ab08452c17424299eab9b9d722ad74 Apr 21 10:50:02 user devstack@n-api.service[61318]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1305297199 Apr 21 10:50:02 user devstack@n-api.service[61318]: X-Role: reader,member Apr 21 10:50:02 user devstack@n-api.service[61318]: X-Roles: reader,member Apr 21 10:50:02 user devstack@n-api.service[61318]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c1ab08452c17424299eab9b9d722ad74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1ab08452c17424299eab9b9d722ad74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1ab08452c17424299eab9b9d722ad74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 10:50:02 user devstack@n-api.service[61318]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1305297199 Apr 21 10:50:02 user devstack@n-api.service[61318]: X-Tenant-Id: c1ab08452c17424299eab9b9d722ad74 Apr 21 10:50:02 user devstack@n-api.service[61318]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1305297199 Apr 21 10:50:02 user devstack@n-api.service[61318]: X-User: tempest-VolumesSnapshotsTestJSON-1305297199-project-member Apr 21 10:50:02 user devstack@n-api.service[61318]: X-User-Domain-Id: default Apr 21 10:50:02 user devstack@n-api.service[61318]: X-User-Domain-Name: Default Apr 21 10:50:02 user devstack@n-api.service[61318]: X-User-Id: 506a78a9e31e42568d62a84f73c6d146 Apr 21 10:50:02 user devstack@n-api.service[61318]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1305297199-project-member Apr 21 10:50:02 user devstack@n-api.service[61318]: method: Apr 21 10:50:02 user devstack@n-api.service[61318]: exception: Volume 2f56f2f6-a380-4f7a-9623-6464da37f03c could not be found. Apr 21 10:50:02 user devstack@n-api.service[61318]: action_args: {'id': '2f56f2f6-a380-4f7a-9623-6464da37f03c'} Apr 21 10:50:02 user devstack@n-api.service[61318]: {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2f56f2f6-a380-4f7a-9623-6464da37f03c could not be found. (HTTP 404) (Request-ID: req-a5266a0c-fa32-4be1-a40d-0088c102759c) Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2f56f2f6-a380-4f7a-9623-6464da37f03c could not be found. Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2f56f2f6-a380-4f7a-9623-6464da37f03c could not be found. Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2f56f2f6-a380-4f7a-9623-6464da37f03c could not be found. Apr 21 10:50:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:50:02 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-253b6f62-38a8-491a-8830-2702ef9bc3fe tempest-VolumesSnapshotsTestJSON-1305297199 tempest-VolumesSnapshotsTestJSON-1305297199-project-member] Returning 404 to user: Volume 2f56f2f6-a380-4f7a-9623-6464da37f03c could not be found. {{(pid=61318) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 10:50:02 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-253b6f62-38a8-491a-8830-2702ef9bc3fe tempest-VolumesSnapshotsTestJSON-1305297199 tempest-VolumesSnapshotsTestJSON-1305297199-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/2f56f2f6-a380-4f7a-9623-6464da37f03c" status: 404 len: 109 microversion: 2.1 time: 0.032626 Apr 21 10:50:02 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 52/161] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 21 10:50:02 2023] GET /compute/v2.1/os-volumes/2f56f2f6-a380-4f7a-9623-6464da37f03c => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 10:50:02 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-b333006f-d989-4c22-b5e4-ecf480249621 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Calling method '.version_select at 0x7f91a5fe0dc0>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:50:02 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-b333006f-d989-4c22-b5e4-ecf480249621 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] 10.0.0.210 "GET /compute/v2.1/images/3c3de79a-9b9a-4806-a09d-d95df36a6231" status: 200 len: 1723 microversion: 2.1 time: 0.057513 Apr 21 10:50:02 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 55/162] 10.0.0.210 () {62 vars in 1310 bytes} [Fri Apr 21 10:50:02 2023] GET /compute/v2.1/images/3c3de79a-9b9a-4806-a09d-d95df36a6231 => generated 1723 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:50:02 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-3ca20bb1-2402-4418-9aa4-8c58bcfa2676 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Calling method '.version_select at 0x7f91a5e2b880>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:50:02 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-3ca20bb1-2402-4418-9aa4-8c58bcfa2676 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] 10.0.0.210 "GET /compute/v2.1/images/3c3de79a-9b9a-4806-a09d-d95df36a6231" status: 200 len: 1723 microversion: 2.1 time: 0.062169 Apr 21 10:50:02 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 56/163] 10.0.0.210 () {62 vars in 1310 bytes} [Fri Apr 21 10:50:02 2023] GET /compute/v2.1/images/3c3de79a-9b9a-4806-a09d-d95df36a6231 => generated 1723 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:50:02 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-565179ef-4806-4d0d-a147-63f4c286fe25 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:50:02 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-565179ef-4806-4d0d-a147-63f4c286fe25 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] [instance: 15bf9321-a92e-4be2-bcae-a943988c811a] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:50:02 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-565179ef-4806-4d0d-a147-63f4c286fe25 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:50:02 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-565179ef-4806-4d0d-a147-63f4c286fe25 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:50:02 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-565179ef-4806-4d0d-a147-63f4c286fe25 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:50:02 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-565179ef-4806-4d0d-a147-63f4c286fe25 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:50:02 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-565179ef-4806-4d0d-a147-63f4c286fe25 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:50:02 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-565179ef-4806-4d0d-a147-63f4c286fe25 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:50:03 user devstack@n-api.service[61318]: DEBUG nova.policy [None req-565179ef-4806-4d0d-a147-63f4c286fe25 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd172d648a9474db082646a47a2840214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdd7a4ccfc340aa9c1b02c57f7a0e70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61318) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:50:03 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-565179ef-4806-4d0d-a147-63f4c286fe25 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15bf9321-a92e-4be2-bcae-a943988c811a" status: 200 len: 1671 microversion: 2.1 time: 0.244968 Apr 21 10:50:03 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 53/164] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:50:02 2023] GET /compute/v2.1/servers/15bf9321-a92e-4be2-bcae-a943988c811a => generated 1671 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:50:03 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-29bea600-7a0f-4fad-a1f7-100925bee254 req-76a70043-db9a-482d-a106-f8d276256492 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db58ccab-48e9-499e-a916-9a68709958d6", "tag": "8df080a4-e60b-4b0e-92c5-4059d9fc6e3b"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:50:03 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-29bea600-7a0f-4fad-a1f7-100925bee254 req-76a70043-db9a-482d-a106-f8d276256492 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:50:03 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-29bea600-7a0f-4fad-a1f7-100925bee254 req-76a70043-db9a-482d-a106-f8d276256492 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:50:03 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-29bea600-7a0f-4fad-a1f7-100925bee254 req-76a70043-db9a-482d-a106-f8d276256492 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:50:03 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-29bea600-7a0f-4fad-a1f7-100925bee254 req-76a70043-db9a-482d-a106-f8d276256492 service nova] Creating event network-changed:8df080a4-e60b-4b0e-92c5-4059d9fc6e3b for instance db58ccab-48e9-499e-a916-9a68709958d6 on user Apr 21 10:50:03 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-29bea600-7a0f-4fad-a1f7-100925bee254 req-76a70043-db9a-482d-a106-f8d276256492 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030680 Apr 21 10:50:03 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 56/165] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:50:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:50:03 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-9078c440-59bb-4ca4-9313-b94a75877c28 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:50:03 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-9078c440-59bb-4ca4-9313-b94a75877c28 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] [instance: dd4d15a1-3a71-49e8-9851-9b49fec6a9e3] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:50:03 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-9078c440-59bb-4ca4-9313-b94a75877c28 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:50:03 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-9078c440-59bb-4ca4-9313-b94a75877c28 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:50:03 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-9078c440-59bb-4ca4-9313-b94a75877c28 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:50:03 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-9078c440-59bb-4ca4-9313-b94a75877c28 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:50:03 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-9078c440-59bb-4ca4-9313-b94a75877c28 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:50:03 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-9078c440-59bb-4ca4-9313-b94a75877c28 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:50:03 user devstack@n-api.service[61320]: INFO nova.api.openstack.wsgi [None req-9078c440-59bb-4ca4-9313-b94a75877c28 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] HTTP exception thrown: Instance dd4d15a1-3a71-49e8-9851-9b49fec6a9e3 could not be found. Apr 21 10:50:03 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-9078c440-59bb-4ca4-9313-b94a75877c28 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Request method failure captured: Apr 21 10:50:03 user devstack@n-api.service[61320]: request: GET /compute/v2.1/servers/dd4d15a1-3a71-49e8-9851-9b49fec6a9e3 HTTP/1.1 Apr 21 10:50:03 user devstack@n-api.service[61320]: Accept: application/json Apr 21 10:50:03 user devstack@n-api.service[61320]: Accept-Encoding: identity Apr 21 10:50:03 user devstack@n-api.service[61320]: Connection: close Apr 21 10:50:03 user devstack@n-api.service[61320]: Content-Length: 0 Apr 21 10:50:03 user devstack@n-api.service[61320]: Content-Type: application/json Apr 21 10:50:03 user devstack@n-api.service[61320]: Host: 10.0.0.210 Apr 21 10:50:03 user devstack@n-api.service[61320]: Openstack-System-Scope: None Apr 21 10:50:03 user devstack@n-api.service[61320]: User-Agent: python-urllib3/1.26.15 Apr 21 10:50:03 user devstack@n-api.service[61320]: X-Auth-Token: gAAAAABkQmmyoE94UhD7aOixNrzW5yWikQ9y3hf2iosOIcXd7YsrsXqnlxo0mLQnqv7Of5EM3jI9XC--6NTXguwTRjQvkx0EPZfaTtvPbHiP73WhTdRnGF7d1x0ywEQ9qMZFiVxsYPEIMR8PvzYiva5U8OAomeYoIOQ2rw41jxexff99JZutboE Apr 21 10:50:03 user devstack@n-api.service[61320]: X-Domain-Id: None Apr 21 10:50:03 user devstack@n-api.service[61320]: X-Domain-Name: None Apr 21 10:50:03 user devstack@n-api.service[61320]: X-Identity-Status: Confirmed Apr 21 10:50:03 user devstack@n-api.service[61320]: X-Is-Admin-Project: True Apr 21 10:50:03 user devstack@n-api.service[61320]: X-Project-Domain-Id: default Apr 21 10:50:03 user devstack@n-api.service[61320]: X-Project-Domain-Name: Default Apr 21 10:50:03 user devstack@n-api.service[61320]: X-Project-Id: d85f51547e5244e495343281725fe320 Apr 21 10:50:03 user devstack@n-api.service[61320]: X-Project-Name: tempest-AttachVolumeTestJSON-2130575493 Apr 21 10:50:03 user devstack@n-api.service[61320]: X-Role: reader,member Apr 21 10:50:03 user devstack@n-api.service[61320]: X-Roles: reader,member Apr 21 10:50:03 user devstack@n-api.service[61320]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d85f51547e5244e495343281725fe320"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d85f51547e5244e495343281725fe320"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d85f51547e5244e495343281725fe320"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 10:50:03 user devstack@n-api.service[61320]: X-Tenant: tempest-AttachVolumeTestJSON-2130575493 Apr 21 10:50:03 user devstack@n-api.service[61320]: X-Tenant-Id: d85f51547e5244e495343281725fe320 Apr 21 10:50:03 user devstack@n-api.service[61320]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2130575493 Apr 21 10:50:03 user devstack@n-api.service[61320]: X-User: tempest-AttachVolumeTestJSON-2130575493-project-member Apr 21 10:50:03 user devstack@n-api.service[61320]: X-User-Domain-Id: default Apr 21 10:50:03 user devstack@n-api.service[61320]: X-User-Domain-Name: Default Apr 21 10:50:03 user devstack@n-api.service[61320]: X-User-Id: 25fb0d890b594080bb1bb99dd6294ff1 Apr 21 10:50:03 user devstack@n-api.service[61320]: X-User-Name: tempest-AttachVolumeTestJSON-2130575493-project-member Apr 21 10:50:03 user devstack@n-api.service[61320]: method: > Apr 21 10:50:03 user devstack@n-api.service[61320]: exception: Instance dd4d15a1-3a71-49e8-9851-9b49fec6a9e3 could not be found. Apr 21 10:50:03 user devstack@n-api.service[61320]: action_args: {'id': 'dd4d15a1-3a71-49e8-9851-9b49fec6a9e3'} Apr 21 10:50:03 user devstack@n-api.service[61320]: {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 10:50:03 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:50:03 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 10:50:03 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 10:50:03 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 10:50:03 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 10:50:03 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 10:50:03 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 10:50:03 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 10:50:03 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 10:50:03 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd4d15a1-3a71-49e8-9851-9b49fec6a9e3 could not be found. Apr 21 10:50:03 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:50:03 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:50:03 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:50:03 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:50:03 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 10:50:03 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 10:50:03 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 10:50:03 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 10:50:03 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 10:50:03 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 10:50:03 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 10:50:03 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 10:50:03 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 10:50:03 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 10:50:03 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 10:50:03 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 10:50:03 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd4d15a1-3a71-49e8-9851-9b49fec6a9e3 could not be found. Apr 21 10:50:03 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:50:03 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:50:03 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:50:03 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:50:03 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 10:50:03 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 10:50:03 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 10:50:03 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 10:50:03 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd4d15a1-3a71-49e8-9851-9b49fec6a9e3 could not be found. Apr 21 10:50:03 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:50:03 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-9078c440-59bb-4ca4-9313-b94a75877c28 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Returning 404 to user: Instance dd4d15a1-3a71-49e8-9851-9b49fec6a9e3 could not be found. {{(pid=61320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 10:50:03 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-9078c440-59bb-4ca4-9313-b94a75877c28 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dd4d15a1-3a71-49e8-9851-9b49fec6a9e3" status: 404 len: 111 microversion: 2.1 time: 0.026062 Apr 21 10:50:03 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 57/166] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:50:03 2023] GET /compute/v2.1/servers/dd4d15a1-3a71-49e8-9851-9b49fec6a9e3 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 10:50:03 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-1c84cbfe-9a7b-45ac-9b8e-5c6fc794a471 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Calling method '.version_select at 0x7f91a60d89d0>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:50:03 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-1c84cbfe-9a7b-45ac-9b8e-5c6fc794a471 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-495885922" status: 202 len: 0 microversion: 2.1 time: 0.022882 Apr 21 10:50:03 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 54/167] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 21 10:50:03 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-495885922 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 10:50:04 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-ee3a1024-6d74-4f22-8219-b0bbc0a3fb69 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Action: 'create', calling method: .version_select at 0x7f91a69c1d80>, body: {"keypair": {"name": "tempest-keypair-950390145", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4Me401imS8FOFYXCWEtUHYjBl+nNDFDOEp9F0qU3EcEjNmrofO3LBhufyQq8+T19fUEnsB1kP8hSrvs1kB/Y0kxUe6+elfuW9GrNxUHrtfrboj4/KWC2DfC017u1bvqA=="}} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:50:04 user devstack@n-api.service[61319]: DEBUG nova.quota [None req-ee3a1024-6d74-4f22-8219-b0bbc0a3fb69 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Getting quotas for project d85f51547e5244e495343281725fe320. Resources: {'key_pairs'} {{(pid=61319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 10:50:04 user devstack@n-api.service[61319]: DEBUG nova.quota [None req-ee3a1024-6d74-4f22-8219-b0bbc0a3fb69 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Getting quotas for user 25fb0d890b594080bb1bb99dd6294ff1 and project d85f51547e5244e495343281725fe320. Resources: {'key_pairs'} {{(pid=61319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 10:50:04 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-ee3a1024-6d74-4f22-8219-b0bbc0a3fb69 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045556 Apr 21 10:50:04 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 57/168] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 21 10:50:04 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:50:05 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [req-beb27500-a528-426f-bccc-b6f5546ae220 req-302228a8-0ad0-465c-ad7f-7b4c8ff1b104 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db58ccab-48e9-499e-a916-9a68709958d6", "name": "network-vif-deleted", "tag": "8df080a4-e60b-4b0e-92c5-4059d9fc6e3b"}]} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:50:05 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-beb27500-a528-426f-bccc-b6f5546ae220 req-302228a8-0ad0-465c-ad7f-7b4c8ff1b104 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:50:05 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-beb27500-a528-426f-bccc-b6f5546ae220 req-302228a8-0ad0-465c-ad7f-7b4c8ff1b104 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:50:05 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-beb27500-a528-426f-bccc-b6f5546ae220 req-302228a8-0ad0-465c-ad7f-7b4c8ff1b104 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:50:05 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.compute.server_external_events [req-beb27500-a528-426f-bccc-b6f5546ae220 req-302228a8-0ad0-465c-ad7f-7b4c8ff1b104 service nova] Unable to find a host for instance db58ccab-48e9-499e-a916-9a68709958d6. Dropping event network-vif-deleted {{(pid=61320) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 21 10:50:05 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [req-beb27500-a528-426f-bccc-b6f5546ae220 req-302228a8-0ad0-465c-ad7f-7b4c8ff1b104 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.024798 Apr 21 10:50:05 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 58/169] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:50:05 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 21 10:50:06 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-95bdc197-fce9-43d7-a48c-1aedf2e7c9a8 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-778341132", "imageRef": "3b29a01a-1fc0-4d0d-89fb-23d22b2de02e", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "b24b52ac-b8ab-493e-994c-c38d7c5c7089"}], "security_groups": [{"name": "tempest-securitygroup--381025125"}], "key_name": "tempest-keypair-950390145", "user_data": "}} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:50:06 user devstack@n-api.service[61318]: DEBUG nova.network.neutron [None req-95bdc197-fce9-43d7-a48c-1aedf2e7c9a8 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] validate_networks() for [('b24b52ac-b8ab-493e-994c-c38d7c5c7089', None, None, None, None, None)] {{(pid=61318) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 10:50:06 user devstack@n-api.service[61318]: DEBUG nova.virt.hardware [None req-95bdc197-fce9-43d7-a48c-1aedf2e7c9a8 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Flavor limits 0:0:0 {{(pid=61318) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 10:50:06 user devstack@n-api.service[61318]: DEBUG nova.virt.hardware [None req-95bdc197-fce9-43d7-a48c-1aedf2e7c9a8 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Image limits 0:0:0 {{(pid=61318) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 10:50:06 user devstack@n-api.service[61318]: DEBUG nova.virt.hardware [None req-95bdc197-fce9-43d7-a48c-1aedf2e7c9a8 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Flavor pref 0:0:0 {{(pid=61318) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 10:50:06 user devstack@n-api.service[61318]: DEBUG nova.virt.hardware [None req-95bdc197-fce9-43d7-a48c-1aedf2e7c9a8 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Image pref 0:0:0 {{(pid=61318) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 10:50:06 user devstack@n-api.service[61318]: DEBUG nova.virt.hardware [None req-95bdc197-fce9-43d7-a48c-1aedf2e7c9a8 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61318) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 10:50:06 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-95bdc197-fce9-43d7-a48c-1aedf2e7c9a8 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:50:06 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-95bdc197-fce9-43d7-a48c-1aedf2e7c9a8 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:50:06 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-95bdc197-fce9-43d7-a48c-1aedf2e7c9a8 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:50:06 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-95bdc197-fce9-43d7-a48c-1aedf2e7c9a8 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:50:06 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-95bdc197-fce9-43d7-a48c-1aedf2e7c9a8 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:50:06 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-95bdc197-fce9-43d7-a48c-1aedf2e7c9a8 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:50:06 user devstack@n-api.service[61318]: DEBUG nova.quota [None req-95bdc197-fce9-43d7-a48c-1aedf2e7c9a8 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Getting quotas for project d85f51547e5244e495343281725fe320. Resources: {'cores', 'instances', 'ram'} {{(pid=61318) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 10:50:06 user devstack@n-api.service[61318]: DEBUG nova.quota [None req-95bdc197-fce9-43d7-a48c-1aedf2e7c9a8 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Getting quotas for user 25fb0d890b594080bb1bb99dd6294ff1 and project d85f51547e5244e495343281725fe320. Resources: {'cores', 'instances', 'ram'} {{(pid=61318) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 10:50:06 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-95bdc197-fce9-43d7-a48c-1aedf2e7c9a8 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Going to run 1 instances... {{(pid=61318) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 10:50:06 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-95bdc197-fce9-43d7-a48c-1aedf2e7c9a8 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] [instance: 566040e7-8140-467b-b814-8d7eb62ef735] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3b29a01a-1fc0-4d0d-89fb-23d22b2de02e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61318) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 10:50:06 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-95bdc197-fce9-43d7-a48c-1aedf2e7c9a8 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.593007 Apr 21 10:50:06 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 55/170] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 10:50:06 2023] POST /compute/v2.1/servers => generated 399 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 10:50:06 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-546b1916-57d8-4a3c-b11e-a576a33473f2 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:50:06 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-546b1916-57d8-4a3c-b11e-a576a33473f2 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] [instance: 566040e7-8140-467b-b814-8d7eb62ef735] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:50:06 user devstack@n-api.service[61319]: DEBUG nova.policy [None req-546b1916-57d8-4a3c-b11e-a576a33473f2 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fb0d890b594080bb1bb99dd6294ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd85f51547e5244e495343281725fe320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61319) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:50:06 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-546b1916-57d8-4a3c-b11e-a576a33473f2 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] 10.0.0.210 "GET /compute/v2.1/servers/566040e7-8140-467b-b814-8d7eb62ef735" status: 200 len: 1230 microversion: 2.1 time: 0.062725 Apr 21 10:50:06 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 58/171] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:50:06 2023] GET /compute/v2.1/servers/566040e7-8140-467b-b814-8d7eb62ef735 => generated 1230 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:50:09 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [req-6c681de5-b08b-48c8-9f9f-11de0aa5bc5f req-5bcf55ed-c989-4ab1-9e68-4cea5891ae10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "566040e7-8140-467b-b814-8d7eb62ef735", "tag": "69a7ef96-ead5-4890-a014-d86e90fa5050"}]} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:50:09 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-6c681de5-b08b-48c8-9f9f-11de0aa5bc5f req-5bcf55ed-c989-4ab1-9e68-4cea5891ae10 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:50:09 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-6c681de5-b08b-48c8-9f9f-11de0aa5bc5f req-5bcf55ed-c989-4ab1-9e68-4cea5891ae10 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:50:09 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-6c681de5-b08b-48c8-9f9f-11de0aa5bc5f req-5bcf55ed-c989-4ab1-9e68-4cea5891ae10 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:50:09 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-6c681de5-b08b-48c8-9f9f-11de0aa5bc5f req-5bcf55ed-c989-4ab1-9e68-4cea5891ae10 service nova] Creating event network-changed:69a7ef96-ead5-4890-a014-d86e90fa5050 for instance 566040e7-8140-467b-b814-8d7eb62ef735 on user Apr 21 10:50:09 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [req-6c681de5-b08b-48c8-9f9f-11de0aa5bc5f req-5bcf55ed-c989-4ab1-9e68-4cea5891ae10 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028857 Apr 21 10:50:09 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 59/172] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:50:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:50:10 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-1c163a2d-a622-449c-b045-ca75681dca38 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:50:10 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-1c163a2d-a622-449c-b045-ca75681dca38 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] [instance: aecf1ba8-9675-4535-874b-9084361b7693] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:50:10 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-1c163a2d-a622-449c-b045-ca75681dca38 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:50:10 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-1c163a2d-a622-449c-b045-ca75681dca38 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:50:10 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-1c163a2d-a622-449c-b045-ca75681dca38 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:50:10 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-1c163a2d-a622-449c-b045-ca75681dca38 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:50:10 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-1c163a2d-a622-449c-b045-ca75681dca38 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:50:10 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-1c163a2d-a622-449c-b045-ca75681dca38 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:50:10 user devstack@n-api.service[61318]: INFO nova.api.openstack.wsgi [None req-1c163a2d-a622-449c-b045-ca75681dca38 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] HTTP exception thrown: Instance aecf1ba8-9675-4535-874b-9084361b7693 could not be found. Apr 21 10:50:10 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-1c163a2d-a622-449c-b045-ca75681dca38 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Request method failure captured: Apr 21 10:50:10 user devstack@n-api.service[61318]: request: GET /compute/v2.1/servers/aecf1ba8-9675-4535-874b-9084361b7693 HTTP/1.1 Apr 21 10:50:10 user devstack@n-api.service[61318]: Accept: application/json Apr 21 10:50:10 user devstack@n-api.service[61318]: Accept-Encoding: identity Apr 21 10:50:10 user devstack@n-api.service[61318]: Connection: close Apr 21 10:50:10 user devstack@n-api.service[61318]: Content-Length: 0 Apr 21 10:50:10 user devstack@n-api.service[61318]: Content-Type: application/json Apr 21 10:50:10 user devstack@n-api.service[61318]: Host: 10.0.0.210 Apr 21 10:50:10 user devstack@n-api.service[61318]: Openstack-System-Scope: None Apr 21 10:50:10 user devstack@n-api.service[61318]: User-Agent: python-urllib3/1.26.15 Apr 21 10:50:10 user devstack@n-api.service[61318]: X-Auth-Token: gAAAAABkQmmiG3176Xs6KfeblcsFXneYW0BdcBCuNzgM9GAnVY1f4ON0jAsvp9vlBUcLPoM8tDwPbluB1UVqQxSOR6vuOZYoA-2lkGlGFK7_a-7zBrIHAOEa1KeXTDMCs3H6X1iJj4lHLiiZgGwmzZiF6eyHrrPyodkpuo9q6DZlGY0obUs1kTM Apr 21 10:50:10 user devstack@n-api.service[61318]: X-Domain-Id: None Apr 21 10:50:10 user devstack@n-api.service[61318]: X-Domain-Name: None Apr 21 10:50:10 user devstack@n-api.service[61318]: X-Identity-Status: Confirmed Apr 21 10:50:10 user devstack@n-api.service[61318]: X-Is-Admin-Project: True Apr 21 10:50:10 user devstack@n-api.service[61318]: X-Project-Domain-Id: default Apr 21 10:50:10 user devstack@n-api.service[61318]: X-Project-Domain-Name: Default Apr 21 10:50:10 user devstack@n-api.service[61318]: X-Project-Id: a3d2c4f2fb9f45559c4e51e86339a0e0 Apr 21 10:50:10 user devstack@n-api.service[61318]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1586367620 Apr 21 10:50:10 user devstack@n-api.service[61318]: X-Role: reader,member Apr 21 10:50:10 user devstack@n-api.service[61318]: X-Roles: reader,member Apr 21 10:50:10 user devstack@n-api.service[61318]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a3d2c4f2fb9f45559c4e51e86339a0e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a3d2c4f2fb9f45559c4e51e86339a0e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a3d2c4f2fb9f45559c4e51e86339a0e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 10:50:10 user devstack@n-api.service[61318]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1586367620 Apr 21 10:50:10 user devstack@n-api.service[61318]: X-Tenant-Id: a3d2c4f2fb9f45559c4e51e86339a0e0 Apr 21 10:50:10 user devstack@n-api.service[61318]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1586367620 Apr 21 10:50:10 user devstack@n-api.service[61318]: X-User: tempest-AttachSCSIVolumeTestJSON-1586367620-project-member Apr 21 10:50:10 user devstack@n-api.service[61318]: X-User-Domain-Id: default Apr 21 10:50:10 user devstack@n-api.service[61318]: X-User-Domain-Name: Default Apr 21 10:50:10 user devstack@n-api.service[61318]: X-User-Id: c0b1fae0fc8d4b9a998ab0679bace1a1 Apr 21 10:50:10 user devstack@n-api.service[61318]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1586367620-project-member Apr 21 10:50:10 user devstack@n-api.service[61318]: method: > Apr 21 10:50:10 user devstack@n-api.service[61318]: exception: Instance aecf1ba8-9675-4535-874b-9084361b7693 could not be found. Apr 21 10:50:10 user devstack@n-api.service[61318]: action_args: {'id': 'aecf1ba8-9675-4535-874b-9084361b7693'} Apr 21 10:50:10 user devstack@n-api.service[61318]: {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 10:50:10 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:50:10 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 10:50:10 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 10:50:10 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 10:50:10 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 10:50:10 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 10:50:10 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 10:50:10 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 10:50:10 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 10:50:10 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aecf1ba8-9675-4535-874b-9084361b7693 could not be found. Apr 21 10:50:10 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:50:10 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:50:10 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:50:10 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:50:10 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 10:50:10 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 10:50:10 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 10:50:10 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 10:50:10 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 10:50:10 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 10:50:10 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 10:50:10 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 10:50:10 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 10:50:10 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 10:50:10 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 10:50:10 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 10:50:10 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aecf1ba8-9675-4535-874b-9084361b7693 could not be found. Apr 21 10:50:10 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:50:10 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:50:10 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:50:10 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:50:10 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 10:50:10 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 10:50:10 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 10:50:10 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 10:50:10 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aecf1ba8-9675-4535-874b-9084361b7693 could not be found. Apr 21 10:50:10 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:50:10 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-1c163a2d-a622-449c-b045-ca75681dca38 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Returning 404 to user: Instance aecf1ba8-9675-4535-874b-9084361b7693 could not be found. {{(pid=61318) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 10:50:10 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-1c163a2d-a622-449c-b045-ca75681dca38 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aecf1ba8-9675-4535-874b-9084361b7693" status: 404 len: 111 microversion: 2.1 time: 0.039772 Apr 21 10:50:10 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 56/173] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:50:10 2023] GET /compute/v2.1/servers/aecf1ba8-9675-4535-874b-9084361b7693 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 10:50:10 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-4c9354a7-c86d-4f13-be95-4aa4d8114979 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Calling method '.version_select at 0x7f91a5f10a60>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:50:10 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-4c9354a7-c86d-4f13-be95-4aa4d8114979 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-538215549" status: 202 len: 0 microversion: 2.1 time: 0.023293 Apr 21 10:50:10 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 59/174] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 21 10:50:10 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-538215549 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 10:50:11 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [req-9d443264-ad9a-4e85-b941-f123e584a239 req-d8eff175-2c03-4109-8516-2168e3096ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "566040e7-8140-467b-b814-8d7eb62ef735", "name": "network-vif-plugged", "status": "completed", "tag": "69a7ef96-ead5-4890-a014-d86e90fa5050"}]} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:50:11 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-9d443264-ad9a-4e85-b941-f123e584a239 req-d8eff175-2c03-4109-8516-2168e3096ce7 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:50:11 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-9d443264-ad9a-4e85-b941-f123e584a239 req-d8eff175-2c03-4109-8516-2168e3096ce7 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:50:11 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-9d443264-ad9a-4e85-b941-f123e584a239 req-d8eff175-2c03-4109-8516-2168e3096ce7 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:50:11 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-9d443264-ad9a-4e85-b941-f123e584a239 req-d8eff175-2c03-4109-8516-2168e3096ce7 service nova] Creating event network-vif-plugged:69a7ef96-ead5-4890-a014-d86e90fa5050 for instance 566040e7-8140-467b-b814-8d7eb62ef735 on user Apr 21 10:50:11 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [req-9d443264-ad9a-4e85-b941-f123e584a239 req-d8eff175-2c03-4109-8516-2168e3096ce7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045995 Apr 21 10:50:11 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 60/175] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:50:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 10:50:11 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-c5eca0ed-ebf2-494b-90c8-149ec7b395a9 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:50:11 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-c5eca0ed-ebf2-494b-90c8-149ec7b395a9 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] [instance: aecf1ba8-9675-4535-874b-9084361b7693] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:50:11 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-c5eca0ed-ebf2-494b-90c8-149ec7b395a9 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:50:11 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-c5eca0ed-ebf2-494b-90c8-149ec7b395a9 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:50:11 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-c5eca0ed-ebf2-494b-90c8-149ec7b395a9 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:50:11 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-c5eca0ed-ebf2-494b-90c8-149ec7b395a9 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:50:11 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-c5eca0ed-ebf2-494b-90c8-149ec7b395a9 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:50:11 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-c5eca0ed-ebf2-494b-90c8-149ec7b395a9 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:50:11 user devstack@n-api.service[61318]: INFO nova.api.openstack.wsgi [None req-c5eca0ed-ebf2-494b-90c8-149ec7b395a9 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] HTTP exception thrown: Instance aecf1ba8-9675-4535-874b-9084361b7693 could not be found. Apr 21 10:50:11 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-c5eca0ed-ebf2-494b-90c8-149ec7b395a9 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Request method failure captured: Apr 21 10:50:11 user devstack@n-api.service[61318]: request: DELETE /compute/v2.1/servers/aecf1ba8-9675-4535-874b-9084361b7693 HTTP/1.1 Apr 21 10:50:11 user devstack@n-api.service[61318]: Accept: application/json Apr 21 10:50:11 user devstack@n-api.service[61318]: Accept-Encoding: identity Apr 21 10:50:11 user devstack@n-api.service[61318]: Connection: close Apr 21 10:50:11 user devstack@n-api.service[61318]: Content-Length: 0 Apr 21 10:50:11 user devstack@n-api.service[61318]: Content-Type: application/json Apr 21 10:50:11 user devstack@n-api.service[61318]: Host: 10.0.0.210 Apr 21 10:50:11 user devstack@n-api.service[61318]: Openstack-System-Scope: None Apr 21 10:50:11 user devstack@n-api.service[61318]: User-Agent: python-urllib3/1.26.15 Apr 21 10:50:11 user devstack@n-api.service[61318]: X-Auth-Token: gAAAAABkQmmiG3176Xs6KfeblcsFXneYW0BdcBCuNzgM9GAnVY1f4ON0jAsvp9vlBUcLPoM8tDwPbluB1UVqQxSOR6vuOZYoA-2lkGlGFK7_a-7zBrIHAOEa1KeXTDMCs3H6X1iJj4lHLiiZgGwmzZiF6eyHrrPyodkpuo9q6DZlGY0obUs1kTM Apr 21 10:50:11 user devstack@n-api.service[61318]: X-Domain-Id: None Apr 21 10:50:11 user devstack@n-api.service[61318]: X-Domain-Name: None Apr 21 10:50:11 user devstack@n-api.service[61318]: X-Identity-Status: Confirmed Apr 21 10:50:11 user devstack@n-api.service[61318]: X-Is-Admin-Project: True Apr 21 10:50:11 user devstack@n-api.service[61318]: X-Project-Domain-Id: default Apr 21 10:50:11 user devstack@n-api.service[61318]: X-Project-Domain-Name: Default Apr 21 10:50:11 user devstack@n-api.service[61318]: X-Project-Id: a3d2c4f2fb9f45559c4e51e86339a0e0 Apr 21 10:50:11 user devstack@n-api.service[61318]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1586367620 Apr 21 10:50:11 user devstack@n-api.service[61318]: X-Role: reader,member Apr 21 10:50:11 user devstack@n-api.service[61318]: X-Roles: reader,member Apr 21 10:50:11 user devstack@n-api.service[61318]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a3d2c4f2fb9f45559c4e51e86339a0e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a3d2c4f2fb9f45559c4e51e86339a0e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a3d2c4f2fb9f45559c4e51e86339a0e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 10:50:11 user devstack@n-api.service[61318]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1586367620 Apr 21 10:50:11 user devstack@n-api.service[61318]: X-Tenant-Id: a3d2c4f2fb9f45559c4e51e86339a0e0 Apr 21 10:50:11 user devstack@n-api.service[61318]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1586367620 Apr 21 10:50:11 user devstack@n-api.service[61318]: X-User: tempest-AttachSCSIVolumeTestJSON-1586367620-project-member Apr 21 10:50:11 user devstack@n-api.service[61318]: X-User-Domain-Id: default Apr 21 10:50:11 user devstack@n-api.service[61318]: X-User-Domain-Name: Default Apr 21 10:50:11 user devstack@n-api.service[61318]: X-User-Id: c0b1fae0fc8d4b9a998ab0679bace1a1 Apr 21 10:50:11 user devstack@n-api.service[61318]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1586367620-project-member Apr 21 10:50:11 user devstack@n-api.service[61318]: method: > Apr 21 10:50:11 user devstack@n-api.service[61318]: exception: Instance aecf1ba8-9675-4535-874b-9084361b7693 could not be found. Apr 21 10:50:11 user devstack@n-api.service[61318]: action_args: {'id': 'aecf1ba8-9675-4535-874b-9084361b7693'} Apr 21 10:50:11 user devstack@n-api.service[61318]: {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 10:50:11 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:50:11 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 10:50:11 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 10:50:11 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 10:50:11 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 10:50:11 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 10:50:11 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 10:50:11 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 10:50:11 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 10:50:11 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aecf1ba8-9675-4535-874b-9084361b7693 could not be found. Apr 21 10:50:11 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:50:11 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:50:11 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:50:11 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:50:11 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 10:50:11 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 10:50:11 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 10:50:11 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 10:50:11 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 10:50:11 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 10:50:11 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 21 10:50:11 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 21 10:50:11 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 21 10:50:11 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 21 10:50:11 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 10:50:11 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 10:50:11 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 10:50:11 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 10:50:11 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aecf1ba8-9675-4535-874b-9084361b7693 could not be found. Apr 21 10:50:11 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:50:11 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:50:11 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:50:11 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:50:11 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 10:50:11 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 10:50:11 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 10:50:11 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 10:50:11 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aecf1ba8-9675-4535-874b-9084361b7693 could not be found. Apr 21 10:50:11 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:50:11 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-c5eca0ed-ebf2-494b-90c8-149ec7b395a9 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Returning 404 to user: Instance aecf1ba8-9675-4535-874b-9084361b7693 could not be found. {{(pid=61318) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 10:50:11 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-c5eca0ed-ebf2-494b-90c8-149ec7b395a9 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/aecf1ba8-9675-4535-874b-9084361b7693" status: 404 len: 111 microversion: 2.1 time: 0.033806 Apr 21 10:50:11 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 57/176] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 10:50:11 2023] DELETE /compute/v2.1/servers/aecf1ba8-9675-4535-874b-9084361b7693 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 10:50:11 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-980a7fd0-beb5-4b3d-b33a-a8be11fda6c6 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:50:11 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-980a7fd0-beb5-4b3d-b33a-a8be11fda6c6 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] [instance: aecf1ba8-9675-4535-874b-9084361b7693] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:50:11 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-980a7fd0-beb5-4b3d-b33a-a8be11fda6c6 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:50:11 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-980a7fd0-beb5-4b3d-b33a-a8be11fda6c6 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:50:11 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-980a7fd0-beb5-4b3d-b33a-a8be11fda6c6 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:50:11 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-980a7fd0-beb5-4b3d-b33a-a8be11fda6c6 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:50:11 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-980a7fd0-beb5-4b3d-b33a-a8be11fda6c6 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:50:11 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-980a7fd0-beb5-4b3d-b33a-a8be11fda6c6 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:50:11 user devstack@n-api.service[61319]: INFO nova.api.openstack.wsgi [None req-980a7fd0-beb5-4b3d-b33a-a8be11fda6c6 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] HTTP exception thrown: Instance aecf1ba8-9675-4535-874b-9084361b7693 could not be found. Apr 21 10:50:11 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-980a7fd0-beb5-4b3d-b33a-a8be11fda6c6 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Request method failure captured: Apr 21 10:50:11 user devstack@n-api.service[61319]: request: GET /compute/v2.1/servers/aecf1ba8-9675-4535-874b-9084361b7693 HTTP/1.1 Apr 21 10:50:11 user devstack@n-api.service[61319]: Accept: application/json Apr 21 10:50:11 user devstack@n-api.service[61319]: Accept-Encoding: identity Apr 21 10:50:11 user devstack@n-api.service[61319]: Connection: close Apr 21 10:50:11 user devstack@n-api.service[61319]: Content-Length: 0 Apr 21 10:50:11 user devstack@n-api.service[61319]: Content-Type: application/json Apr 21 10:50:11 user devstack@n-api.service[61319]: Host: 10.0.0.210 Apr 21 10:50:11 user devstack@n-api.service[61319]: Openstack-System-Scope: None Apr 21 10:50:11 user devstack@n-api.service[61319]: User-Agent: python-urllib3/1.26.15 Apr 21 10:50:11 user devstack@n-api.service[61319]: X-Auth-Token: gAAAAABkQmmiG3176Xs6KfeblcsFXneYW0BdcBCuNzgM9GAnVY1f4ON0jAsvp9vlBUcLPoM8tDwPbluB1UVqQxSOR6vuOZYoA-2lkGlGFK7_a-7zBrIHAOEa1KeXTDMCs3H6X1iJj4lHLiiZgGwmzZiF6eyHrrPyodkpuo9q6DZlGY0obUs1kTM Apr 21 10:50:11 user devstack@n-api.service[61319]: X-Domain-Id: None Apr 21 10:50:11 user devstack@n-api.service[61319]: X-Domain-Name: None Apr 21 10:50:11 user devstack@n-api.service[61319]: X-Identity-Status: Confirmed Apr 21 10:50:11 user devstack@n-api.service[61319]: X-Is-Admin-Project: True Apr 21 10:50:11 user devstack@n-api.service[61319]: X-Project-Domain-Id: default Apr 21 10:50:11 user devstack@n-api.service[61319]: X-Project-Domain-Name: Default Apr 21 10:50:11 user devstack@n-api.service[61319]: X-Project-Id: a3d2c4f2fb9f45559c4e51e86339a0e0 Apr 21 10:50:11 user devstack@n-api.service[61319]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1586367620 Apr 21 10:50:11 user devstack@n-api.service[61319]: X-Role: reader,member Apr 21 10:50:11 user devstack@n-api.service[61319]: X-Roles: reader,member Apr 21 10:50:11 user devstack@n-api.service[61319]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a3d2c4f2fb9f45559c4e51e86339a0e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a3d2c4f2fb9f45559c4e51e86339a0e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a3d2c4f2fb9f45559c4e51e86339a0e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 10:50:11 user devstack@n-api.service[61319]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1586367620 Apr 21 10:50:11 user devstack@n-api.service[61319]: X-Tenant-Id: a3d2c4f2fb9f45559c4e51e86339a0e0 Apr 21 10:50:11 user devstack@n-api.service[61319]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1586367620 Apr 21 10:50:11 user devstack@n-api.service[61319]: X-User: tempest-AttachSCSIVolumeTestJSON-1586367620-project-member Apr 21 10:50:11 user devstack@n-api.service[61319]: X-User-Domain-Id: default Apr 21 10:50:11 user devstack@n-api.service[61319]: X-User-Domain-Name: Default Apr 21 10:50:11 user devstack@n-api.service[61319]: X-User-Id: c0b1fae0fc8d4b9a998ab0679bace1a1 Apr 21 10:50:11 user devstack@n-api.service[61319]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1586367620-project-member Apr 21 10:50:11 user devstack@n-api.service[61319]: method: > Apr 21 10:50:11 user devstack@n-api.service[61319]: exception: Instance aecf1ba8-9675-4535-874b-9084361b7693 could not be found. Apr 21 10:50:11 user devstack@n-api.service[61319]: action_args: {'id': 'aecf1ba8-9675-4535-874b-9084361b7693'} Apr 21 10:50:11 user devstack@n-api.service[61319]: {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 10:50:11 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:50:11 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 10:50:11 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 10:50:11 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 10:50:11 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 10:50:11 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 10:50:11 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 10:50:11 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 10:50:11 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 10:50:11 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aecf1ba8-9675-4535-874b-9084361b7693 could not be found. Apr 21 10:50:11 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:50:11 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:50:11 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:50:11 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:50:11 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 10:50:11 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 10:50:11 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 10:50:11 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 10:50:11 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 10:50:11 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 10:50:11 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 10:50:11 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 10:50:11 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 10:50:11 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 10:50:11 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 10:50:11 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 10:50:11 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aecf1ba8-9675-4535-874b-9084361b7693 could not be found. Apr 21 10:50:11 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:50:11 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:50:11 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:50:11 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:50:11 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 10:50:11 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 10:50:11 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 10:50:11 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 10:50:11 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aecf1ba8-9675-4535-874b-9084361b7693 could not be found. Apr 21 10:50:11 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:50:11 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-980a7fd0-beb5-4b3d-b33a-a8be11fda6c6 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] Returning 404 to user: Instance aecf1ba8-9675-4535-874b-9084361b7693 could not be found. {{(pid=61319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 10:50:11 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-980a7fd0-beb5-4b3d-b33a-a8be11fda6c6 tempest-AttachSCSIVolumeTestJSON-1586367620 tempest-AttachSCSIVolumeTestJSON-1586367620-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aecf1ba8-9675-4535-874b-9084361b7693" status: 404 len: 111 microversion: 2.1 time: 0.032834 Apr 21 10:50:11 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 60/177] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:50:11 2023] GET /compute/v2.1/servers/aecf1ba8-9675-4535-874b-9084361b7693 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 10:50:13 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [req-3ece06d3-0254-4803-bbfa-53e2886a0052 req-cb4fc0b5-0115-4f1f-a870-b56712f3c697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "566040e7-8140-467b-b814-8d7eb62ef735", "name": "network-vif-plugged", "status": "completed", "tag": "69a7ef96-ead5-4890-a014-d86e90fa5050"}]} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:50:13 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-3ece06d3-0254-4803-bbfa-53e2886a0052 req-cb4fc0b5-0115-4f1f-a870-b56712f3c697 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:50:13 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-3ece06d3-0254-4803-bbfa-53e2886a0052 req-cb4fc0b5-0115-4f1f-a870-b56712f3c697 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:50:13 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-3ece06d3-0254-4803-bbfa-53e2886a0052 req-cb4fc0b5-0115-4f1f-a870-b56712f3c697 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:50:13 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-3ece06d3-0254-4803-bbfa-53e2886a0052 req-cb4fc0b5-0115-4f1f-a870-b56712f3c697 service nova] Creating event network-vif-plugged:69a7ef96-ead5-4890-a014-d86e90fa5050 for instance 566040e7-8140-467b-b814-8d7eb62ef735 on user Apr 21 10:50:13 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [req-3ece06d3-0254-4803-bbfa-53e2886a0052 req-cb4fc0b5-0115-4f1f-a870-b56712f3c697 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028487 Apr 21 10:50:13 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 61/178] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:50:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:50:17 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-de2fc745-0dd1-4e31-89a5-cc3ef5061d01 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:50:17 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-de2fc745-0dd1-4e31-89a5-cc3ef5061d01 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] [instance: 3dd95a26-8652-40f5-b357-3cbc8a38628a] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:50:17 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell0:SELECT=4 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:50:17 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell0:SELECT=12 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:50:17 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-de2fc745-0dd1-4e31-89a5-cc3ef5061d01 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:50:17 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-de2fc745-0dd1-4e31-89a5-cc3ef5061d01 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:50:17 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-de2fc745-0dd1-4e31-89a5-cc3ef5061d01 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:50:17 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-de2fc745-0dd1-4e31-89a5-cc3ef5061d01 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:50:17 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-de2fc745-0dd1-4e31-89a5-cc3ef5061d01 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:50:17 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-de2fc745-0dd1-4e31-89a5-cc3ef5061d01 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:50:17 user devstack@n-api.service[61318]: DEBUG nova.policy [None req-de2fc745-0dd1-4e31-89a5-cc3ef5061d01 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c600e01acfe140cabcdfe54958e66108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e77e1735854e0c966c42e9a613017f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61318) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:50:17 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-de2fc745-0dd1-4e31-89a5-cc3ef5061d01 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3dd95a26-8652-40f5-b357-3cbc8a38628a" status: 200 len: 1495 microversion: 2.1 time: 0.375244 Apr 21 10:50:17 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 58/179] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:50:17 2023] GET /compute/v2.1/servers/3dd95a26-8652-40f5-b357-3cbc8a38628a => generated 1495 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:50:28 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-500de7c1-4316-487d-bf60-b5495f22dbca tempest-TestVolumeBootPattern-683980468 tempest-TestVolumeBootPattern-683980468-project-member] Action: 'create', calling method: .version_select at 0x7f91a5ec4820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-731505129", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOx2WsSUcwOMbZpJ1RF2bBGdixjWIvVfkvXfesTWeO8ghsBQxTpsft8PSC9X8t0g3FmWBU3GKatGO4XhLzyCYs5Ol8e33uOuV0/w5utfsb+6EE2YBvGdlveNMOF+nMIJ6Q=="}} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:50:28 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell0:SELECT=8 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:50:28 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:50:28 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell1:SELECT=18 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:50:28 user devstack@n-api.service[61319]: DEBUG nova.quota [None req-500de7c1-4316-487d-bf60-b5495f22dbca tempest-TestVolumeBootPattern-683980468 tempest-TestVolumeBootPattern-683980468-project-member] Getting quotas for project da057743ba534056beac9d18a3f5fc0e. Resources: {'key_pairs'} {{(pid=61319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 10:50:28 user devstack@n-api.service[61319]: DEBUG nova.quota [None req-500de7c1-4316-487d-bf60-b5495f22dbca tempest-TestVolumeBootPattern-683980468 tempest-TestVolumeBootPattern-683980468-project-member] Getting quotas for user 0285cc34e3854084abd318ef9a1da750 and project da057743ba534056beac9d18a3f5fc0e. Resources: {'key_pairs'} {{(pid=61319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 10:50:28 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-500de7c1-4316-487d-bf60-b5495f22dbca tempest-TestVolumeBootPattern-683980468 tempest-TestVolumeBootPattern-683980468-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.066930 Apr 21 10:50:28 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 61/180] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 21 10:50:28 2023] POST /compute/v2.1/os-keypairs => generated 399 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:50:31 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:50:31 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:50:31 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-7afe2d20-e320-432b-b347-3c1052c82f38 tempest-TestVolumeBootPattern-683980468 tempest-TestVolumeBootPattern-683980468-project-member] Calling method '.version_select at 0x7f91a5d44040>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:50:31 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-7afe2d20-e320-432b-b347-3c1052c82f38 tempest-TestVolumeBootPattern-683980468 tempest-TestVolumeBootPattern-683980468-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-731505129" status: 202 len: 0 microversion: 2.1 time: 0.030223 Apr 21 10:50:31 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 62/181] 10.0.0.210 () {62 vars in 1337 bytes} [Fri Apr 21 10:50:31 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-731505129 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 10:50:45 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-66e08b89-e047-4ac5-81b6-c604d441d5e0 tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:50:45 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-66e08b89-e047-4ac5-81b6-c604d441d5e0 tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] [instance: c3100b42-46b3-4371-89f2-e511ca1ce6cd] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:50:45 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:50:45 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell1:SELECT=30 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:50:45 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-66e08b89-e047-4ac5-81b6-c604d441d5e0 tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:50:45 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-66e08b89-e047-4ac5-81b6-c604d441d5e0 tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:50:45 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-66e08b89-e047-4ac5-81b6-c604d441d5e0 tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:50:45 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-66e08b89-e047-4ac5-81b6-c604d441d5e0 tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:50:45 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-66e08b89-e047-4ac5-81b6-c604d441d5e0 tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:50:45 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-66e08b89-e047-4ac5-81b6-c604d441d5e0 tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:50:45 user devstack@n-api.service[61318]: INFO nova.api.openstack.wsgi [None req-66e08b89-e047-4ac5-81b6-c604d441d5e0 tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] HTTP exception thrown: Instance c3100b42-46b3-4371-89f2-e511ca1ce6cd could not be found. Apr 21 10:50:45 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-66e08b89-e047-4ac5-81b6-c604d441d5e0 tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Request method failure captured: Apr 21 10:50:45 user devstack@n-api.service[61318]: request: GET /compute/v2.1/servers/c3100b42-46b3-4371-89f2-e511ca1ce6cd HTTP/1.1 Apr 21 10:50:45 user devstack@n-api.service[61318]: Accept: application/json Apr 21 10:50:45 user devstack@n-api.service[61318]: Accept-Encoding: identity Apr 21 10:50:45 user devstack@n-api.service[61318]: Connection: close Apr 21 10:50:45 user devstack@n-api.service[61318]: Content-Length: 0 Apr 21 10:50:45 user devstack@n-api.service[61318]: Content-Type: application/json Apr 21 10:50:45 user devstack@n-api.service[61318]: Host: 10.0.0.210 Apr 21 10:50:45 user devstack@n-api.service[61318]: Openstack-System-Scope: None Apr 21 10:50:45 user devstack@n-api.service[61318]: User-Agent: python-urllib3/1.26.15 Apr 21 10:50:45 user devstack@n-api.service[61318]: X-Auth-Token: gAAAAABkQmnV8upb9SlskcPde71r5Bhq_srCct7d16iRDBC6YXc7x771S6WXaYCvtuD6PkEljnfiqQw4sdyx_rKqcdoXiCPu8gt99ftbtAWMS0k3a276xK-lIFyv625UhtvryBBeAuumw47Q-YD8xGaKO84mTgkRFIrqnGMWHYeH39BfHcN0R9k Apr 21 10:50:45 user devstack@n-api.service[61318]: X-Domain-Id: None Apr 21 10:50:45 user devstack@n-api.service[61318]: X-Domain-Name: None Apr 21 10:50:45 user devstack@n-api.service[61318]: X-Identity-Status: Confirmed Apr 21 10:50:45 user devstack@n-api.service[61318]: X-Is-Admin-Project: True Apr 21 10:50:45 user devstack@n-api.service[61318]: X-Project-Domain-Id: default Apr 21 10:50:45 user devstack@n-api.service[61318]: X-Project-Domain-Name: Default Apr 21 10:50:45 user devstack@n-api.service[61318]: X-Project-Id: 52aece0e34a3451da50638e2930424e7 Apr 21 10:50:45 user devstack@n-api.service[61318]: X-Project-Name: tempest-SnapshotDataIntegrityTests-816712956 Apr 21 10:50:45 user devstack@n-api.service[61318]: X-Role: reader,member Apr 21 10:50:45 user devstack@n-api.service[61318]: X-Roles: reader,member Apr 21 10:50:45 user devstack@n-api.service[61318]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/52aece0e34a3451da50638e2930424e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/52aece0e34a3451da50638e2930424e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/52aece0e34a3451da50638e2930424e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 10:50:45 user devstack@n-api.service[61318]: X-Tenant: tempest-SnapshotDataIntegrityTests-816712956 Apr 21 10:50:45 user devstack@n-api.service[61318]: X-Tenant-Id: 52aece0e34a3451da50638e2930424e7 Apr 21 10:50:45 user devstack@n-api.service[61318]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-816712956 Apr 21 10:50:45 user devstack@n-api.service[61318]: X-User: tempest-SnapshotDataIntegrityTests-816712956-project-member Apr 21 10:50:45 user devstack@n-api.service[61318]: X-User-Domain-Id: default Apr 21 10:50:45 user devstack@n-api.service[61318]: X-User-Domain-Name: Default Apr 21 10:50:45 user devstack@n-api.service[61318]: X-User-Id: 0d7234a4dcce4289a84f5060f546efb6 Apr 21 10:50:45 user devstack@n-api.service[61318]: X-User-Name: tempest-SnapshotDataIntegrityTests-816712956-project-member Apr 21 10:50:45 user devstack@n-api.service[61318]: method: > Apr 21 10:50:45 user devstack@n-api.service[61318]: exception: Instance c3100b42-46b3-4371-89f2-e511ca1ce6cd could not be found. Apr 21 10:50:45 user devstack@n-api.service[61318]: action_args: {'id': 'c3100b42-46b3-4371-89f2-e511ca1ce6cd'} Apr 21 10:50:45 user devstack@n-api.service[61318]: {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 10:50:45 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:50:45 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 10:50:45 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 10:50:45 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 10:50:45 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 10:50:45 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 10:50:45 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 10:50:45 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 10:50:45 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 10:50:45 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3100b42-46b3-4371-89f2-e511ca1ce6cd could not be found. Apr 21 10:50:45 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:50:45 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:50:45 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:50:45 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:50:45 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 10:50:45 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 10:50:45 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 10:50:45 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 10:50:45 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 10:50:45 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 10:50:45 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 10:50:45 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 10:50:45 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 10:50:45 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 10:50:45 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 10:50:45 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 10:50:45 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3100b42-46b3-4371-89f2-e511ca1ce6cd could not be found. Apr 21 10:50:45 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:50:45 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:50:45 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:50:45 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:50:45 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 10:50:45 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 10:50:45 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 10:50:45 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 10:50:45 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3100b42-46b3-4371-89f2-e511ca1ce6cd could not be found. Apr 21 10:50:45 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:50:45 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-66e08b89-e047-4ac5-81b6-c604d441d5e0 tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Returning 404 to user: Instance c3100b42-46b3-4371-89f2-e511ca1ce6cd could not be found. {{(pid=61318) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 10:50:45 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-66e08b89-e047-4ac5-81b6-c604d441d5e0 tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c3100b42-46b3-4371-89f2-e511ca1ce6cd" status: 404 len: 111 microversion: 2.1 time: 0.042603 Apr 21 10:50:45 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 59/182] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:50:45 2023] GET /compute/v2.1/servers/c3100b42-46b3-4371-89f2-e511ca1ce6cd => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 10:50:45 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell0:SELECT=4 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:50:45 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:50:45 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-a905d0c8-cea4-4451-b3d8-546ae5f23f4c tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] Calling method '.version_select at 0x7f91a5ec6050>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:50:45 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-a905d0c8-cea4-4451-b3d8-546ae5f23f4c tempest-SnapshotDataIntegrityTests-816712956 tempest-SnapshotDataIntegrityTests-816712956-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1505495754" status: 202 len: 0 microversion: 2.1 time: 0.039408 Apr 21 10:50:45 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 62/183] 10.0.0.210 () {62 vars in 1355 bytes} [Fri Apr 21 10:50:45 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1505495754 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 10:50:51 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:50:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-f9cfbc17-51b4-4f20-9b73-0a9e9aaa1d34 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:50:51 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-f9cfbc17-51b4-4f20-9b73-0a9e9aaa1d34 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] [instance: db58ccab-48e9-499e-a916-9a68709958d6] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:50:51 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-f9cfbc17-51b4-4f20-9b73-0a9e9aaa1d34 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:50:51 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-f9cfbc17-51b4-4f20-9b73-0a9e9aaa1d34 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:50:51 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-f9cfbc17-51b4-4f20-9b73-0a9e9aaa1d34 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:50:51 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-f9cfbc17-51b4-4f20-9b73-0a9e9aaa1d34 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:50:51 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-f9cfbc17-51b4-4f20-9b73-0a9e9aaa1d34 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:50:51 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-f9cfbc17-51b4-4f20-9b73-0a9e9aaa1d34 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:50:51 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-f9cfbc17-51b4-4f20-9b73-0a9e9aaa1d34 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:50:51 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-f9cfbc17-51b4-4f20-9b73-0a9e9aaa1d34 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:50:51 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-f9cfbc17-51b4-4f20-9b73-0a9e9aaa1d34 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:50:51 user devstack@n-api.service[61320]: DEBUG nova.objects.instance [None req-f9cfbc17-51b4-4f20-9b73-0a9e9aaa1d34 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lazy-loading 'fault' on Instance uuid db58ccab-48e9-499e-a916-9a68709958d6 {{(pid=61320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 21 10:50:51 user devstack@n-api.service[61320]: DEBUG nova.policy [None req-f9cfbc17-51b4-4f20-9b73-0a9e9aaa1d34 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c67d90b6014d9ea24ef2552006bc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad84a0e014f47ddaeaddc88bf16b0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61320) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:50:51 user devstack@n-api.service[61320]: DEBUG nova.policy [None req-f9cfbc17-51b4-4f20-9b73-0a9e9aaa1d34 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c67d90b6014d9ea24ef2552006bc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad84a0e014f47ddaeaddc88bf16b0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61320) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:50:51 user devstack@n-api.service[61320]: DEBUG nova.policy [None req-f9cfbc17-51b4-4f20-9b73-0a9e9aaa1d34 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c67d90b6014d9ea24ef2552006bc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad84a0e014f47ddaeaddc88bf16b0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61320) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:50:51 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-f9cfbc17-51b4-4f20-9b73-0a9e9aaa1d34 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db58ccab-48e9-499e-a916-9a68709958d6" status: 200 len: 1650 microversion: 2.87 time: 0.154922 Apr 21 10:50:51 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 63/184] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 10:50:51 2023] GET /compute/v2.1/servers/db58ccab-48e9-499e-a916-9a68709958d6 => generated 1650 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 10:50:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-abbe7dfd-1c5c-4351-8d4f-32fbb8228a4e tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:50:51 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-abbe7dfd-1c5c-4351-8d4f-32fbb8228a4e tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] [instance: db58ccab-48e9-499e-a916-9a68709958d6] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:50:51 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-abbe7dfd-1c5c-4351-8d4f-32fbb8228a4e tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:50:51 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-abbe7dfd-1c5c-4351-8d4f-32fbb8228a4e tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:50:51 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-abbe7dfd-1c5c-4351-8d4f-32fbb8228a4e tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:50:51 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-abbe7dfd-1c5c-4351-8d4f-32fbb8228a4e tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:50:51 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-abbe7dfd-1c5c-4351-8d4f-32fbb8228a4e tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:50:51 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-abbe7dfd-1c5c-4351-8d4f-32fbb8228a4e tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:50:51 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-abbe7dfd-1c5c-4351-8d4f-32fbb8228a4e tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] [instance: db58ccab-48e9-499e-a916-9a68709958d6] Going to try to terminate instance {{(pid=61318) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 10:50:51 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-abbe7dfd-1c5c-4351-8d4f-32fbb8228a4e tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] [instance: db58ccab-48e9-499e-a916-9a68709958d6] Doing local delete in cell bb5ee891-ceca-455b-842d-847784699b19(cell1) {{(pid=61318) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 21 10:50:51 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-abbe7dfd-1c5c-4351-8d4f-32fbb8228a4e tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:50:51 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-abbe7dfd-1c5c-4351-8d4f-32fbb8228a4e tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:50:51 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-abbe7dfd-1c5c-4351-8d4f-32fbb8228a4e tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:50:51 user devstack@n-api.service[61318]: WARNING nova.compute.api [None req-abbe7dfd-1c5c-4351-8d4f-32fbb8228a4e tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] [instance: db58ccab-48e9-499e-a916-9a68709958d6] instance's host None is down, deleting from database Apr 21 10:50:51 user devstack@n-api.service[61318]: DEBUG nova.network.neutron [None req-abbe7dfd-1c5c-4351-8d4f-32fbb8228a4e tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] [instance: db58ccab-48e9-499e-a916-9a68709958d6] deallocate_for_instance() {{(pid=61318) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 21 10:50:51 user devstack@n-api.service[61318]: DEBUG nova.network.neutron [None req-abbe7dfd-1c5c-4351-8d4f-32fbb8228a4e tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] [instance: db58ccab-48e9-499e-a916-9a68709958d6] Instance cache missing network info. {{(pid=61318) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 21 10:50:51 user devstack@n-api.service[61318]: DEBUG nova.network.neutron [None req-abbe7dfd-1c5c-4351-8d4f-32fbb8228a4e tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] [instance: db58ccab-48e9-499e-a916-9a68709958d6] Updating instance_info_cache with network_info: [] {{(pid=61318) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 21 10:50:51 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-abbe7dfd-1c5c-4351-8d4f-32fbb8228a4e tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] [instance: db58ccab-48e9-499e-a916-9a68709958d6] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61318) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 21 10:50:51 user devstack@n-api.service[61318]: WARNING nova.compute.api [None req-abbe7dfd-1c5c-4351-8d4f-32fbb8228a4e tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] [instance: db58ccab-48e9-499e-a916-9a68709958d6] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 21 10:50:51 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-abbe7dfd-1c5c-4351-8d4f-32fbb8228a4e tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/db58ccab-48e9-499e-a916-9a68709958d6" status: 204 len: 0 microversion: 2.87 time: 0.558726 Apr 21 10:50:51 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 60/185] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 21 10:50:51 2023] DELETE /compute/v2.1/servers/db58ccab-48e9-499e-a916-9a68709958d6 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 21 10:50:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-0bf31de7-27d6-4fba-af66-dccd6b955759 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:50:51 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-0bf31de7-27d6-4fba-af66-dccd6b955759 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] [instance: db58ccab-48e9-499e-a916-9a68709958d6] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:50:51 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-0bf31de7-27d6-4fba-af66-dccd6b955759 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:50:51 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-0bf31de7-27d6-4fba-af66-dccd6b955759 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:50:51 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-0bf31de7-27d6-4fba-af66-dccd6b955759 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:50:51 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-0bf31de7-27d6-4fba-af66-dccd6b955759 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:50:51 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-0bf31de7-27d6-4fba-af66-dccd6b955759 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:50:51 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-0bf31de7-27d6-4fba-af66-dccd6b955759 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:50:51 user devstack@n-api.service[61319]: INFO nova.api.openstack.wsgi [None req-0bf31de7-27d6-4fba-af66-dccd6b955759 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] HTTP exception thrown: Instance db58ccab-48e9-499e-a916-9a68709958d6 could not be found. Apr 21 10:50:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-0bf31de7-27d6-4fba-af66-dccd6b955759 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Request method failure captured: Apr 21 10:50:51 user devstack@n-api.service[61319]: request: GET /compute/v2.1/servers/db58ccab-48e9-499e-a916-9a68709958d6 HTTP/1.1 Apr 21 10:50:51 user devstack@n-api.service[61319]: Accept: application/json Apr 21 10:50:51 user devstack@n-api.service[61319]: Accept-Encoding: identity Apr 21 10:50:51 user devstack@n-api.service[61319]: Connection: close Apr 21 10:50:51 user devstack@n-api.service[61319]: Content-Length: 0 Apr 21 10:50:51 user devstack@n-api.service[61319]: Content-Type: application/json Apr 21 10:50:51 user devstack@n-api.service[61319]: Host: 10.0.0.210 Apr 21 10:50:51 user devstack@n-api.service[61319]: Openstack-System-Scope: None Apr 21 10:50:51 user devstack@n-api.service[61319]: User-Agent: python-urllib3/1.26.15 Apr 21 10:50:51 user devstack@n-api.service[61319]: X-Auth-Token: gAAAAABkQmmi2qmN21XP1-DJ0fIuUyfzkDVvfbWGO-MUZXWhTOEnVzXhVFl8LUHS-yHejsXQJQDrMBGmIiXmN8jjX0f1kKLnGT_CoDsaSA6EPHkQhVh674tVagYFSv7PUgkhweI8_tY6juuaFpZwf7yRfTk8k_mK9rn7HdRsjMrpquoVzV7Q8q4 Apr 21 10:50:51 user devstack@n-api.service[61319]: X-Domain-Id: None Apr 21 10:50:51 user devstack@n-api.service[61319]: X-Domain-Name: None Apr 21 10:50:51 user devstack@n-api.service[61319]: X-Identity-Status: Confirmed Apr 21 10:50:51 user devstack@n-api.service[61319]: X-Is-Admin-Project: True Apr 21 10:50:51 user devstack@n-api.service[61319]: X-Openstack-Nova-Api-Version: 2.87 Apr 21 10:50:51 user devstack@n-api.service[61319]: X-Project-Domain-Id: default Apr 21 10:50:51 user devstack@n-api.service[61319]: X-Project-Domain-Name: Default Apr 21 10:50:51 user devstack@n-api.service[61319]: X-Project-Id: aad84a0e014f47ddaeaddc88bf16b0a8 Apr 21 10:50:51 user devstack@n-api.service[61319]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1980957418 Apr 21 10:50:51 user devstack@n-api.service[61319]: X-Role: reader,member Apr 21 10:50:51 user devstack@n-api.service[61319]: X-Roles: reader,member Apr 21 10:50:51 user devstack@n-api.service[61319]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/aad84a0e014f47ddaeaddc88bf16b0a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/aad84a0e014f47ddaeaddc88bf16b0a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/aad84a0e014f47ddaeaddc88bf16b0a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 10:50:51 user devstack@n-api.service[61319]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1980957418 Apr 21 10:50:51 user devstack@n-api.service[61319]: X-Tenant-Id: aad84a0e014f47ddaeaddc88bf16b0a8 Apr 21 10:50:51 user devstack@n-api.service[61319]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1980957418 Apr 21 10:50:51 user devstack@n-api.service[61319]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member Apr 21 10:50:51 user devstack@n-api.service[61319]: X-User-Domain-Id: default Apr 21 10:50:51 user devstack@n-api.service[61319]: X-User-Domain-Name: Default Apr 21 10:50:51 user devstack@n-api.service[61319]: X-User-Id: 54c67d90b6014d9ea24ef2552006bc04 Apr 21 10:50:51 user devstack@n-api.service[61319]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member Apr 21 10:50:51 user devstack@n-api.service[61319]: method: > Apr 21 10:50:51 user devstack@n-api.service[61319]: exception: Instance db58ccab-48e9-499e-a916-9a68709958d6 could not be found. Apr 21 10:50:51 user devstack@n-api.service[61319]: action_args: {'id': 'db58ccab-48e9-499e-a916-9a68709958d6'} Apr 21 10:50:51 user devstack@n-api.service[61319]: {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 10:50:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:50:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 10:50:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 10:50:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 10:50:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 10:50:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 10:50:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 10:50:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 10:50:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 10:50:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db58ccab-48e9-499e-a916-9a68709958d6 could not be found. Apr 21 10:50:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:50:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:50:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:50:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:50:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 10:50:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 10:50:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 10:50:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 10:50:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 10:50:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 10:50:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 10:50:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 10:50:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 10:50:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 10:50:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 10:50:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 10:50:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db58ccab-48e9-499e-a916-9a68709958d6 could not be found. Apr 21 10:50:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:50:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:50:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:50:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:50:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 10:50:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 10:50:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 10:50:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 10:50:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db58ccab-48e9-499e-a916-9a68709958d6 could not be found. Apr 21 10:50:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:50:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-0bf31de7-27d6-4fba-af66-dccd6b955759 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Returning 404 to user: Instance db58ccab-48e9-499e-a916-9a68709958d6 could not be found. {{(pid=61319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 10:50:51 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-0bf31de7-27d6-4fba-af66-dccd6b955759 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db58ccab-48e9-499e-a916-9a68709958d6" status: 404 len: 111 microversion: 2.87 time: 0.043264 Apr 21 10:50:51 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 63/186] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 10:50:51 2023] GET /compute/v2.1/servers/db58ccab-48e9-499e-a916-9a68709958d6 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 21 10:50:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-f42bea43-f64c-4884-a48e-8452c8825d79 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-2043125688", "imageRef": "3b29a01a-1fc0-4d0d-89fb-23d22b2de02e", "flavorRef": "42", "networks": [{"uuid": "cfb4de90-44ea-486a-b5c4-c3b1111aa2bd"}]}} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:50:52 user devstack@n-api.service[61320]: DEBUG nova.network.neutron [None req-f42bea43-f64c-4884-a48e-8452c8825d79 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] validate_networks() for [('cfb4de90-44ea-486a-b5c4-c3b1111aa2bd', None, None, None, None, None)] {{(pid=61320) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 10:50:52 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-f42bea43-f64c-4884-a48e-8452c8825d79 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Flavor limits 0:0:0 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 10:50:52 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-f42bea43-f64c-4884-a48e-8452c8825d79 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Image limits 0:0:0 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 10:50:52 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-f42bea43-f64c-4884-a48e-8452c8825d79 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Flavor pref 0:0:0 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 10:50:52 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-f42bea43-f64c-4884-a48e-8452c8825d79 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Image pref 0:0:0 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 10:50:52 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-f42bea43-f64c-4884-a48e-8452c8825d79 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 10:50:52 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-f42bea43-f64c-4884-a48e-8452c8825d79 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:50:52 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-f42bea43-f64c-4884-a48e-8452c8825d79 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:50:52 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-f42bea43-f64c-4884-a48e-8452c8825d79 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:50:52 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-f42bea43-f64c-4884-a48e-8452c8825d79 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:50:52 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-f42bea43-f64c-4884-a48e-8452c8825d79 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:50:52 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-f42bea43-f64c-4884-a48e-8452c8825d79 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:50:52 user devstack@n-api.service[61320]: DEBUG nova.quota [None req-f42bea43-f64c-4884-a48e-8452c8825d79 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Getting quotas for project aad84a0e014f47ddaeaddc88bf16b0a8. Resources: {'cores', 'instances', 'ram'} {{(pid=61320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 10:50:52 user devstack@n-api.service[61320]: DEBUG nova.quota [None req-f42bea43-f64c-4884-a48e-8452c8825d79 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Getting quotas for user 54c67d90b6014d9ea24ef2552006bc04 and project aad84a0e014f47ddaeaddc88bf16b0a8. Resources: {'cores', 'instances', 'ram'} {{(pid=61320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 10:50:52 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-f42bea43-f64c-4884-a48e-8452c8825d79 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Going to run 1 instances... {{(pid=61320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 10:50:52 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-f42bea43-f64c-4884-a48e-8452c8825d79 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] [instance: f4dda568-8f3b-40eb-aff3-64d3e759c310] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3b29a01a-1fc0-4d0d-89fb-23d22b2de02e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 10:50:52 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-f42bea43-f64c-4884-a48e-8452c8825d79 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.618508 Apr 21 10:50:52 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 64/187] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 21 10:50:51 2023] POST /compute/v2.1/servers => generated 378 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 21 10:50:52 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-49c1ab99-3238-47cb-b546-62586456b40d tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:50:52 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-49c1ab99-3238-47cb-b546-62586456b40d tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] [instance: f4dda568-8f3b-40eb-aff3-64d3e759c310] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:50:52 user devstack@n-api.service[61318]: DEBUG nova.policy [None req-49c1ab99-3238-47cb-b546-62586456b40d tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c67d90b6014d9ea24ef2552006bc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad84a0e014f47ddaeaddc88bf16b0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61318) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:50:52 user devstack@n-api.service[61318]: DEBUG nova.policy [None req-49c1ab99-3238-47cb-b546-62586456b40d tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c67d90b6014d9ea24ef2552006bc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad84a0e014f47ddaeaddc88bf16b0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61318) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:50:52 user devstack@n-api.service[61318]: DEBUG nova.policy [None req-49c1ab99-3238-47cb-b546-62586456b40d tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c67d90b6014d9ea24ef2552006bc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad84a0e014f47ddaeaddc88bf16b0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61318) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:50:52 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-49c1ab99-3238-47cb-b546-62586456b40d tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f4dda568-8f3b-40eb-aff3-64d3e759c310" status: 200 len: 1395 microversion: 2.87 time: 0.080753 Apr 21 10:50:52 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 61/188] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 10:50:52 2023] GET /compute/v2.1/servers/f4dda568-8f3b-40eb-aff3-64d3e759c310 => generated 1395 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 10:50:55 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-645e122f-aab0-44ec-afd5-13fa533fa501 req-2c5660a9-9a42-4a01-8ec5-e2ac64678718 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4dda568-8f3b-40eb-aff3-64d3e759c310", "tag": "0e9676a1-1652-48fd-affd-355632de3ca2"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:50:55 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-645e122f-aab0-44ec-afd5-13fa533fa501 req-2c5660a9-9a42-4a01-8ec5-e2ac64678718 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:50:55 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-645e122f-aab0-44ec-afd5-13fa533fa501 req-2c5660a9-9a42-4a01-8ec5-e2ac64678718 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:50:55 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-645e122f-aab0-44ec-afd5-13fa533fa501 req-2c5660a9-9a42-4a01-8ec5-e2ac64678718 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:50:55 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-645e122f-aab0-44ec-afd5-13fa533fa501 req-2c5660a9-9a42-4a01-8ec5-e2ac64678718 service nova] Creating event network-changed:0e9676a1-1652-48fd-affd-355632de3ca2 for instance f4dda568-8f3b-40eb-aff3-64d3e759c310 on user Apr 21 10:50:55 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-645e122f-aab0-44ec-afd5-13fa533fa501 req-2c5660a9-9a42-4a01-8ec5-e2ac64678718 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028380 Apr 21 10:50:55 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 64/189] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:50:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:50:56 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-269f3296-5fd1-4ca3-a169-5cdf702a62ab tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:50:56 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-269f3296-5fd1-4ca3-a169-5cdf702a62ab tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] [instance: 566040e7-8140-467b-b814-8d7eb62ef735] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:50:56 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-269f3296-5fd1-4ca3-a169-5cdf702a62ab tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:50:56 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-269f3296-5fd1-4ca3-a169-5cdf702a62ab tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:50:56 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-269f3296-5fd1-4ca3-a169-5cdf702a62ab tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:50:56 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-269f3296-5fd1-4ca3-a169-5cdf702a62ab tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:50:56 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-269f3296-5fd1-4ca3-a169-5cdf702a62ab tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:50:56 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-269f3296-5fd1-4ca3-a169-5cdf702a62ab tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:50:57 user devstack@n-api.service[61320]: DEBUG nova.policy [None req-269f3296-5fd1-4ca3-a169-5cdf702a62ab tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fb0d890b594080bb1bb99dd6294ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd85f51547e5244e495343281725fe320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61320) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:50:57 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-269f3296-5fd1-4ca3-a169-5cdf702a62ab tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] 10.0.0.210 "GET /compute/v2.1/servers/566040e7-8140-467b-b814-8d7eb62ef735" status: 200 len: 1535 microversion: 2.1 time: 0.346667 Apr 21 10:50:57 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 65/190] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:50:56 2023] GET /compute/v2.1/servers/566040e7-8140-467b-b814-8d7eb62ef735 => generated 1535 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 10:50:57 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [req-5ba7148b-27a3-4039-817a-31f1e0611969 req-e9ae87da-501d-41ab-b656-09e3d49e1b2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4dda568-8f3b-40eb-aff3-64d3e759c310", "name": "network-vif-plugged", "status": "completed", "tag": "0e9676a1-1652-48fd-affd-355632de3ca2"}]} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:50:57 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-5ba7148b-27a3-4039-817a-31f1e0611969 req-e9ae87da-501d-41ab-b656-09e3d49e1b2d service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:50:57 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-5ba7148b-27a3-4039-817a-31f1e0611969 req-e9ae87da-501d-41ab-b656-09e3d49e1b2d service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:50:57 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-5ba7148b-27a3-4039-817a-31f1e0611969 req-e9ae87da-501d-41ab-b656-09e3d49e1b2d service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:50:57 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-5ba7148b-27a3-4039-817a-31f1e0611969 req-e9ae87da-501d-41ab-b656-09e3d49e1b2d service nova] Creating event network-vif-plugged:0e9676a1-1652-48fd-affd-355632de3ca2 for instance f4dda568-8f3b-40eb-aff3-64d3e759c310 on user Apr 21 10:50:57 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [req-5ba7148b-27a3-4039-817a-31f1e0611969 req-e9ae87da-501d-41ab-b656-09e3d49e1b2d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027366 Apr 21 10:50:57 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 62/191] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:50:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 10:50:59 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-1d214b45-44fb-408f-aac9-1eea8ee67b6b req-e71ba1da-03cc-4341-9356-d2f9edc9f720 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4dda568-8f3b-40eb-aff3-64d3e759c310", "name": "network-vif-plugged", "status": "completed", "tag": "0e9676a1-1652-48fd-affd-355632de3ca2"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:50:59 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-1d214b45-44fb-408f-aac9-1eea8ee67b6b req-e71ba1da-03cc-4341-9356-d2f9edc9f720 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:50:59 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-1d214b45-44fb-408f-aac9-1eea8ee67b6b req-e71ba1da-03cc-4341-9356-d2f9edc9f720 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:50:59 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-1d214b45-44fb-408f-aac9-1eea8ee67b6b req-e71ba1da-03cc-4341-9356-d2f9edc9f720 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:50:59 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-1d214b45-44fb-408f-aac9-1eea8ee67b6b req-e71ba1da-03cc-4341-9356-d2f9edc9f720 service nova] Creating event network-vif-plugged:0e9676a1-1652-48fd-affd-355632de3ca2 for instance f4dda568-8f3b-40eb-aff3-64d3e759c310 on user Apr 21 10:50:59 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-1d214b45-44fb-408f-aac9-1eea8ee67b6b req-e71ba1da-03cc-4341-9356-d2f9edc9f720 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030429 Apr 21 10:50:59 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 65/192] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:50:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:51:00 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-b6d70904-ec9f-499b-8823-34c62aee219a tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:51:00 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-b6d70904-ec9f-499b-8823-34c62aee219a tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] [instance: f8609da3-c26d-482a-bc03-017baf4bce22] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:51:00 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-b6d70904-ec9f-499b-8823-34c62aee219a tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:51:00 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-b6d70904-ec9f-499b-8823-34c62aee219a tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:51:00 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-b6d70904-ec9f-499b-8823-34c62aee219a tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:51:00 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-b6d70904-ec9f-499b-8823-34c62aee219a tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:51:00 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-b6d70904-ec9f-499b-8823-34c62aee219a tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:51:00 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-b6d70904-ec9f-499b-8823-34c62aee219a tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:51:00 user devstack@n-api.service[61320]: DEBUG nova.policy [None req-b6d70904-ec9f-499b-8823-34c62aee219a tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced216baa4a64c72946cf3f71eb873dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648163a728fc4b28b85a24e9198d356b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61320) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:51:00 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-b6d70904-ec9f-499b-8823-34c62aee219a tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8609da3-c26d-482a-bc03-017baf4bce22" status: 200 len: 1656 microversion: 2.1 time: 0.244366 Apr 21 10:51:00 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 66/193] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:51:00 2023] GET /compute/v2.1/servers/f8609da3-c26d-482a-bc03-017baf4bce22 => generated 1656 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:51:03 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell0:SELECT=2 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:51:03 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-5e61f11d-e217-4637-9014-e6daad0cf2ff tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:51:03 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-5e61f11d-e217-4637-9014-e6daad0cf2ff tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] [instance: 15bf9321-a92e-4be2-bcae-a943988c811a] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:51:03 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-5e61f11d-e217-4637-9014-e6daad0cf2ff tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:51:03 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-5e61f11d-e217-4637-9014-e6daad0cf2ff tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:51:03 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-5e61f11d-e217-4637-9014-e6daad0cf2ff tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:51:03 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-5e61f11d-e217-4637-9014-e6daad0cf2ff tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:51:03 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-5e61f11d-e217-4637-9014-e6daad0cf2ff tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:51:03 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-5e61f11d-e217-4637-9014-e6daad0cf2ff tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:51:03 user devstack@n-api.service[61318]: DEBUG nova.policy [None req-5e61f11d-e217-4637-9014-e6daad0cf2ff tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd172d648a9474db082646a47a2840214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdd7a4ccfc340aa9c1b02c57f7a0e70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61318) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:51:03 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-5e61f11d-e217-4637-9014-e6daad0cf2ff tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15bf9321-a92e-4be2-bcae-a943988c811a" status: 200 len: 1671 microversion: 2.1 time: 0.365711 Apr 21 10:51:03 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 63/194] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:51:03 2023] GET /compute/v2.1/servers/15bf9321-a92e-4be2-bcae-a943988c811a => generated 1671 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:51:05 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-a3bc24df-2ef9-49e2-8c2c-40f467db23bf tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Calling method '.version_select at 0x7f91a6b65ea0>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:51:05 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-a3bc24df-2ef9-49e2-8c2c-40f467db23bf tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/3c3de79a-9b9a-4806-a09d-d95df36a6231" status: 204 len: 0 microversion: 2.1 time: 0.259912 Apr 21 10:51:05 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 66/195] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:51:05 2023] DELETE /compute/v2.1/images/3c3de79a-9b9a-4806-a09d-d95df36a6231 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 10:51:05 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-35f7c72e-f266-4645-8552-e324620d5993 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:51:05 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-35f7c72e-f266-4645-8552-e324620d5993 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] [instance: 15bf9321-a92e-4be2-bcae-a943988c811a] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:51:05 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell0:SELECT=2 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:51:05 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell0:SELECT=6 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:51:05 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-35f7c72e-f266-4645-8552-e324620d5993 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:51:05 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-35f7c72e-f266-4645-8552-e324620d5993 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:51:05 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-35f7c72e-f266-4645-8552-e324620d5993 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:51:05 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-35f7c72e-f266-4645-8552-e324620d5993 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:51:05 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-35f7c72e-f266-4645-8552-e324620d5993 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:51:05 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-35f7c72e-f266-4645-8552-e324620d5993 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:51:05 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-35f7c72e-f266-4645-8552-e324620d5993 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] [instance: 15bf9321-a92e-4be2-bcae-a943988c811a] Going to try to terminate instance {{(pid=61320) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 10:51:05 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-35f7c72e-f266-4645-8552-e324620d5993 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/15bf9321-a92e-4be2-bcae-a943988c811a" status: 204 len: 0 microversion: 2.1 time: 0.134369 Apr 21 10:51:05 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 67/196] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 10:51:05 2023] DELETE /compute/v2.1/servers/15bf9321-a92e-4be2-bcae-a943988c811a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 10:51:05 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-a1bd4792-4fce-4984-9b19-c7d62eaebb9c tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:51:05 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-a1bd4792-4fce-4984-9b19-c7d62eaebb9c tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] [instance: 15bf9321-a92e-4be2-bcae-a943988c811a] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:51:05 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-a1bd4792-4fce-4984-9b19-c7d62eaebb9c tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:51:05 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-a1bd4792-4fce-4984-9b19-c7d62eaebb9c tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:51:05 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-a1bd4792-4fce-4984-9b19-c7d62eaebb9c tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:51:05 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-a1bd4792-4fce-4984-9b19-c7d62eaebb9c tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:51:05 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-a1bd4792-4fce-4984-9b19-c7d62eaebb9c tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:51:05 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-a1bd4792-4fce-4984-9b19-c7d62eaebb9c tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:51:06 user devstack@n-api.service[61318]: DEBUG nova.policy [None req-a1bd4792-4fce-4984-9b19-c7d62eaebb9c tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd172d648a9474db082646a47a2840214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdd7a4ccfc340aa9c1b02c57f7a0e70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61318) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:51:06 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-a1bd4792-4fce-4984-9b19-c7d62eaebb9c tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15bf9321-a92e-4be2-bcae-a943988c811a" status: 200 len: 1677 microversion: 2.1 time: 0.216706 Apr 21 10:51:06 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 64/197] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:51:05 2023] GET /compute/v2.1/servers/15bf9321-a92e-4be2-bcae-a943988c811a => generated 1677 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:51:06 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-2098cd12-8a39-404f-bdc9-f1d8bf86d4eb req-2ee0ff50-711b-43fb-ba95-ebe03ea3f764 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15bf9321-a92e-4be2-bcae-a943988c811a", "name": "network-vif-unplugged", "status": "completed", "tag": "fca8b6a6-fd45-4ba5-b1b1-fc40da2fc33d"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:51:06 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-2098cd12-8a39-404f-bdc9-f1d8bf86d4eb req-2ee0ff50-711b-43fb-ba95-ebe03ea3f764 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:51:06 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-2098cd12-8a39-404f-bdc9-f1d8bf86d4eb req-2ee0ff50-711b-43fb-ba95-ebe03ea3f764 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:51:06 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-2098cd12-8a39-404f-bdc9-f1d8bf86d4eb req-2ee0ff50-711b-43fb-ba95-ebe03ea3f764 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:51:06 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-2098cd12-8a39-404f-bdc9-f1d8bf86d4eb req-2ee0ff50-711b-43fb-ba95-ebe03ea3f764 service nova] Creating event network-vif-unplugged:fca8b6a6-fd45-4ba5-b1b1-fc40da2fc33d for instance 15bf9321-a92e-4be2-bcae-a943988c811a on user Apr 21 10:51:06 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-2098cd12-8a39-404f-bdc9-f1d8bf86d4eb req-2ee0ff50-711b-43fb-ba95-ebe03ea3f764 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028068 Apr 21 10:51:06 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 67/198] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:51:06 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 10:51:07 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [req-dd339c0e-1d53-4d0f-a17c-5b9feaba5258 req-4c5013be-c23c-49d5-a39c-c1b1be4160c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15bf9321-a92e-4be2-bcae-a943988c811a", "name": "network-vif-deleted", "tag": "fca8b6a6-fd45-4ba5-b1b1-fc40da2fc33d"}]} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:51:07 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-dd339c0e-1d53-4d0f-a17c-5b9feaba5258 req-4c5013be-c23c-49d5-a39c-c1b1be4160c4 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:51:07 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-dd339c0e-1d53-4d0f-a17c-5b9feaba5258 req-4c5013be-c23c-49d5-a39c-c1b1be4160c4 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:51:07 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-dd339c0e-1d53-4d0f-a17c-5b9feaba5258 req-4c5013be-c23c-49d5-a39c-c1b1be4160c4 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:51:07 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-dd339c0e-1d53-4d0f-a17c-5b9feaba5258 req-4c5013be-c23c-49d5-a39c-c1b1be4160c4 service nova] Creating event network-vif-deleted:fca8b6a6-fd45-4ba5-b1b1-fc40da2fc33d for instance 15bf9321-a92e-4be2-bcae-a943988c811a on user Apr 21 10:51:07 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [req-dd339c0e-1d53-4d0f-a17c-5b9feaba5258 req-4c5013be-c23c-49d5-a39c-c1b1be4160c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033021 Apr 21 10:51:07 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 68/199] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:51:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:51:08 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-773de336-11c6-4b4e-bc57-589e2803931c tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Action: 'create', calling method: .version_select at 0x7f91a60db760>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-990689924", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdIcpjsQgofTWxPhSCIN/mpUwMbeXhtJNFymtTMxwmV7Bxki7QmQko9CAbLh0f7+BwLKjoTQlfvvfT0xvv8wlFZ5IIip5N+0UUo9CL93KfHE8COz3zk4cngjZQ1yxLNwA=="}} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:51:08 user devstack@n-api.service[61318]: DEBUG nova.quota [None req-773de336-11c6-4b4e-bc57-589e2803931c tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Getting quotas for project 9ead44a7da0640cbb2cf8dece0ea4f40. Resources: {'key_pairs'} {{(pid=61318) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 10:51:08 user devstack@n-api.service[61318]: DEBUG nova.quota [None req-773de336-11c6-4b4e-bc57-589e2803931c tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Getting quotas for user 6cae5a1734d24ac8aebc233dd31d3084 and project 9ead44a7da0640cbb2cf8dece0ea4f40. Resources: {'key_pairs'} {{(pid=61318) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 10:51:08 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-773de336-11c6-4b4e-bc57-589e2803931c tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.047100 Apr 21 10:51:08 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 65/200] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 21 10:51:08 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:51:08 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-d84d8081-de08-4f85-be1c-a2ee7323d2a6 req-24585973-2b1d-4677-9c35-0eace5cf7f23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15bf9321-a92e-4be2-bcae-a943988c811a", "name": "network-vif-plugged", "status": "completed", "tag": "fca8b6a6-fd45-4ba5-b1b1-fc40da2fc33d"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:51:08 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-d84d8081-de08-4f85-be1c-a2ee7323d2a6 req-24585973-2b1d-4677-9c35-0eace5cf7f23 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:51:08 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-d84d8081-de08-4f85-be1c-a2ee7323d2a6 req-24585973-2b1d-4677-9c35-0eace5cf7f23 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:51:08 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-d84d8081-de08-4f85-be1c-a2ee7323d2a6 req-24585973-2b1d-4677-9c35-0eace5cf7f23 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:51:08 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-d84d8081-de08-4f85-be1c-a2ee7323d2a6 req-24585973-2b1d-4677-9c35-0eace5cf7f23 service nova] Creating event network-vif-plugged:fca8b6a6-fd45-4ba5-b1b1-fc40da2fc33d for instance 15bf9321-a92e-4be2-bcae-a943988c811a on user Apr 21 10:51:08 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-d84d8081-de08-4f85-be1c-a2ee7323d2a6 req-24585973-2b1d-4677-9c35-0eace5cf7f23 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031201 Apr 21 10:51:08 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 68/201] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:51:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:51:08 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-f1fc51a9-2224-426d-a626-3f57ffb84b04 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2059401768", "imageRef": "86c32514-9140-48a4-8ce6-baeafcca9587", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-990689924", "networks": [{"uuid": "89cc600b-891d-4913-9f39-935f5c5bce86"}]}} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:51:08 user devstack@n-api.service[61320]: DEBUG nova.network.neutron [None req-f1fc51a9-2224-426d-a626-3f57ffb84b04 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] validate_networks() for [('89cc600b-891d-4913-9f39-935f5c5bce86', None, None, None, None, None)] {{(pid=61320) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 10:51:08 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-f1fc51a9-2224-426d-a626-3f57ffb84b04 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Flavor limits 0:0:0 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 10:51:08 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-f1fc51a9-2224-426d-a626-3f57ffb84b04 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Image limits 0:0:0 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 10:51:08 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-f1fc51a9-2224-426d-a626-3f57ffb84b04 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Flavor pref 0:0:0 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 10:51:08 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-f1fc51a9-2224-426d-a626-3f57ffb84b04 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Image pref 0:0:0 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 10:51:08 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-f1fc51a9-2224-426d-a626-3f57ffb84b04 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 10:51:08 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-f1fc51a9-2224-426d-a626-3f57ffb84b04 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:51:08 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-f1fc51a9-2224-426d-a626-3f57ffb84b04 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:51:08 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-f1fc51a9-2224-426d-a626-3f57ffb84b04 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:51:08 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-f1fc51a9-2224-426d-a626-3f57ffb84b04 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:51:08 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-f1fc51a9-2224-426d-a626-3f57ffb84b04 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:51:08 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-f1fc51a9-2224-426d-a626-3f57ffb84b04 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:51:08 user devstack@n-api.service[61320]: DEBUG nova.quota [None req-f1fc51a9-2224-426d-a626-3f57ffb84b04 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Getting quotas for project 9ead44a7da0640cbb2cf8dece0ea4f40. Resources: {'cores', 'instances', 'ram'} {{(pid=61320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 10:51:08 user devstack@n-api.service[61320]: DEBUG nova.quota [None req-f1fc51a9-2224-426d-a626-3f57ffb84b04 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Getting quotas for user 6cae5a1734d24ac8aebc233dd31d3084 and project 9ead44a7da0640cbb2cf8dece0ea4f40. Resources: {'cores', 'instances', 'ram'} {{(pid=61320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 10:51:08 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-f1fc51a9-2224-426d-a626-3f57ffb84b04 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Going to run 1 instances... {{(pid=61320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 10:51:08 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-f1fc51a9-2224-426d-a626-3f57ffb84b04 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] [instance: 69031436-19d1-4cc1-91e7-4d99381b6ae3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='86c32514-9140-48a4-8ce6-baeafcca9587',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 10:51:08 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-f1fc51a9-2224-426d-a626-3f57ffb84b04 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.580333 Apr 21 10:51:08 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 69/202] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 10:51:08 2023] POST /compute/v2.1/servers => generated 378 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 10:51:08 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-1515eb10-adb5-43a4-9582-6336f28604c7 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:51:08 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-1515eb10-adb5-43a4-9582-6336f28604c7 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] [instance: 69031436-19d1-4cc1-91e7-4d99381b6ae3] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:51:08 user devstack@n-api.service[61318]: DEBUG nova.policy [None req-1515eb10-adb5-43a4-9582-6336f28604c7 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cae5a1734d24ac8aebc233dd31d3084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead44a7da0640cbb2cf8dece0ea4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61318) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:51:08 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-1515eb10-adb5-43a4-9582-6336f28604c7 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] 10.0.0.210 "GET /compute/v2.1/servers/69031436-19d1-4cc1-91e7-4d99381b6ae3" status: 200 len: 1252 microversion: 2.1 time: 0.089576 Apr 21 10:51:08 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 66/203] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:51:08 2023] GET /compute/v2.1/servers/69031436-19d1-4cc1-91e7-4d99381b6ae3 => generated 1252 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:51:11 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-2d5e49ba-3080-484a-bde9-020b497f0d6d req-23eacc69-f06e-429b-8c08-5e1739ea5d69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69031436-19d1-4cc1-91e7-4d99381b6ae3", "tag": "516728bc-fbfa-4318-bbac-6c94509ee008"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:51:11 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-2d5e49ba-3080-484a-bde9-020b497f0d6d req-23eacc69-f06e-429b-8c08-5e1739ea5d69 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:51:11 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-2d5e49ba-3080-484a-bde9-020b497f0d6d req-23eacc69-f06e-429b-8c08-5e1739ea5d69 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:51:11 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-2d5e49ba-3080-484a-bde9-020b497f0d6d req-23eacc69-f06e-429b-8c08-5e1739ea5d69 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:51:11 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-2d5e49ba-3080-484a-bde9-020b497f0d6d req-23eacc69-f06e-429b-8c08-5e1739ea5d69 service nova] Creating event network-changed:516728bc-fbfa-4318-bbac-6c94509ee008 for instance 69031436-19d1-4cc1-91e7-4d99381b6ae3 on user Apr 21 10:51:11 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-2d5e49ba-3080-484a-bde9-020b497f0d6d req-23eacc69-f06e-429b-8c08-5e1739ea5d69 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030200 Apr 21 10:51:11 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 69/204] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:51:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:51:13 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [req-7777a554-1712-427f-af25-3027ea387409 req-0e920e91-0fd6-4bd9-84fb-a5da7e8ff21b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69031436-19d1-4cc1-91e7-4d99381b6ae3", "name": "network-vif-plugged", "status": "completed", "tag": "516728bc-fbfa-4318-bbac-6c94509ee008"}]} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:51:13 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-7777a554-1712-427f-af25-3027ea387409 req-0e920e91-0fd6-4bd9-84fb-a5da7e8ff21b service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:51:13 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-7777a554-1712-427f-af25-3027ea387409 req-0e920e91-0fd6-4bd9-84fb-a5da7e8ff21b service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:51:13 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-7777a554-1712-427f-af25-3027ea387409 req-0e920e91-0fd6-4bd9-84fb-a5da7e8ff21b service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:51:13 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-7777a554-1712-427f-af25-3027ea387409 req-0e920e91-0fd6-4bd9-84fb-a5da7e8ff21b service nova] Creating event network-vif-plugged:516728bc-fbfa-4318-bbac-6c94509ee008 for instance 69031436-19d1-4cc1-91e7-4d99381b6ae3 on user Apr 21 10:51:13 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [req-7777a554-1712-427f-af25-3027ea387409 req-0e920e91-0fd6-4bd9-84fb-a5da7e8ff21b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030684 Apr 21 10:51:13 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 70/205] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:51:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:51:15 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [req-cb7ff0c8-672d-4f99-8da0-05bd839b7b4e req-ee6d9def-ffa5-4c0e-ac37-a0e5249d0f72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69031436-19d1-4cc1-91e7-4d99381b6ae3", "name": "network-vif-plugged", "status": "completed", "tag": "516728bc-fbfa-4318-bbac-6c94509ee008"}]} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:51:15 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:51:16 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-cb7ff0c8-672d-4f99-8da0-05bd839b7b4e req-ee6d9def-ffa5-4c0e-ac37-a0e5249d0f72 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:51:16 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-cb7ff0c8-672d-4f99-8da0-05bd839b7b4e req-ee6d9def-ffa5-4c0e-ac37-a0e5249d0f72 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:51:16 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-cb7ff0c8-672d-4f99-8da0-05bd839b7b4e req-ee6d9def-ffa5-4c0e-ac37-a0e5249d0f72 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:51:16 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:51:16 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-cb7ff0c8-672d-4f99-8da0-05bd839b7b4e req-ee6d9def-ffa5-4c0e-ac37-a0e5249d0f72 service nova] Creating event network-vif-plugged:516728bc-fbfa-4318-bbac-6c94509ee008 for instance 69031436-19d1-4cc1-91e7-4d99381b6ae3 on user Apr 21 10:51:16 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [req-cb7ff0c8-672d-4f99-8da0-05bd839b7b4e req-ee6d9def-ffa5-4c0e-ac37-a0e5249d0f72 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038862 Apr 21 10:51:16 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 67/206] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:51:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:51:18 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-d8fe6718-b596-43cc-9e62-87ca8cbaa249 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:51:18 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-d8fe6718-b596-43cc-9e62-87ca8cbaa249 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] [instance: 3dd95a26-8652-40f5-b357-3cbc8a38628a] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:51:18 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:51:18 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-d8fe6718-b596-43cc-9e62-87ca8cbaa249 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:51:18 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-d8fe6718-b596-43cc-9e62-87ca8cbaa249 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:51:18 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-d8fe6718-b596-43cc-9e62-87ca8cbaa249 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:51:18 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-d8fe6718-b596-43cc-9e62-87ca8cbaa249 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:51:18 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-d8fe6718-b596-43cc-9e62-87ca8cbaa249 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:51:18 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-d8fe6718-b596-43cc-9e62-87ca8cbaa249 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:51:18 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell1:SELECT=13 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:51:18 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-d8fe6718-b596-43cc-9e62-87ca8cbaa249 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] [instance: 3dd95a26-8652-40f5-b357-3cbc8a38628a] Going to try to terminate instance {{(pid=61319) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 10:51:19 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-d8fe6718-b596-43cc-9e62-87ca8cbaa249 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3dd95a26-8652-40f5-b357-3cbc8a38628a" status: 204 len: 0 microversion: 2.1 time: 0.111193 Apr 21 10:51:19 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 70/207] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 10:51:18 2023] DELETE /compute/v2.1/servers/3dd95a26-8652-40f5-b357-3cbc8a38628a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 10:51:19 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell0:SELECT=2 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:51:19 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell0:SELECT=6 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:51:19 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-63002f9d-ecd3-460f-b62d-6d32acd99018 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:51:19 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-63002f9d-ecd3-460f-b62d-6d32acd99018 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] [instance: 3dd95a26-8652-40f5-b357-3cbc8a38628a] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:51:19 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-63002f9d-ecd3-460f-b62d-6d32acd99018 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:51:19 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-63002f9d-ecd3-460f-b62d-6d32acd99018 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:51:19 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-63002f9d-ecd3-460f-b62d-6d32acd99018 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:51:19 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-63002f9d-ecd3-460f-b62d-6d32acd99018 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:51:19 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-63002f9d-ecd3-460f-b62d-6d32acd99018 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:51:19 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-63002f9d-ecd3-460f-b62d-6d32acd99018 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:51:19 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell0:SELECT=6 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:51:19 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [req-97cb3582-f730-4a89-a0bf-9546f7156f9e req-4be49072-ffcb-4d62-b574-ea802f8b8bce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dd95a26-8652-40f5-b357-3cbc8a38628a", "name": "network-vif-unplugged", "status": "completed", "tag": "76364ccf-028e-4291-b953-431265bcfabb"}]} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:51:19 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-97cb3582-f730-4a89-a0bf-9546f7156f9e req-4be49072-ffcb-4d62-b574-ea802f8b8bce service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:51:19 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-97cb3582-f730-4a89-a0bf-9546f7156f9e req-4be49072-ffcb-4d62-b574-ea802f8b8bce service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:51:19 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-97cb3582-f730-4a89-a0bf-9546f7156f9e req-4be49072-ffcb-4d62-b574-ea802f8b8bce service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:51:19 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-97cb3582-f730-4a89-a0bf-9546f7156f9e req-4be49072-ffcb-4d62-b574-ea802f8b8bce service nova] Creating event network-vif-unplugged:76364ccf-028e-4291-b953-431265bcfabb for instance 3dd95a26-8652-40f5-b357-3cbc8a38628a on user Apr 21 10:51:19 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [req-97cb3582-f730-4a89-a0bf-9546f7156f9e req-4be49072-ffcb-4d62-b574-ea802f8b8bce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037695 Apr 21 10:51:19 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 68/208] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:51:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:51:19 user devstack@n-api.service[61320]: DEBUG nova.policy [None req-63002f9d-ecd3-460f-b62d-6d32acd99018 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c600e01acfe140cabcdfe54958e66108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e77e1735854e0c966c42e9a613017f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61320) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:51:19 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-63002f9d-ecd3-460f-b62d-6d32acd99018 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3dd95a26-8652-40f5-b357-3cbc8a38628a" status: 200 len: 1501 microversion: 2.1 time: 0.363285 Apr 21 10:51:19 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 71/209] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:51:19 2023] GET /compute/v2.1/servers/3dd95a26-8652-40f5-b357-3cbc8a38628a => generated 1501 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:51:21 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-7f6c3b21-1e20-4e99-be21-9676f6098ee0 req-99eb1c7e-db16-4846-994b-afbafc61b497 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dd95a26-8652-40f5-b357-3cbc8a38628a", "name": "network-vif-plugged", "status": "completed", "tag": "76364ccf-028e-4291-b953-431265bcfabb"}, {"server_uuid": "3dd95a26-8652-40f5-b357-3cbc8a38628a", "name": "network-vif-deleted", "tag": "76364ccf-028e-4291-b953-431265bcfabb"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:51:21 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-7f6c3b21-1e20-4e99-be21-9676f6098ee0 req-99eb1c7e-db16-4846-994b-afbafc61b497 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:51:21 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-7f6c3b21-1e20-4e99-be21-9676f6098ee0 req-99eb1c7e-db16-4846-994b-afbafc61b497 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:51:21 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-7f6c3b21-1e20-4e99-be21-9676f6098ee0 req-99eb1c7e-db16-4846-994b-afbafc61b497 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:51:21 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-7f6c3b21-1e20-4e99-be21-9676f6098ee0 req-99eb1c7e-db16-4846-994b-afbafc61b497 service nova] Creating event network-vif-plugged:76364ccf-028e-4291-b953-431265bcfabb for instance 3dd95a26-8652-40f5-b357-3cbc8a38628a on user Apr 21 10:51:21 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-7f6c3b21-1e20-4e99-be21-9676f6098ee0 req-99eb1c7e-db16-4846-994b-afbafc61b497 service nova] Creating event network-vif-deleted:76364ccf-028e-4291-b953-431265bcfabb for instance 3dd95a26-8652-40f5-b357-3cbc8a38628a on user Apr 21 10:51:21 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-7f6c3b21-1e20-4e99-be21-9676f6098ee0 req-99eb1c7e-db16-4846-994b-afbafc61b497 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.028508 Apr 21 10:51:21 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 71/210] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:51:21 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:51:42 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_api:SELECT=3 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:51:42 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell1:SELECT=3 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:51:42 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-e1347d89-67e5-465a-81fd-0fd6ced54769 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:51:42 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-e1347d89-67e5-465a-81fd-0fd6ced54769 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] [instance: f4dda568-8f3b-40eb-aff3-64d3e759c310] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:51:42 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-e1347d89-67e5-465a-81fd-0fd6ced54769 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:51:42 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-e1347d89-67e5-465a-81fd-0fd6ced54769 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:51:42 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-e1347d89-67e5-465a-81fd-0fd6ced54769 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:51:42 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-e1347d89-67e5-465a-81fd-0fd6ced54769 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:51:42 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-e1347d89-67e5-465a-81fd-0fd6ced54769 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:51:42 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-e1347d89-67e5-465a-81fd-0fd6ced54769 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:51:43 user devstack@n-api.service[61318]: DEBUG nova.policy [None req-e1347d89-67e5-465a-81fd-0fd6ced54769 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c67d90b6014d9ea24ef2552006bc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad84a0e014f47ddaeaddc88bf16b0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61318) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:51:43 user devstack@n-api.service[61318]: DEBUG nova.policy [None req-e1347d89-67e5-465a-81fd-0fd6ced54769 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c67d90b6014d9ea24ef2552006bc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad84a0e014f47ddaeaddc88bf16b0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61318) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:51:43 user devstack@n-api.service[61318]: DEBUG nova.policy [None req-e1347d89-67e5-465a-81fd-0fd6ced54769 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c67d90b6014d9ea24ef2552006bc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad84a0e014f47ddaeaddc88bf16b0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61318) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:51:43 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-e1347d89-67e5-465a-81fd-0fd6ced54769 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f4dda568-8f3b-40eb-aff3-64d3e759c310" status: 200 len: 1692 microversion: 2.87 time: 0.782771 Apr 21 10:51:43 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 69/211] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 10:51:42 2023] GET /compute/v2.1/servers/f4dda568-8f3b-40eb-aff3-64d3e759c310 => generated 1692 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 10:51:56 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-b96d6c34-cb3a-45a0-a9b4-ff94c0b978e2 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:51:56 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-b96d6c34-cb3a-45a0-a9b4-ff94c0b978e2 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] [instance: 15bf9321-a92e-4be2-bcae-a943988c811a] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:51:56 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:51:56 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:51:56 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-b96d6c34-cb3a-45a0-a9b4-ff94c0b978e2 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:51:56 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-b96d6c34-cb3a-45a0-a9b4-ff94c0b978e2 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:51:56 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-b96d6c34-cb3a-45a0-a9b4-ff94c0b978e2 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:51:56 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-b96d6c34-cb3a-45a0-a9b4-ff94c0b978e2 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:51:56 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-b96d6c34-cb3a-45a0-a9b4-ff94c0b978e2 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:51:56 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-b96d6c34-cb3a-45a0-a9b4-ff94c0b978e2 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:51:56 user devstack@n-api.service[61320]: INFO nova.api.openstack.wsgi [None req-b96d6c34-cb3a-45a0-a9b4-ff94c0b978e2 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] HTTP exception thrown: Instance 15bf9321-a92e-4be2-bcae-a943988c811a could not be found. Apr 21 10:51:56 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-b96d6c34-cb3a-45a0-a9b4-ff94c0b978e2 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Request method failure captured: Apr 21 10:51:56 user devstack@n-api.service[61320]: request: GET /compute/v2.1/servers/15bf9321-a92e-4be2-bcae-a943988c811a HTTP/1.1 Apr 21 10:51:56 user devstack@n-api.service[61320]: Accept: application/json Apr 21 10:51:56 user devstack@n-api.service[61320]: Accept-Encoding: identity Apr 21 10:51:56 user devstack@n-api.service[61320]: Connection: close Apr 21 10:51:56 user devstack@n-api.service[61320]: Content-Length: 0 Apr 21 10:51:56 user devstack@n-api.service[61320]: Content-Type: application/json Apr 21 10:51:56 user devstack@n-api.service[61320]: Host: 10.0.0.210 Apr 21 10:51:56 user devstack@n-api.service[61320]: Openstack-System-Scope: None Apr 21 10:51:56 user devstack@n-api.service[61320]: User-Agent: python-urllib3/1.26.15 Apr 21 10:51:56 user devstack@n-api.service[61320]: X-Auth-Token: gAAAAABkQmmt934YXU7uDDeWOZ3t8vdmZoLsAxi8Y3KLLQmc0htZ75_0elEv1U_Z7KE8Z6aCvGauyNtMuFdrT1cSBe1n651dHUi_12EK9r5rbRMwypbbUnwpkr5OfapD8GWBPIyV1UDp852-YBu1Xg0dWZMUjsKNFbrL8VWZQ0RMrU8bkhvN1EQ Apr 21 10:51:56 user devstack@n-api.service[61320]: X-Domain-Id: None Apr 21 10:51:56 user devstack@n-api.service[61320]: X-Domain-Name: None Apr 21 10:51:56 user devstack@n-api.service[61320]: X-Identity-Status: Confirmed Apr 21 10:51:56 user devstack@n-api.service[61320]: X-Is-Admin-Project: True Apr 21 10:51:56 user devstack@n-api.service[61320]: X-Project-Domain-Id: default Apr 21 10:51:56 user devstack@n-api.service[61320]: X-Project-Domain-Name: Default Apr 21 10:51:56 user devstack@n-api.service[61320]: X-Project-Id: 4bdd7a4ccfc340aa9c1b02c57f7a0e70 Apr 21 10:51:56 user devstack@n-api.service[61320]: X-Project-Name: tempest-ServerStableDeviceRescueTest-335595160 Apr 21 10:51:56 user devstack@n-api.service[61320]: X-Role: reader,member Apr 21 10:51:56 user devstack@n-api.service[61320]: X-Roles: reader,member Apr 21 10:51:56 user devstack@n-api.service[61320]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4bdd7a4ccfc340aa9c1b02c57f7a0e70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4bdd7a4ccfc340aa9c1b02c57f7a0e70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4bdd7a4ccfc340aa9c1b02c57f7a0e70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 10:51:56 user devstack@n-api.service[61320]: X-Tenant: tempest-ServerStableDeviceRescueTest-335595160 Apr 21 10:51:56 user devstack@n-api.service[61320]: X-Tenant-Id: 4bdd7a4ccfc340aa9c1b02c57f7a0e70 Apr 21 10:51:56 user devstack@n-api.service[61320]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-335595160 Apr 21 10:51:56 user devstack@n-api.service[61320]: X-User: tempest-ServerStableDeviceRescueTest-335595160-project-member Apr 21 10:51:56 user devstack@n-api.service[61320]: X-User-Domain-Id: default Apr 21 10:51:56 user devstack@n-api.service[61320]: X-User-Domain-Name: Default Apr 21 10:51:56 user devstack@n-api.service[61320]: X-User-Id: d172d648a9474db082646a47a2840214 Apr 21 10:51:56 user devstack@n-api.service[61320]: X-User-Name: tempest-ServerStableDeviceRescueTest-335595160-project-member Apr 21 10:51:56 user devstack@n-api.service[61320]: method: > Apr 21 10:51:56 user devstack@n-api.service[61320]: exception: Instance 15bf9321-a92e-4be2-bcae-a943988c811a could not be found. Apr 21 10:51:56 user devstack@n-api.service[61320]: action_args: {'id': '15bf9321-a92e-4be2-bcae-a943988c811a'} Apr 21 10:51:56 user devstack@n-api.service[61320]: {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 10:51:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:51:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 10:51:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 10:51:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 10:51:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 10:51:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 10:51:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 10:51:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 10:51:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 10:51:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15bf9321-a92e-4be2-bcae-a943988c811a could not be found. Apr 21 10:51:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:51:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:51:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:51:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:51:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 10:51:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 10:51:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 10:51:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 10:51:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 10:51:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 10:51:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 10:51:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 10:51:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 10:51:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 10:51:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 10:51:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 10:51:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15bf9321-a92e-4be2-bcae-a943988c811a could not be found. Apr 21 10:51:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:51:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:51:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:51:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:51:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 10:51:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 10:51:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 10:51:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 10:51:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15bf9321-a92e-4be2-bcae-a943988c811a could not be found. Apr 21 10:51:56 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:51:56 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-b96d6c34-cb3a-45a0-a9b4-ff94c0b978e2 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Returning 404 to user: Instance 15bf9321-a92e-4be2-bcae-a943988c811a could not be found. {{(pid=61320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 10:51:56 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-b96d6c34-cb3a-45a0-a9b4-ff94c0b978e2 tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15bf9321-a92e-4be2-bcae-a943988c811a" status: 404 len: 111 microversion: 2.1 time: 0.033120 Apr 21 10:51:56 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 72/212] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:51:56 2023] GET /compute/v2.1/servers/15bf9321-a92e-4be2-bcae-a943988c811a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 10:51:56 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_api:SELECT=8,nova_api:UPDATE=1 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:51:56 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:51:56 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-cfdc602e-92f8-43f5-a1d0-9fb66aacd79e tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] Calling method '.version_select at 0x7f91a5ec72e0>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:51:56 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-cfdc602e-92f8-43f5-a1d0-9fb66aacd79e tempest-ServerStableDeviceRescueTest-335595160 tempest-ServerStableDeviceRescueTest-335595160-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-474843765" status: 202 len: 0 microversion: 2.1 time: 0.029919 Apr 21 10:51:56 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 72/213] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 21 10:51:56 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-474843765 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 10:51:57 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-01d3b2b2-f50a-41dd-8c63-ca05a456f40b tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:51:57 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-01d3b2b2-f50a-41dd-8c63-ca05a456f40b tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] [instance: 566040e7-8140-467b-b814-8d7eb62ef735] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:51:57 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell1:SELECT=6 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:51:57 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_api:SELECT=4 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:51:57 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-01d3b2b2-f50a-41dd-8c63-ca05a456f40b tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:51:57 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-01d3b2b2-f50a-41dd-8c63-ca05a456f40b tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:51:57 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-01d3b2b2-f50a-41dd-8c63-ca05a456f40b tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:51:57 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-01d3b2b2-f50a-41dd-8c63-ca05a456f40b tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:51:57 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-01d3b2b2-f50a-41dd-8c63-ca05a456f40b tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:51:57 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-01d3b2b2-f50a-41dd-8c63-ca05a456f40b tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:51:57 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-01d3b2b2-f50a-41dd-8c63-ca05a456f40b tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] 10.0.0.210 "GET /compute/v2.1/servers/566040e7-8140-467b-b814-8d7eb62ef735/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.311291 Apr 21 10:51:57 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 70/214] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 21 10:51:57 2023] GET /compute/v2.1/servers/566040e7-8140-467b-b814-8d7eb62ef735/os-interface => generated 282 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:51:58 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [req-d9653557-6983-462d-8ce7-a655d9949ca2 req-fedebd5a-12a6-438a-9a43-36c6f6ea4f95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "566040e7-8140-467b-b814-8d7eb62ef735", "tag": "69a7ef96-ead5-4890-a014-d86e90fa5050"}]} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:51:58 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-d9653557-6983-462d-8ce7-a655d9949ca2 req-fedebd5a-12a6-438a-9a43-36c6f6ea4f95 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:51:58 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-d9653557-6983-462d-8ce7-a655d9949ca2 req-fedebd5a-12a6-438a-9a43-36c6f6ea4f95 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:51:58 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-d9653557-6983-462d-8ce7-a655d9949ca2 req-fedebd5a-12a6-438a-9a43-36c6f6ea4f95 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:51:58 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-d9653557-6983-462d-8ce7-a655d9949ca2 req-fedebd5a-12a6-438a-9a43-36c6f6ea4f95 service nova] Creating event network-changed:69a7ef96-ead5-4890-a014-d86e90fa5050 for instance 566040e7-8140-467b-b814-8d7eb62ef735 on user Apr 21 10:51:58 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [req-d9653557-6983-462d-8ce7-a655d9949ca2 req-fedebd5a-12a6-438a-9a43-36c6f6ea4f95 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036206 Apr 21 10:51:58 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 73/215] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:51:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:51:58 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-62489e45-db39-48a9-bcc5-b4e7c0803d60 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:51:58 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-62489e45-db39-48a9-bcc5-b4e7c0803d60 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] [instance: 566040e7-8140-467b-b814-8d7eb62ef735] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:51:58 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-62489e45-db39-48a9-bcc5-b4e7c0803d60 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:51:58 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-62489e45-db39-48a9-bcc5-b4e7c0803d60 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:51:58 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-62489e45-db39-48a9-bcc5-b4e7c0803d60 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:51:58 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-62489e45-db39-48a9-bcc5-b4e7c0803d60 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:51:58 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-62489e45-db39-48a9-bcc5-b4e7c0803d60 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:51:58 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-62489e45-db39-48a9-bcc5-b4e7c0803d60 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:51:58 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-62489e45-db39-48a9-bcc5-b4e7c0803d60 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] 10.0.0.210 "GET /compute/v2.1/servers/566040e7-8140-467b-b814-8d7eb62ef735/ips" status: 200 len: 104 microversion: 2.1 time: 0.036564 Apr 21 10:51:58 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 73/216] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 21 10:51:58 2023] GET /compute/v2.1/servers/566040e7-8140-467b-b814-8d7eb62ef735/ips => generated 104 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:51:59 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-e39a3e91-5dc9-4e61-ad85-68390dc14fc8 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:51:59 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-e39a3e91-5dc9-4e61-ad85-68390dc14fc8 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] [instance: 69031436-19d1-4cc1-91e7-4d99381b6ae3] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:51:59 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-e39a3e91-5dc9-4e61-ad85-68390dc14fc8 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:51:59 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-e39a3e91-5dc9-4e61-ad85-68390dc14fc8 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:51:59 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-e39a3e91-5dc9-4e61-ad85-68390dc14fc8 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:51:59 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-e39a3e91-5dc9-4e61-ad85-68390dc14fc8 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:51:59 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-e39a3e91-5dc9-4e61-ad85-68390dc14fc8 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:51:59 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-e39a3e91-5dc9-4e61-ad85-68390dc14fc8 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:51:59 user devstack@n-api.service[61318]: DEBUG nova.policy [None req-e39a3e91-5dc9-4e61-ad85-68390dc14fc8 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cae5a1734d24ac8aebc233dd31d3084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead44a7da0640cbb2cf8dece0ea4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61318) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:51:59 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-e39a3e91-5dc9-4e61-ad85-68390dc14fc8 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] 10.0.0.210 "GET /compute/v2.1/servers/69031436-19d1-4cc1-91e7-4d99381b6ae3" status: 200 len: 1537 microversion: 2.1 time: 0.410316 Apr 21 10:51:59 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 71/217] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:51:59 2023] GET /compute/v2.1/servers/69031436-19d1-4cc1-91e7-4d99381b6ae3 => generated 1537 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:52:00 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-a9121c5e-edc0-4d82-8ca3-776b8063a533 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:52:00 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-a9121c5e-edc0-4d82-8ca3-776b8063a533 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] [instance: 566040e7-8140-467b-b814-8d7eb62ef735] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:52:00 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-a9121c5e-edc0-4d82-8ca3-776b8063a533 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:52:00 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-a9121c5e-edc0-4d82-8ca3-776b8063a533 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:52:00 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-a9121c5e-edc0-4d82-8ca3-776b8063a533 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:52:00 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-a9121c5e-edc0-4d82-8ca3-776b8063a533 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:52:00 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-a9121c5e-edc0-4d82-8ca3-776b8063a533 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:52:00 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-a9121c5e-edc0-4d82-8ca3-776b8063a533 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:52:00 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-a9121c5e-edc0-4d82-8ca3-776b8063a533 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] [instance: 566040e7-8140-467b-b814-8d7eb62ef735] Going to try to terminate instance {{(pid=61320) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 10:52:00 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-a9121c5e-edc0-4d82-8ca3-776b8063a533 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/566040e7-8140-467b-b814-8d7eb62ef735" status: 204 len: 0 microversion: 2.1 time: 0.144945 Apr 21 10:52:00 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 74/218] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 10:52:00 2023] DELETE /compute/v2.1/servers/566040e7-8140-467b-b814-8d7eb62ef735 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 10:52:00 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-ec5cbe23-e040-4c6c-aded-f4f27c2eede7 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:52:00 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-ec5cbe23-e040-4c6c-aded-f4f27c2eede7 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] [instance: 566040e7-8140-467b-b814-8d7eb62ef735] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:52:00 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-ec5cbe23-e040-4c6c-aded-f4f27c2eede7 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:52:00 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-ec5cbe23-e040-4c6c-aded-f4f27c2eede7 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:52:00 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-ec5cbe23-e040-4c6c-aded-f4f27c2eede7 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:52:00 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-ec5cbe23-e040-4c6c-aded-f4f27c2eede7 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:52:00 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-ec5cbe23-e040-4c6c-aded-f4f27c2eede7 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:52:00 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-ec5cbe23-e040-4c6c-aded-f4f27c2eede7 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:52:00 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [req-620b215c-ffe9-4411-a30f-3134a16a9fc1 req-bcc81eba-e070-4fbc-85d2-e5eef0b1ff75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "566040e7-8140-467b-b814-8d7eb62ef735", "name": "network-vif-unplugged", "status": "completed", "tag": "69a7ef96-ead5-4890-a014-d86e90fa5050"}]} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:52:00 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-620b215c-ffe9-4411-a30f-3134a16a9fc1 req-bcc81eba-e070-4fbc-85d2-e5eef0b1ff75 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:52:00 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-620b215c-ffe9-4411-a30f-3134a16a9fc1 req-bcc81eba-e070-4fbc-85d2-e5eef0b1ff75 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:52:00 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-620b215c-ffe9-4411-a30f-3134a16a9fc1 req-bcc81eba-e070-4fbc-85d2-e5eef0b1ff75 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:52:00 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-620b215c-ffe9-4411-a30f-3134a16a9fc1 req-bcc81eba-e070-4fbc-85d2-e5eef0b1ff75 service nova] Creating event network-vif-unplugged:69a7ef96-ead5-4890-a014-d86e90fa5050 for instance 566040e7-8140-467b-b814-8d7eb62ef735 on user Apr 21 10:52:00 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [req-620b215c-ffe9-4411-a30f-3134a16a9fc1 req-bcc81eba-e070-4fbc-85d2-e5eef0b1ff75 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031357 Apr 21 10:52:00 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 72/219] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:52:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 10:52:00 user devstack@n-api.service[61319]: DEBUG nova.policy [None req-ec5cbe23-e040-4c6c-aded-f4f27c2eede7 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fb0d890b594080bb1bb99dd6294ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd85f51547e5244e495343281725fe320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61319) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:52:00 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-ec5cbe23-e040-4c6c-aded-f4f27c2eede7 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] 10.0.0.210 "GET /compute/v2.1/servers/566040e7-8140-467b-b814-8d7eb62ef735" status: 200 len: 1659 microversion: 2.1 time: 0.509842 Apr 21 10:52:00 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 74/220] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:52:00 2023] GET /compute/v2.1/servers/566040e7-8140-467b-b814-8d7eb62ef735 => generated 1659 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:52:00 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-ac2a5a1e-5f9e-4c24-b0f9-3bbcd29f371f tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:52:00 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-ac2a5a1e-5f9e-4c24-b0f9-3bbcd29f371f tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] [instance: f8609da3-c26d-482a-bc03-017baf4bce22] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:52:00 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-ac2a5a1e-5f9e-4c24-b0f9-3bbcd29f371f tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:52:00 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-ac2a5a1e-5f9e-4c24-b0f9-3bbcd29f371f tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:52:00 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-ac2a5a1e-5f9e-4c24-b0f9-3bbcd29f371f tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:52:00 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-ac2a5a1e-5f9e-4c24-b0f9-3bbcd29f371f tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:52:00 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-ac2a5a1e-5f9e-4c24-b0f9-3bbcd29f371f tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:52:00 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-ac2a5a1e-5f9e-4c24-b0f9-3bbcd29f371f tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:52:01 user devstack@n-api.service[61320]: DEBUG nova.policy [None req-ac2a5a1e-5f9e-4c24-b0f9-3bbcd29f371f tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced216baa4a64c72946cf3f71eb873dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648163a728fc4b28b85a24e9198d356b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61320) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:52:01 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-ac2a5a1e-5f9e-4c24-b0f9-3bbcd29f371f tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8609da3-c26d-482a-bc03-017baf4bce22" status: 200 len: 1656 microversion: 2.1 time: 0.725625 Apr 21 10:52:01 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 75/221] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:52:00 2023] GET /compute/v2.1/servers/f8609da3-c26d-482a-bc03-017baf4bce22 => generated 1656 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:52:01 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-60b3d21c-5cc2-4ec9-843b-55df4dc1b082 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:52:01 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-60b3d21c-5cc2-4ec9-843b-55df4dc1b082 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] [instance: f8609da3-c26d-482a-bc03-017baf4bce22] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:52:01 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-60b3d21c-5cc2-4ec9-843b-55df4dc1b082 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:52:01 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-60b3d21c-5cc2-4ec9-843b-55df4dc1b082 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:52:01 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-60b3d21c-5cc2-4ec9-843b-55df4dc1b082 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:52:01 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-60b3d21c-5cc2-4ec9-843b-55df4dc1b082 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:52:01 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-60b3d21c-5cc2-4ec9-843b-55df4dc1b082 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:52:01 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-60b3d21c-5cc2-4ec9-843b-55df4dc1b082 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:52:01 user devstack@n-api.service[61318]: DEBUG nova.policy [None req-60b3d21c-5cc2-4ec9-843b-55df4dc1b082 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced216baa4a64c72946cf3f71eb873dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648163a728fc4b28b85a24e9198d356b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61318) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:52:01 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-60b3d21c-5cc2-4ec9-843b-55df4dc1b082 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8609da3-c26d-482a-bc03-017baf4bce22" status: 200 len: 1656 microversion: 2.1 time: 0.218705 Apr 21 10:52:01 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 73/222] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:52:01 2023] GET /compute/v2.1/servers/f8609da3-c26d-482a-bc03-017baf4bce22 => generated 1656 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:52:01 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-5cd5aa44-bea2-44ca-8852-ef218c9fad0d tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:52:01 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-5cd5aa44-bea2-44ca-8852-ef218c9fad0d tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] [instance: f8609da3-c26d-482a-bc03-017baf4bce22] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:52:01 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-5cd5aa44-bea2-44ca-8852-ef218c9fad0d tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:52:01 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-5cd5aa44-bea2-44ca-8852-ef218c9fad0d tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:52:01 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-5cd5aa44-bea2-44ca-8852-ef218c9fad0d tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:52:01 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-5cd5aa44-bea2-44ca-8852-ef218c9fad0d tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:52:01 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-5cd5aa44-bea2-44ca-8852-ef218c9fad0d tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:52:01 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-5cd5aa44-bea2-44ca-8852-ef218c9fad0d tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:52:02 user devstack@n-api.service[61319]: DEBUG nova.policy [None req-5cd5aa44-bea2-44ca-8852-ef218c9fad0d tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced216baa4a64c72946cf3f71eb873dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648163a728fc4b28b85a24e9198d356b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61319) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:52:02 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-5cd5aa44-bea2-44ca-8852-ef218c9fad0d tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8609da3-c26d-482a-bc03-017baf4bce22" status: 200 len: 1656 microversion: 2.1 time: 0.364519 Apr 21 10:52:02 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 75/223] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:52:01 2023] GET /compute/v2.1/servers/f8609da3-c26d-482a-bc03-017baf4bce22 => generated 1656 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:52:02 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [req-fffdb6fe-5ef3-4e6b-8f0e-ffbf438572b5 req-286157a5-b142-462b-93ce-7366a985bdd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "566040e7-8140-467b-b814-8d7eb62ef735", "name": "network-vif-deleted", "tag": "69a7ef96-ead5-4890-a014-d86e90fa5050"}]} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:52:02 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-fffdb6fe-5ef3-4e6b-8f0e-ffbf438572b5 req-286157a5-b142-462b-93ce-7366a985bdd5 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:52:02 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-fffdb6fe-5ef3-4e6b-8f0e-ffbf438572b5 req-286157a5-b142-462b-93ce-7366a985bdd5 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:52:02 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-fffdb6fe-5ef3-4e6b-8f0e-ffbf438572b5 req-286157a5-b142-462b-93ce-7366a985bdd5 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:52:02 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-fffdb6fe-5ef3-4e6b-8f0e-ffbf438572b5 req-286157a5-b142-462b-93ce-7366a985bdd5 service nova] Creating event network-vif-deleted:69a7ef96-ead5-4890-a014-d86e90fa5050 for instance 566040e7-8140-467b-b814-8d7eb62ef735 on user Apr 21 10:52:02 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [req-fffdb6fe-5ef3-4e6b-8f0e-ffbf438572b5 req-286157a5-b142-462b-93ce-7366a985bdd5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034209 Apr 21 10:52:02 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 76/224] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:52:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:52:02 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [req-3c6ad9fe-5a26-41d2-9c7d-ab01e71527eb req-36cc3ecf-0383-4f53-a8f5-bdabc7ceac34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "566040e7-8140-467b-b814-8d7eb62ef735", "name": "network-vif-plugged", "status": "completed", "tag": "69a7ef96-ead5-4890-a014-d86e90fa5050"}]} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:52:02 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-3c6ad9fe-5a26-41d2-9c7d-ab01e71527eb req-36cc3ecf-0383-4f53-a8f5-bdabc7ceac34 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:52:02 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-3c6ad9fe-5a26-41d2-9c7d-ab01e71527eb req-36cc3ecf-0383-4f53-a8f5-bdabc7ceac34 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:52:02 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-3c6ad9fe-5a26-41d2-9c7d-ab01e71527eb req-36cc3ecf-0383-4f53-a8f5-bdabc7ceac34 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:52:02 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-3c6ad9fe-5a26-41d2-9c7d-ab01e71527eb req-36cc3ecf-0383-4f53-a8f5-bdabc7ceac34 service nova] Creating event network-vif-plugged:69a7ef96-ead5-4890-a014-d86e90fa5050 for instance 566040e7-8140-467b-b814-8d7eb62ef735 on user Apr 21 10:52:02 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [req-3c6ad9fe-5a26-41d2-9c7d-ab01e71527eb req-36cc3ecf-0383-4f53-a8f5-bdabc7ceac34 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028064 Apr 21 10:52:02 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 74/225] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:52:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:52:09 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-708fae75-e245-4b4e-bcc1-d7ec4b72a639 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:52:09 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-708fae75-e245-4b4e-bcc1-d7ec4b72a639 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] [instance: 3dd95a26-8652-40f5-b357-3cbc8a38628a] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:52:09 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-708fae75-e245-4b4e-bcc1-d7ec4b72a639 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:52:09 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-708fae75-e245-4b4e-bcc1-d7ec4b72a639 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:52:09 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-708fae75-e245-4b4e-bcc1-d7ec4b72a639 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:52:09 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-708fae75-e245-4b4e-bcc1-d7ec4b72a639 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:52:09 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-708fae75-e245-4b4e-bcc1-d7ec4b72a639 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:52:09 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-708fae75-e245-4b4e-bcc1-d7ec4b72a639 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:52:09 user devstack@n-api.service[61319]: INFO nova.api.openstack.wsgi [None req-708fae75-e245-4b4e-bcc1-d7ec4b72a639 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] HTTP exception thrown: Instance 3dd95a26-8652-40f5-b357-3cbc8a38628a could not be found. Apr 21 10:52:09 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-708fae75-e245-4b4e-bcc1-d7ec4b72a639 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Request method failure captured: Apr 21 10:52:09 user devstack@n-api.service[61319]: request: GET /compute/v2.1/servers/3dd95a26-8652-40f5-b357-3cbc8a38628a HTTP/1.1 Apr 21 10:52:09 user devstack@n-api.service[61319]: Accept: application/json Apr 21 10:52:09 user devstack@n-api.service[61319]: Accept-Encoding: identity Apr 21 10:52:09 user devstack@n-api.service[61319]: Connection: close Apr 21 10:52:09 user devstack@n-api.service[61319]: Content-Length: 0 Apr 21 10:52:09 user devstack@n-api.service[61319]: Content-Type: application/json Apr 21 10:52:09 user devstack@n-api.service[61319]: Host: 10.0.0.210 Apr 21 10:52:09 user devstack@n-api.service[61319]: Openstack-System-Scope: None Apr 21 10:52:09 user devstack@n-api.service[61319]: User-Agent: python-urllib3/1.26.15 Apr 21 10:52:09 user devstack@n-api.service[61319]: X-Auth-Token: gAAAAABkQmmw-awH0BMXKrfo3YW1ctVO3zusEKCx5o8dxiv3co6lDaAMv_ajdIXsHgnHhuHUpuTMaSZSaXKS-zrhkGe2pfDtmILxh1gg-h9QBH9NODDO6bpXMPd4ivXY4t1Ef0v552wkATg__FY5HJgzwhZr0Qm7QMNpWOYcnh0LrVkOEERYfqg Apr 21 10:52:09 user devstack@n-api.service[61319]: X-Domain-Id: None Apr 21 10:52:09 user devstack@n-api.service[61319]: X-Domain-Name: None Apr 21 10:52:09 user devstack@n-api.service[61319]: X-Identity-Status: Confirmed Apr 21 10:52:09 user devstack@n-api.service[61319]: X-Is-Admin-Project: True Apr 21 10:52:09 user devstack@n-api.service[61319]: X-Project-Domain-Id: default Apr 21 10:52:09 user devstack@n-api.service[61319]: X-Project-Domain-Name: Default Apr 21 10:52:09 user devstack@n-api.service[61319]: X-Project-Id: 94e77e1735854e0c966c42e9a613017f Apr 21 10:52:09 user devstack@n-api.service[61319]: X-Project-Name: tempest-VolumesAdminNegativeTest-243340095 Apr 21 10:52:09 user devstack@n-api.service[61319]: X-Role: reader,member Apr 21 10:52:09 user devstack@n-api.service[61319]: X-Roles: reader,member Apr 21 10:52:09 user devstack@n-api.service[61319]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/94e77e1735854e0c966c42e9a613017f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/94e77e1735854e0c966c42e9a613017f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/94e77e1735854e0c966c42e9a613017f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 10:52:09 user devstack@n-api.service[61319]: X-Tenant: tempest-VolumesAdminNegativeTest-243340095 Apr 21 10:52:09 user devstack@n-api.service[61319]: X-Tenant-Id: 94e77e1735854e0c966c42e9a613017f Apr 21 10:52:09 user devstack@n-api.service[61319]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-243340095 Apr 21 10:52:09 user devstack@n-api.service[61319]: X-User: tempest-VolumesAdminNegativeTest-243340095-project-member Apr 21 10:52:09 user devstack@n-api.service[61319]: X-User-Domain-Id: default Apr 21 10:52:09 user devstack@n-api.service[61319]: X-User-Domain-Name: Default Apr 21 10:52:09 user devstack@n-api.service[61319]: X-User-Id: c600e01acfe140cabcdfe54958e66108 Apr 21 10:52:09 user devstack@n-api.service[61319]: X-User-Name: tempest-VolumesAdminNegativeTest-243340095-project-member Apr 21 10:52:09 user devstack@n-api.service[61319]: method: > Apr 21 10:52:09 user devstack@n-api.service[61319]: exception: Instance 3dd95a26-8652-40f5-b357-3cbc8a38628a could not be found. Apr 21 10:52:09 user devstack@n-api.service[61319]: action_args: {'id': '3dd95a26-8652-40f5-b357-3cbc8a38628a'} Apr 21 10:52:09 user devstack@n-api.service[61319]: {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 10:52:09 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:52:09 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 10:52:09 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 10:52:09 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 10:52:09 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 10:52:09 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 10:52:09 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 10:52:09 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 10:52:09 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 10:52:09 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dd95a26-8652-40f5-b357-3cbc8a38628a could not be found. Apr 21 10:52:09 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:52:09 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:52:09 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:52:09 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:52:09 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 10:52:09 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 10:52:09 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 10:52:09 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 10:52:09 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 10:52:09 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 10:52:09 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 10:52:09 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 10:52:09 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 10:52:09 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 10:52:09 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 10:52:09 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 10:52:09 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dd95a26-8652-40f5-b357-3cbc8a38628a could not be found. Apr 21 10:52:09 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:52:09 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:52:09 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:52:09 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:52:09 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 10:52:09 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 10:52:09 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 10:52:09 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 10:52:09 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dd95a26-8652-40f5-b357-3cbc8a38628a could not be found. Apr 21 10:52:09 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:52:09 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-708fae75-e245-4b4e-bcc1-d7ec4b72a639 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Returning 404 to user: Instance 3dd95a26-8652-40f5-b357-3cbc8a38628a could not be found. {{(pid=61319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 10:52:09 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-708fae75-e245-4b4e-bcc1-d7ec4b72a639 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3dd95a26-8652-40f5-b357-3cbc8a38628a" status: 404 len: 111 microversion: 2.1 time: 0.026636 Apr 21 10:52:09 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 76/226] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:52:09 2023] GET /compute/v2.1/servers/3dd95a26-8652-40f5-b357-3cbc8a38628a => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 10:52:09 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-35d6b6b8-1e2e-434a-8085-b53ca92f641f tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:52:09 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-35d6b6b8-1e2e-434a-8085-b53ca92f641f tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] [instance: 8ae797bd-c587-43a3-b941-e6d6d6c74e51] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:52:09 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-35d6b6b8-1e2e-434a-8085-b53ca92f641f tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:52:09 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-35d6b6b8-1e2e-434a-8085-b53ca92f641f tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:52:09 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-35d6b6b8-1e2e-434a-8085-b53ca92f641f tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:52:09 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-35d6b6b8-1e2e-434a-8085-b53ca92f641f tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:52:09 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-35d6b6b8-1e2e-434a-8085-b53ca92f641f tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:52:09 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-35d6b6b8-1e2e-434a-8085-b53ca92f641f tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:52:09 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-35d6b6b8-1e2e-434a-8085-b53ca92f641f tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] [instance: 8ae797bd-c587-43a3-b941-e6d6d6c74e51] Going to try to terminate instance {{(pid=61320) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 10:52:09 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-35d6b6b8-1e2e-434a-8085-b53ca92f641f tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8ae797bd-c587-43a3-b941-e6d6d6c74e51" status: 204 len: 0 microversion: 2.1 time: 0.128609 Apr 21 10:52:09 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 77/227] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 10:52:09 2023] DELETE /compute/v2.1/servers/8ae797bd-c587-43a3-b941-e6d6d6c74e51 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 10:52:09 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-8defbe62-f760-4507-be7f-eac7f477e4b4 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:52:09 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-8defbe62-f760-4507-be7f-eac7f477e4b4 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] [instance: 8ae797bd-c587-43a3-b941-e6d6d6c74e51] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:52:09 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-8defbe62-f760-4507-be7f-eac7f477e4b4 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:52:09 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-8defbe62-f760-4507-be7f-eac7f477e4b4 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:52:09 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-8defbe62-f760-4507-be7f-eac7f477e4b4 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:52:09 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-8defbe62-f760-4507-be7f-eac7f477e4b4 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:52:09 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-8defbe62-f760-4507-be7f-eac7f477e4b4 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:52:09 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-8defbe62-f760-4507-be7f-eac7f477e4b4 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:52:10 user devstack@n-api.service[61318]: DEBUG nova.policy [None req-8defbe62-f760-4507-be7f-eac7f477e4b4 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c600e01acfe140cabcdfe54958e66108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e77e1735854e0c966c42e9a613017f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61318) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:52:10 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-922b39b9-0f5e-4900-91af-95724bb537e6 req-1d9b86bc-04cb-441d-b6d0-d9dc028fe27c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ae797bd-c587-43a3-b941-e6d6d6c74e51", "name": "network-vif-unplugged", "status": "completed", "tag": "44d4e2d5-0850-4b05-9d97-f3916611f340"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:52:10 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-8defbe62-f760-4507-be7f-eac7f477e4b4 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8ae797bd-c587-43a3-b941-e6d6d6c74e51" status: 200 len: 1670 microversion: 2.1 time: 0.318132 Apr 21 10:52:10 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 75/228] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:52:09 2023] GET /compute/v2.1/servers/8ae797bd-c587-43a3-b941-e6d6d6c74e51 => generated 1670 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:52:10 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-922b39b9-0f5e-4900-91af-95724bb537e6 req-1d9b86bc-04cb-441d-b6d0-d9dc028fe27c service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:52:10 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-922b39b9-0f5e-4900-91af-95724bb537e6 req-1d9b86bc-04cb-441d-b6d0-d9dc028fe27c service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:52:10 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-922b39b9-0f5e-4900-91af-95724bb537e6 req-1d9b86bc-04cb-441d-b6d0-d9dc028fe27c service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:52:10 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-922b39b9-0f5e-4900-91af-95724bb537e6 req-1d9b86bc-04cb-441d-b6d0-d9dc028fe27c service nova] Creating event network-vif-unplugged:44d4e2d5-0850-4b05-9d97-f3916611f340 for instance 8ae797bd-c587-43a3-b941-e6d6d6c74e51 on user Apr 21 10:52:10 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-922b39b9-0f5e-4900-91af-95724bb537e6 req-1d9b86bc-04cb-441d-b6d0-d9dc028fe27c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038548 Apr 21 10:52:10 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 77/229] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:52:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:52:11 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [req-f37d5d7d-3a66-4116-b98a-a6ae0dc0f90b req-71d918cf-89d2-4378-853b-1032e4b6aa03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ae797bd-c587-43a3-b941-e6d6d6c74e51", "name": "network-vif-deleted", "tag": "44d4e2d5-0850-4b05-9d97-f3916611f340"}]} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:52:11 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-f37d5d7d-3a66-4116-b98a-a6ae0dc0f90b req-71d918cf-89d2-4378-853b-1032e4b6aa03 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:52:11 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-f37d5d7d-3a66-4116-b98a-a6ae0dc0f90b req-71d918cf-89d2-4378-853b-1032e4b6aa03 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:52:11 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-f37d5d7d-3a66-4116-b98a-a6ae0dc0f90b req-71d918cf-89d2-4378-853b-1032e4b6aa03 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:52:11 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-f37d5d7d-3a66-4116-b98a-a6ae0dc0f90b req-71d918cf-89d2-4378-853b-1032e4b6aa03 service nova] Creating event network-vif-deleted:44d4e2d5-0850-4b05-9d97-f3916611f340 for instance 8ae797bd-c587-43a3-b941-e6d6d6c74e51 on user Apr 21 10:52:11 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [req-f37d5d7d-3a66-4116-b98a-a6ae0dc0f90b req-71d918cf-89d2-4378-853b-1032e4b6aa03 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034745 Apr 21 10:52:11 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 78/230] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:52:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:52:12 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [req-d45a66bd-574d-4234-bf87-ef2b24f7224c req-383d65a5-81f0-4351-864c-851917caa893 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ae797bd-c587-43a3-b941-e6d6d6c74e51", "name": "network-vif-plugged", "status": "completed", "tag": "44d4e2d5-0850-4b05-9d97-f3916611f340"}]} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:52:12 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-d45a66bd-574d-4234-bf87-ef2b24f7224c req-383d65a5-81f0-4351-864c-851917caa893 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:52:12 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-d45a66bd-574d-4234-bf87-ef2b24f7224c req-383d65a5-81f0-4351-864c-851917caa893 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:52:12 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-d45a66bd-574d-4234-bf87-ef2b24f7224c req-383d65a5-81f0-4351-864c-851917caa893 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:52:12 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-d45a66bd-574d-4234-bf87-ef2b24f7224c req-383d65a5-81f0-4351-864c-851917caa893 service nova] Creating event network-vif-plugged:44d4e2d5-0850-4b05-9d97-f3916611f340 for instance 8ae797bd-c587-43a3-b941-e6d6d6c74e51 on user Apr 21 10:52:12 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [req-d45a66bd-574d-4234-bf87-ef2b24f7224c req-383d65a5-81f0-4351-864c-851917caa893 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028574 Apr 21 10:52:12 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 76/231] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:52:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:52:18 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-642e0c11-4300-46d5-a9ef-cef9a8da52dc tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1210829464", "imageRef": "3b29a01a-1fc0-4d0d-89fb-23d22b2de02e", "flavorRef": "42", "networks": [{"uuid": "3fe4dad8-0e5a-4737-9c24-dc77d7b275ff"}]}} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:52:18 user devstack@n-api.service[61319]: DEBUG nova.network.neutron [None req-642e0c11-4300-46d5-a9ef-cef9a8da52dc tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] validate_networks() for [('3fe4dad8-0e5a-4737-9c24-dc77d7b275ff', None, None, None, None, None)] {{(pid=61319) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 10:52:19 user devstack@n-api.service[61319]: DEBUG nova.virt.hardware [None req-642e0c11-4300-46d5-a9ef-cef9a8da52dc tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Flavor limits 0:0:0 {{(pid=61319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 10:52:19 user devstack@n-api.service[61319]: DEBUG nova.virt.hardware [None req-642e0c11-4300-46d5-a9ef-cef9a8da52dc tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Image limits 0:0:0 {{(pid=61319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 10:52:19 user devstack@n-api.service[61319]: DEBUG nova.virt.hardware [None req-642e0c11-4300-46d5-a9ef-cef9a8da52dc tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Flavor pref 0:0:0 {{(pid=61319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 10:52:19 user devstack@n-api.service[61319]: DEBUG nova.virt.hardware [None req-642e0c11-4300-46d5-a9ef-cef9a8da52dc tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Image pref 0:0:0 {{(pid=61319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 10:52:19 user devstack@n-api.service[61319]: DEBUG nova.virt.hardware [None req-642e0c11-4300-46d5-a9ef-cef9a8da52dc tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 10:52:19 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-642e0c11-4300-46d5-a9ef-cef9a8da52dc tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:52:19 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-642e0c11-4300-46d5-a9ef-cef9a8da52dc tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:52:19 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-642e0c11-4300-46d5-a9ef-cef9a8da52dc tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:52:19 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-642e0c11-4300-46d5-a9ef-cef9a8da52dc tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:52:19 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-642e0c11-4300-46d5-a9ef-cef9a8da52dc tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:52:19 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-642e0c11-4300-46d5-a9ef-cef9a8da52dc tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:52:19 user devstack@n-api.service[61319]: DEBUG nova.quota [None req-642e0c11-4300-46d5-a9ef-cef9a8da52dc tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Getting quotas for project 8eaf2efa4ddc4d8fbc5ec14e86d93c53. Resources: {'cores', 'instances', 'ram'} {{(pid=61319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 10:52:19 user devstack@n-api.service[61319]: DEBUG nova.quota [None req-642e0c11-4300-46d5-a9ef-cef9a8da52dc tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Getting quotas for user dc80162b39bc4ff2a71a8ff4d34979c3 and project 8eaf2efa4ddc4d8fbc5ec14e86d93c53. Resources: {'cores', 'instances', 'ram'} {{(pid=61319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 10:52:19 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-642e0c11-4300-46d5-a9ef-cef9a8da52dc tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Going to run 1 instances... {{(pid=61319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 10:52:19 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-642e0c11-4300-46d5-a9ef-cef9a8da52dc tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] [instance: 14bd5401-4cc1-4827-8d4a-fd1358bb9c6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3b29a01a-1fc0-4d0d-89fb-23d22b2de02e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 10:52:19 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-642e0c11-4300-46d5-a9ef-cef9a8da52dc tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.967107 Apr 21 10:52:19 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 78/232] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 10:52:18 2023] POST /compute/v2.1/servers => generated 378 bytes in 968 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 10:52:19 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-da9a0737-5c69-4532-be6b-e618f8e9d253 tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:52:19 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-da9a0737-5c69-4532-be6b-e618f8e9d253 tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] [instance: 14bd5401-4cc1-4827-8d4a-fd1358bb9c6b] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:52:19 user devstack@n-api.service[61320]: DEBUG nova.policy [None req-da9a0737-5c69-4532-be6b-e618f8e9d253 tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc80162b39bc4ff2a71a8ff4d34979c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eaf2efa4ddc4d8fbc5ec14e86d93c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61320) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:52:19 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-da9a0737-5c69-4532-be6b-e618f8e9d253 tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14bd5401-4cc1-4827-8d4a-fd1358bb9c6b" status: 200 len: 1208 microversion: 2.1 time: 0.060806 Apr 21 10:52:19 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 79/233] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:52:19 2023] GET /compute/v2.1/servers/14bd5401-4cc1-4827-8d4a-fd1358bb9c6b => generated 1208 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:52:22 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_api:SELECT=14 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:52:22 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell1:SELECT=28 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:52:22 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [req-628a50aa-dbec-446e-a6cb-3177e51c3923 req-648cf59f-950b-4b95-8e00-624eff59a9aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14bd5401-4cc1-4827-8d4a-fd1358bb9c6b", "tag": "d8b0279f-95ca-4143-8f78-c6faf74a3620"}]} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:52:22 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-628a50aa-dbec-446e-a6cb-3177e51c3923 req-648cf59f-950b-4b95-8e00-624eff59a9aa service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:52:22 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-628a50aa-dbec-446e-a6cb-3177e51c3923 req-648cf59f-950b-4b95-8e00-624eff59a9aa service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:52:22 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-628a50aa-dbec-446e-a6cb-3177e51c3923 req-648cf59f-950b-4b95-8e00-624eff59a9aa service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:52:22 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-628a50aa-dbec-446e-a6cb-3177e51c3923 req-648cf59f-950b-4b95-8e00-624eff59a9aa service nova] Creating event network-changed:d8b0279f-95ca-4143-8f78-c6faf74a3620 for instance 14bd5401-4cc1-4827-8d4a-fd1358bb9c6b on user Apr 21 10:52:22 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [req-628a50aa-dbec-446e-a6cb-3177e51c3923 req-648cf59f-950b-4b95-8e00-624eff59a9aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121243 Apr 21 10:52:22 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 77/234] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:52:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:52:24 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-fcaea8c4-3d8d-4b0c-a02d-c145127175b1 req-586ef544-9d4a-4317-9ce6-5e6365efe1e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14bd5401-4cc1-4827-8d4a-fd1358bb9c6b", "name": "network-vif-plugged", "status": "completed", "tag": "d8b0279f-95ca-4143-8f78-c6faf74a3620"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:52:24 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-fcaea8c4-3d8d-4b0c-a02d-c145127175b1 req-586ef544-9d4a-4317-9ce6-5e6365efe1e4 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:52:24 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-fcaea8c4-3d8d-4b0c-a02d-c145127175b1 req-586ef544-9d4a-4317-9ce6-5e6365efe1e4 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:52:24 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-fcaea8c4-3d8d-4b0c-a02d-c145127175b1 req-586ef544-9d4a-4317-9ce6-5e6365efe1e4 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:52:24 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-fcaea8c4-3d8d-4b0c-a02d-c145127175b1 req-586ef544-9d4a-4317-9ce6-5e6365efe1e4 service nova] Creating event network-vif-plugged:d8b0279f-95ca-4143-8f78-c6faf74a3620 for instance 14bd5401-4cc1-4827-8d4a-fd1358bb9c6b on user Apr 21 10:52:24 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-fcaea8c4-3d8d-4b0c-a02d-c145127175b1 req-586ef544-9d4a-4317-9ce6-5e6365efe1e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031435 Apr 21 10:52:24 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 79/235] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:52:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:52:26 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [req-b53f7d7f-eeff-440c-b142-d9495d99d5b8 req-a546f4d0-203a-4e9f-8d6c-c2c4309fb8b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14bd5401-4cc1-4827-8d4a-fd1358bb9c6b", "name": "network-vif-plugged", "status": "completed", "tag": "d8b0279f-95ca-4143-8f78-c6faf74a3620"}]} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:52:26 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:52:26 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-b53f7d7f-eeff-440c-b142-d9495d99d5b8 req-a546f4d0-203a-4e9f-8d6c-c2c4309fb8b7 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:52:26 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-b53f7d7f-eeff-440c-b142-d9495d99d5b8 req-a546f4d0-203a-4e9f-8d6c-c2c4309fb8b7 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:52:26 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-b53f7d7f-eeff-440c-b142-d9495d99d5b8 req-a546f4d0-203a-4e9f-8d6c-c2c4309fb8b7 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:52:26 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-b53f7d7f-eeff-440c-b142-d9495d99d5b8 req-a546f4d0-203a-4e9f-8d6c-c2c4309fb8b7 service nova] Creating event network-vif-plugged:d8b0279f-95ca-4143-8f78-c6faf74a3620 for instance 14bd5401-4cc1-4827-8d4a-fd1358bb9c6b on user Apr 21 10:52:26 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [req-b53f7d7f-eeff-440c-b142-d9495d99d5b8 req-a546f4d0-203a-4e9f-8d6c-c2c4309fb8b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032950 Apr 21 10:52:26 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 80/236] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:52:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:52:43 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_api:SELECT=2 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:52:43 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell1:SELECT=2 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:52:43 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-7731f480-1221-4163-8e53-756acadf6c46 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1514515166"}} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:52:43 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-7731f480-1221-4163-8e53-756acadf6c46 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] [instance: f4dda568-8f3b-40eb-aff3-64d3e759c310] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:52:43 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-7731f480-1221-4163-8e53-756acadf6c46 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:52:43 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-7731f480-1221-4163-8e53-756acadf6c46 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:52:43 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-7731f480-1221-4163-8e53-756acadf6c46 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:52:43 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-7731f480-1221-4163-8e53-756acadf6c46 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:52:43 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-7731f480-1221-4163-8e53-756acadf6c46 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:52:43 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-7731f480-1221-4163-8e53-756acadf6c46 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:52:44 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-7731f480-1221-4163-8e53-756acadf6c46 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f4dda568-8f3b-40eb-aff3-64d3e759c310/action" status: 202 len: 52 microversion: 2.87 time: 1.053259 Apr 21 10:52:44 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 78/237] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 21 10:52:43 2023] POST /compute/v2.1/servers/f4dda568-8f3b-40eb-aff3-64d3e759c310/action => generated 52 bytes in 1056 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 21 10:52:49 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell0:SELECT=2 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:52:49 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell0:SELECT=6 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:52:49 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:52:49 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell1:SELECT=24 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:52:49 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-ebb41fa2-9b9a-4f2d-903a-1e8e9db5855c tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:52:49 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-ebb41fa2-9b9a-4f2d-903a-1e8e9db5855c tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] [instance: f4dda568-8f3b-40eb-aff3-64d3e759c310] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:52:49 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-ebb41fa2-9b9a-4f2d-903a-1e8e9db5855c tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:52:49 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-ebb41fa2-9b9a-4f2d-903a-1e8e9db5855c tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:52:49 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-ebb41fa2-9b9a-4f2d-903a-1e8e9db5855c tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:52:49 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-ebb41fa2-9b9a-4f2d-903a-1e8e9db5855c tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:52:49 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-ebb41fa2-9b9a-4f2d-903a-1e8e9db5855c tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:52:49 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-ebb41fa2-9b9a-4f2d-903a-1e8e9db5855c tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:52:50 user devstack@n-api.service[61319]: DEBUG nova.policy [None req-ebb41fa2-9b9a-4f2d-903a-1e8e9db5855c tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c67d90b6014d9ea24ef2552006bc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad84a0e014f47ddaeaddc88bf16b0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61319) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:52:50 user devstack@n-api.service[61319]: DEBUG nova.policy [None req-ebb41fa2-9b9a-4f2d-903a-1e8e9db5855c tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c67d90b6014d9ea24ef2552006bc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad84a0e014f47ddaeaddc88bf16b0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61319) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:52:50 user devstack@n-api.service[61319]: DEBUG nova.policy [None req-ebb41fa2-9b9a-4f2d-903a-1e8e9db5855c tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c67d90b6014d9ea24ef2552006bc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad84a0e014f47ddaeaddc88bf16b0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61319) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:52:50 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-ebb41fa2-9b9a-4f2d-903a-1e8e9db5855c tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f4dda568-8f3b-40eb-aff3-64d3e759c310" status: 200 len: 1692 microversion: 2.87 time: 0.386055 Apr 21 10:52:50 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 80/238] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 10:52:49 2023] GET /compute/v2.1/servers/f4dda568-8f3b-40eb-aff3-64d3e759c310 => generated 1692 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 10:52:50 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell0:SELECT=2 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:52:50 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=2 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:52:50 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell1:SELECT=2 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:52:50 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-f5f1fb9f-be89-4ce4-bb0d-578df2c2f6fa tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:52:50 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-f5f1fb9f-be89-4ce4-bb0d-578df2c2f6fa tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] [instance: 566040e7-8140-467b-b814-8d7eb62ef735] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:52:50 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-f5f1fb9f-be89-4ce4-bb0d-578df2c2f6fa tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:52:50 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-f5f1fb9f-be89-4ce4-bb0d-578df2c2f6fa tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:52:50 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-f5f1fb9f-be89-4ce4-bb0d-578df2c2f6fa tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:52:50 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-f5f1fb9f-be89-4ce4-bb0d-578df2c2f6fa tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:52:50 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-f5f1fb9f-be89-4ce4-bb0d-578df2c2f6fa tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:52:50 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-f5f1fb9f-be89-4ce4-bb0d-578df2c2f6fa tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:52:50 user devstack@n-api.service[61320]: INFO nova.api.openstack.wsgi [None req-f5f1fb9f-be89-4ce4-bb0d-578df2c2f6fa tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] HTTP exception thrown: Instance 566040e7-8140-467b-b814-8d7eb62ef735 could not be found. Apr 21 10:52:50 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-f5f1fb9f-be89-4ce4-bb0d-578df2c2f6fa tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Request method failure captured: Apr 21 10:52:50 user devstack@n-api.service[61320]: request: GET /compute/v2.1/servers/566040e7-8140-467b-b814-8d7eb62ef735 HTTP/1.1 Apr 21 10:52:50 user devstack@n-api.service[61320]: Accept: application/json Apr 21 10:52:50 user devstack@n-api.service[61320]: Accept-Encoding: identity Apr 21 10:52:50 user devstack@n-api.service[61320]: Connection: close Apr 21 10:52:50 user devstack@n-api.service[61320]: Content-Length: 0 Apr 21 10:52:50 user devstack@n-api.service[61320]: Content-Type: application/json Apr 21 10:52:50 user devstack@n-api.service[61320]: Host: 10.0.0.210 Apr 21 10:52:50 user devstack@n-api.service[61320]: Openstack-System-Scope: None Apr 21 10:52:50 user devstack@n-api.service[61320]: User-Agent: python-urllib3/1.26.15 Apr 21 10:52:50 user devstack@n-api.service[61320]: X-Auth-Token: gAAAAABkQmmyoE94UhD7aOixNrzW5yWikQ9y3hf2iosOIcXd7YsrsXqnlxo0mLQnqv7Of5EM3jI9XC--6NTXguwTRjQvkx0EPZfaTtvPbHiP73WhTdRnGF7d1x0ywEQ9qMZFiVxsYPEIMR8PvzYiva5U8OAomeYoIOQ2rw41jxexff99JZutboE Apr 21 10:52:50 user devstack@n-api.service[61320]: X-Domain-Id: None Apr 21 10:52:50 user devstack@n-api.service[61320]: X-Domain-Name: None Apr 21 10:52:50 user devstack@n-api.service[61320]: X-Identity-Status: Confirmed Apr 21 10:52:50 user devstack@n-api.service[61320]: X-Is-Admin-Project: True Apr 21 10:52:50 user devstack@n-api.service[61320]: X-Project-Domain-Id: default Apr 21 10:52:50 user devstack@n-api.service[61320]: X-Project-Domain-Name: Default Apr 21 10:52:50 user devstack@n-api.service[61320]: X-Project-Id: d85f51547e5244e495343281725fe320 Apr 21 10:52:50 user devstack@n-api.service[61320]: X-Project-Name: tempest-AttachVolumeTestJSON-2130575493 Apr 21 10:52:50 user devstack@n-api.service[61320]: X-Role: reader,member Apr 21 10:52:50 user devstack@n-api.service[61320]: X-Roles: reader,member Apr 21 10:52:50 user devstack@n-api.service[61320]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d85f51547e5244e495343281725fe320"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d85f51547e5244e495343281725fe320"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d85f51547e5244e495343281725fe320"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 10:52:50 user devstack@n-api.service[61320]: X-Tenant: tempest-AttachVolumeTestJSON-2130575493 Apr 21 10:52:50 user devstack@n-api.service[61320]: X-Tenant-Id: d85f51547e5244e495343281725fe320 Apr 21 10:52:50 user devstack@n-api.service[61320]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2130575493 Apr 21 10:52:50 user devstack@n-api.service[61320]: X-User: tempest-AttachVolumeTestJSON-2130575493-project-member Apr 21 10:52:50 user devstack@n-api.service[61320]: X-User-Domain-Id: default Apr 21 10:52:50 user devstack@n-api.service[61320]: X-User-Domain-Name: Default Apr 21 10:52:50 user devstack@n-api.service[61320]: X-User-Id: 25fb0d890b594080bb1bb99dd6294ff1 Apr 21 10:52:50 user devstack@n-api.service[61320]: X-User-Name: tempest-AttachVolumeTestJSON-2130575493-project-member Apr 21 10:52:50 user devstack@n-api.service[61320]: method: > Apr 21 10:52:50 user devstack@n-api.service[61320]: exception: Instance 566040e7-8140-467b-b814-8d7eb62ef735 could not be found. Apr 21 10:52:50 user devstack@n-api.service[61320]: action_args: {'id': '566040e7-8140-467b-b814-8d7eb62ef735'} Apr 21 10:52:50 user devstack@n-api.service[61320]: {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 10:52:50 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:52:50 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 10:52:50 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 10:52:50 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 10:52:50 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 10:52:50 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 10:52:50 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 10:52:50 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 10:52:50 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 10:52:50 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 566040e7-8140-467b-b814-8d7eb62ef735 could not be found. Apr 21 10:52:50 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:52:50 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:52:50 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:52:50 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:52:50 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 10:52:50 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 10:52:50 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 10:52:50 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 10:52:50 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 10:52:50 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 10:52:50 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 10:52:50 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 10:52:50 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 10:52:50 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 10:52:50 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 10:52:50 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 10:52:50 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 566040e7-8140-467b-b814-8d7eb62ef735 could not be found. Apr 21 10:52:50 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:52:50 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:52:50 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:52:50 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:52:50 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 10:52:50 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 10:52:50 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 10:52:50 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 10:52:50 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 566040e7-8140-467b-b814-8d7eb62ef735 could not be found. Apr 21 10:52:50 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:52:50 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-f5f1fb9f-be89-4ce4-bb0d-578df2c2f6fa tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Returning 404 to user: Instance 566040e7-8140-467b-b814-8d7eb62ef735 could not be found. {{(pid=61320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 10:52:50 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-f5f1fb9f-be89-4ce4-bb0d-578df2c2f6fa tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] 10.0.0.210 "GET /compute/v2.1/servers/566040e7-8140-467b-b814-8d7eb62ef735" status: 404 len: 111 microversion: 2.1 time: 0.156419 Apr 21 10:52:50 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 81/239] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:52:50 2023] GET /compute/v2.1/servers/566040e7-8140-467b-b814-8d7eb62ef735 => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 10:52:50 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-53f230b6-776a-4f8f-a465-ac72f55d12bd tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Calling method '.version_select at 0x7f91a5d50700>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:52:50 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-53f230b6-776a-4f8f-a465-ac72f55d12bd tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-950390145" status: 202 len: 0 microversion: 2.1 time: 0.022415 Apr 21 10:52:50 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 79/240] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 21 10:52:50 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-950390145 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 10:52:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-7d749146-9b9f-4c62-b43c-5602c2b326f7 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:52:51 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-7d749146-9b9f-4c62-b43c-5602c2b326f7 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] [instance: 566040e7-8140-467b-b814-8d7eb62ef735] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:52:51 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-7d749146-9b9f-4c62-b43c-5602c2b326f7 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:52:51 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-7d749146-9b9f-4c62-b43c-5602c2b326f7 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:52:51 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-7d749146-9b9f-4c62-b43c-5602c2b326f7 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:52:51 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-7d749146-9b9f-4c62-b43c-5602c2b326f7 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:52:51 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-7d749146-9b9f-4c62-b43c-5602c2b326f7 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:52:51 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-7d749146-9b9f-4c62-b43c-5602c2b326f7 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:52:51 user devstack@n-api.service[61319]: INFO nova.api.openstack.wsgi [None req-7d749146-9b9f-4c62-b43c-5602c2b326f7 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] HTTP exception thrown: Instance 566040e7-8140-467b-b814-8d7eb62ef735 could not be found. Apr 21 10:52:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-7d749146-9b9f-4c62-b43c-5602c2b326f7 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Request method failure captured: Apr 21 10:52:51 user devstack@n-api.service[61319]: request: DELETE /compute/v2.1/servers/566040e7-8140-467b-b814-8d7eb62ef735 HTTP/1.1 Apr 21 10:52:51 user devstack@n-api.service[61319]: Accept: application/json Apr 21 10:52:51 user devstack@n-api.service[61319]: Accept-Encoding: identity Apr 21 10:52:51 user devstack@n-api.service[61319]: Connection: close Apr 21 10:52:51 user devstack@n-api.service[61319]: Content-Length: 0 Apr 21 10:52:51 user devstack@n-api.service[61319]: Content-Type: application/json Apr 21 10:52:51 user devstack@n-api.service[61319]: Host: 10.0.0.210 Apr 21 10:52:51 user devstack@n-api.service[61319]: Openstack-System-Scope: None Apr 21 10:52:51 user devstack@n-api.service[61319]: User-Agent: python-urllib3/1.26.15 Apr 21 10:52:51 user devstack@n-api.service[61319]: X-Auth-Token: gAAAAABkQmmyoE94UhD7aOixNrzW5yWikQ9y3hf2iosOIcXd7YsrsXqnlxo0mLQnqv7Of5EM3jI9XC--6NTXguwTRjQvkx0EPZfaTtvPbHiP73WhTdRnGF7d1x0ywEQ9qMZFiVxsYPEIMR8PvzYiva5U8OAomeYoIOQ2rw41jxexff99JZutboE Apr 21 10:52:51 user devstack@n-api.service[61319]: X-Domain-Id: None Apr 21 10:52:51 user devstack@n-api.service[61319]: X-Domain-Name: None Apr 21 10:52:51 user devstack@n-api.service[61319]: X-Identity-Status: Confirmed Apr 21 10:52:51 user devstack@n-api.service[61319]: X-Is-Admin-Project: True Apr 21 10:52:51 user devstack@n-api.service[61319]: X-Project-Domain-Id: default Apr 21 10:52:51 user devstack@n-api.service[61319]: X-Project-Domain-Name: Default Apr 21 10:52:51 user devstack@n-api.service[61319]: X-Project-Id: d85f51547e5244e495343281725fe320 Apr 21 10:52:51 user devstack@n-api.service[61319]: X-Project-Name: tempest-AttachVolumeTestJSON-2130575493 Apr 21 10:52:51 user devstack@n-api.service[61319]: X-Role: reader,member Apr 21 10:52:51 user devstack@n-api.service[61319]: X-Roles: reader,member Apr 21 10:52:51 user devstack@n-api.service[61319]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d85f51547e5244e495343281725fe320"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d85f51547e5244e495343281725fe320"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d85f51547e5244e495343281725fe320"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 10:52:51 user devstack@n-api.service[61319]: X-Tenant: tempest-AttachVolumeTestJSON-2130575493 Apr 21 10:52:51 user devstack@n-api.service[61319]: X-Tenant-Id: d85f51547e5244e495343281725fe320 Apr 21 10:52:51 user devstack@n-api.service[61319]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2130575493 Apr 21 10:52:51 user devstack@n-api.service[61319]: X-User: tempest-AttachVolumeTestJSON-2130575493-project-member Apr 21 10:52:51 user devstack@n-api.service[61319]: X-User-Domain-Id: default Apr 21 10:52:51 user devstack@n-api.service[61319]: X-User-Domain-Name: Default Apr 21 10:52:51 user devstack@n-api.service[61319]: X-User-Id: 25fb0d890b594080bb1bb99dd6294ff1 Apr 21 10:52:51 user devstack@n-api.service[61319]: X-User-Name: tempest-AttachVolumeTestJSON-2130575493-project-member Apr 21 10:52:51 user devstack@n-api.service[61319]: method: > Apr 21 10:52:51 user devstack@n-api.service[61319]: exception: Instance 566040e7-8140-467b-b814-8d7eb62ef735 could not be found. Apr 21 10:52:51 user devstack@n-api.service[61319]: action_args: {'id': '566040e7-8140-467b-b814-8d7eb62ef735'} Apr 21 10:52:51 user devstack@n-api.service[61319]: {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 566040e7-8140-467b-b814-8d7eb62ef735 could not be found. Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 566040e7-8140-467b-b814-8d7eb62ef735 could not be found. Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 566040e7-8140-467b-b814-8d7eb62ef735 could not be found. Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:52:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-7d749146-9b9f-4c62-b43c-5602c2b326f7 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Returning 404 to user: Instance 566040e7-8140-467b-b814-8d7eb62ef735 could not be found. {{(pid=61319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 10:52:51 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-7d749146-9b9f-4c62-b43c-5602c2b326f7 tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/566040e7-8140-467b-b814-8d7eb62ef735" status: 404 len: 111 microversion: 2.1 time: 0.026539 Apr 21 10:52:51 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 81/241] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 10:52:51 2023] DELETE /compute/v2.1/servers/566040e7-8140-467b-b814-8d7eb62ef735 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 10:52:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-79fbe63e-a71f-4da9-8b8f-afe792aa452a tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:52:51 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-79fbe63e-a71f-4da9-8b8f-afe792aa452a tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] [instance: 566040e7-8140-467b-b814-8d7eb62ef735] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:52:51 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-79fbe63e-a71f-4da9-8b8f-afe792aa452a tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:52:51 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-79fbe63e-a71f-4da9-8b8f-afe792aa452a tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:52:51 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-79fbe63e-a71f-4da9-8b8f-afe792aa452a tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:52:51 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-79fbe63e-a71f-4da9-8b8f-afe792aa452a tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:52:51 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-79fbe63e-a71f-4da9-8b8f-afe792aa452a tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:52:51 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-79fbe63e-a71f-4da9-8b8f-afe792aa452a tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:52:51 user devstack@n-api.service[61320]: INFO nova.api.openstack.wsgi [None req-79fbe63e-a71f-4da9-8b8f-afe792aa452a tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] HTTP exception thrown: Instance 566040e7-8140-467b-b814-8d7eb62ef735 could not be found. Apr 21 10:52:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-79fbe63e-a71f-4da9-8b8f-afe792aa452a tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Request method failure captured: Apr 21 10:52:51 user devstack@n-api.service[61320]: request: GET /compute/v2.1/servers/566040e7-8140-467b-b814-8d7eb62ef735 HTTP/1.1 Apr 21 10:52:51 user devstack@n-api.service[61320]: Accept: application/json Apr 21 10:52:51 user devstack@n-api.service[61320]: Accept-Encoding: identity Apr 21 10:52:51 user devstack@n-api.service[61320]: Connection: close Apr 21 10:52:51 user devstack@n-api.service[61320]: Content-Length: 0 Apr 21 10:52:51 user devstack@n-api.service[61320]: Content-Type: application/json Apr 21 10:52:51 user devstack@n-api.service[61320]: Host: 10.0.0.210 Apr 21 10:52:51 user devstack@n-api.service[61320]: Openstack-System-Scope: None Apr 21 10:52:51 user devstack@n-api.service[61320]: User-Agent: python-urllib3/1.26.15 Apr 21 10:52:51 user devstack@n-api.service[61320]: X-Auth-Token: gAAAAABkQmmyoE94UhD7aOixNrzW5yWikQ9y3hf2iosOIcXd7YsrsXqnlxo0mLQnqv7Of5EM3jI9XC--6NTXguwTRjQvkx0EPZfaTtvPbHiP73WhTdRnGF7d1x0ywEQ9qMZFiVxsYPEIMR8PvzYiva5U8OAomeYoIOQ2rw41jxexff99JZutboE Apr 21 10:52:51 user devstack@n-api.service[61320]: X-Domain-Id: None Apr 21 10:52:51 user devstack@n-api.service[61320]: X-Domain-Name: None Apr 21 10:52:51 user devstack@n-api.service[61320]: X-Identity-Status: Confirmed Apr 21 10:52:51 user devstack@n-api.service[61320]: X-Is-Admin-Project: True Apr 21 10:52:51 user devstack@n-api.service[61320]: X-Project-Domain-Id: default Apr 21 10:52:51 user devstack@n-api.service[61320]: X-Project-Domain-Name: Default Apr 21 10:52:51 user devstack@n-api.service[61320]: X-Project-Id: d85f51547e5244e495343281725fe320 Apr 21 10:52:51 user devstack@n-api.service[61320]: X-Project-Name: tempest-AttachVolumeTestJSON-2130575493 Apr 21 10:52:51 user devstack@n-api.service[61320]: X-Role: reader,member Apr 21 10:52:51 user devstack@n-api.service[61320]: X-Roles: reader,member Apr 21 10:52:51 user devstack@n-api.service[61320]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d85f51547e5244e495343281725fe320"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d85f51547e5244e495343281725fe320"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d85f51547e5244e495343281725fe320"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 10:52:51 user devstack@n-api.service[61320]: X-Tenant: tempest-AttachVolumeTestJSON-2130575493 Apr 21 10:52:51 user devstack@n-api.service[61320]: X-Tenant-Id: d85f51547e5244e495343281725fe320 Apr 21 10:52:51 user devstack@n-api.service[61320]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2130575493 Apr 21 10:52:51 user devstack@n-api.service[61320]: X-User: tempest-AttachVolumeTestJSON-2130575493-project-member Apr 21 10:52:51 user devstack@n-api.service[61320]: X-User-Domain-Id: default Apr 21 10:52:51 user devstack@n-api.service[61320]: X-User-Domain-Name: Default Apr 21 10:52:51 user devstack@n-api.service[61320]: X-User-Id: 25fb0d890b594080bb1bb99dd6294ff1 Apr 21 10:52:51 user devstack@n-api.service[61320]: X-User-Name: tempest-AttachVolumeTestJSON-2130575493-project-member Apr 21 10:52:51 user devstack@n-api.service[61320]: method: > Apr 21 10:52:51 user devstack@n-api.service[61320]: exception: Instance 566040e7-8140-467b-b814-8d7eb62ef735 could not be found. Apr 21 10:52:51 user devstack@n-api.service[61320]: action_args: {'id': '566040e7-8140-467b-b814-8d7eb62ef735'} Apr 21 10:52:51 user devstack@n-api.service[61320]: {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 10:52:51 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:52:51 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 10:52:51 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 10:52:51 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 10:52:51 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 10:52:51 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 10:52:51 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 10:52:51 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 10:52:51 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 10:52:51 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 566040e7-8140-467b-b814-8d7eb62ef735 could not be found. Apr 21 10:52:51 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:52:51 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:52:51 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:52:51 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:52:51 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 10:52:51 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 10:52:51 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 10:52:51 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 10:52:51 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 10:52:51 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 10:52:51 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 10:52:51 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 10:52:51 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 10:52:51 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 10:52:51 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 10:52:51 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 10:52:51 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 566040e7-8140-467b-b814-8d7eb62ef735 could not be found. Apr 21 10:52:51 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:52:51 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:52:51 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:52:51 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:52:51 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 10:52:51 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 10:52:51 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 10:52:51 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 10:52:51 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 566040e7-8140-467b-b814-8d7eb62ef735 could not be found. Apr 21 10:52:51 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:52:51 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-79fbe63e-a71f-4da9-8b8f-afe792aa452a tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Returning 404 to user: Instance 566040e7-8140-467b-b814-8d7eb62ef735 could not be found. {{(pid=61320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 10:52:51 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-79fbe63e-a71f-4da9-8b8f-afe792aa452a tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] 10.0.0.210 "GET /compute/v2.1/servers/566040e7-8140-467b-b814-8d7eb62ef735" status: 404 len: 111 microversion: 2.1 time: 0.026124 Apr 21 10:52:51 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 82/242] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:52:51 2023] GET /compute/v2.1/servers/566040e7-8140-467b-b814-8d7eb62ef735 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 10:52:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-7b392a83-b89f-4674-88fa-adb2fda3662e tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:52:51 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-7b392a83-b89f-4674-88fa-adb2fda3662e tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] [instance: dd4d15a1-3a71-49e8-9851-9b49fec6a9e3] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:52:51 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-7b392a83-b89f-4674-88fa-adb2fda3662e tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:52:51 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-7b392a83-b89f-4674-88fa-adb2fda3662e tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:52:51 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-7b392a83-b89f-4674-88fa-adb2fda3662e tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:52:51 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-7b392a83-b89f-4674-88fa-adb2fda3662e tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:52:51 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-7b392a83-b89f-4674-88fa-adb2fda3662e tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:52:51 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-7b392a83-b89f-4674-88fa-adb2fda3662e tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:52:51 user devstack@n-api.service[61318]: INFO nova.api.openstack.wsgi [None req-7b392a83-b89f-4674-88fa-adb2fda3662e tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] HTTP exception thrown: Instance dd4d15a1-3a71-49e8-9851-9b49fec6a9e3 could not be found. Apr 21 10:52:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-7b392a83-b89f-4674-88fa-adb2fda3662e tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Request method failure captured: Apr 21 10:52:51 user devstack@n-api.service[61318]: request: DELETE /compute/v2.1/servers/dd4d15a1-3a71-49e8-9851-9b49fec6a9e3 HTTP/1.1 Apr 21 10:52:51 user devstack@n-api.service[61318]: Accept: application/json Apr 21 10:52:51 user devstack@n-api.service[61318]: Accept-Encoding: identity Apr 21 10:52:51 user devstack@n-api.service[61318]: Connection: close Apr 21 10:52:51 user devstack@n-api.service[61318]: Content-Length: 0 Apr 21 10:52:51 user devstack@n-api.service[61318]: Content-Type: application/json Apr 21 10:52:51 user devstack@n-api.service[61318]: Host: 10.0.0.210 Apr 21 10:52:51 user devstack@n-api.service[61318]: Openstack-System-Scope: None Apr 21 10:52:51 user devstack@n-api.service[61318]: User-Agent: python-urllib3/1.26.15 Apr 21 10:52:51 user devstack@n-api.service[61318]: X-Auth-Token: gAAAAABkQmmyoE94UhD7aOixNrzW5yWikQ9y3hf2iosOIcXd7YsrsXqnlxo0mLQnqv7Of5EM3jI9XC--6NTXguwTRjQvkx0EPZfaTtvPbHiP73WhTdRnGF7d1x0ywEQ9qMZFiVxsYPEIMR8PvzYiva5U8OAomeYoIOQ2rw41jxexff99JZutboE Apr 21 10:52:51 user devstack@n-api.service[61318]: X-Domain-Id: None Apr 21 10:52:51 user devstack@n-api.service[61318]: X-Domain-Name: None Apr 21 10:52:51 user devstack@n-api.service[61318]: X-Identity-Status: Confirmed Apr 21 10:52:51 user devstack@n-api.service[61318]: X-Is-Admin-Project: True Apr 21 10:52:51 user devstack@n-api.service[61318]: X-Project-Domain-Id: default Apr 21 10:52:51 user devstack@n-api.service[61318]: X-Project-Domain-Name: Default Apr 21 10:52:51 user devstack@n-api.service[61318]: X-Project-Id: d85f51547e5244e495343281725fe320 Apr 21 10:52:51 user devstack@n-api.service[61318]: X-Project-Name: tempest-AttachVolumeTestJSON-2130575493 Apr 21 10:52:51 user devstack@n-api.service[61318]: X-Role: reader,member Apr 21 10:52:51 user devstack@n-api.service[61318]: X-Roles: reader,member Apr 21 10:52:51 user devstack@n-api.service[61318]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d85f51547e5244e495343281725fe320"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d85f51547e5244e495343281725fe320"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d85f51547e5244e495343281725fe320"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 10:52:51 user devstack@n-api.service[61318]: X-Tenant: tempest-AttachVolumeTestJSON-2130575493 Apr 21 10:52:51 user devstack@n-api.service[61318]: X-Tenant-Id: d85f51547e5244e495343281725fe320 Apr 21 10:52:51 user devstack@n-api.service[61318]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2130575493 Apr 21 10:52:51 user devstack@n-api.service[61318]: X-User: tempest-AttachVolumeTestJSON-2130575493-project-member Apr 21 10:52:51 user devstack@n-api.service[61318]: X-User-Domain-Id: default Apr 21 10:52:51 user devstack@n-api.service[61318]: X-User-Domain-Name: Default Apr 21 10:52:51 user devstack@n-api.service[61318]: X-User-Id: 25fb0d890b594080bb1bb99dd6294ff1 Apr 21 10:52:51 user devstack@n-api.service[61318]: X-User-Name: tempest-AttachVolumeTestJSON-2130575493-project-member Apr 21 10:52:51 user devstack@n-api.service[61318]: method: > Apr 21 10:52:51 user devstack@n-api.service[61318]: exception: Instance dd4d15a1-3a71-49e8-9851-9b49fec6a9e3 could not be found. Apr 21 10:52:51 user devstack@n-api.service[61318]: action_args: {'id': 'dd4d15a1-3a71-49e8-9851-9b49fec6a9e3'} Apr 21 10:52:51 user devstack@n-api.service[61318]: {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 10:52:51 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:52:51 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 10:52:51 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 10:52:51 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 10:52:51 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 10:52:51 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 10:52:51 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 10:52:51 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 10:52:51 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 10:52:51 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd4d15a1-3a71-49e8-9851-9b49fec6a9e3 could not be found. Apr 21 10:52:51 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:52:51 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:52:51 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:52:51 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:52:51 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 10:52:51 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 10:52:51 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 10:52:51 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 10:52:51 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 10:52:51 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 10:52:51 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 21 10:52:51 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 21 10:52:51 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 21 10:52:51 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 21 10:52:51 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 10:52:51 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 10:52:51 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 10:52:51 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 10:52:51 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd4d15a1-3a71-49e8-9851-9b49fec6a9e3 could not be found. Apr 21 10:52:51 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:52:51 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:52:51 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:52:51 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:52:51 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 10:52:51 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 10:52:51 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 10:52:51 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 10:52:51 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd4d15a1-3a71-49e8-9851-9b49fec6a9e3 could not be found. Apr 21 10:52:51 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:52:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-7b392a83-b89f-4674-88fa-adb2fda3662e tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Returning 404 to user: Instance dd4d15a1-3a71-49e8-9851-9b49fec6a9e3 could not be found. {{(pid=61318) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 10:52:51 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-7b392a83-b89f-4674-88fa-adb2fda3662e tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dd4d15a1-3a71-49e8-9851-9b49fec6a9e3" status: 404 len: 111 microversion: 2.1 time: 0.028498 Apr 21 10:52:51 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 80/243] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 10:52:51 2023] DELETE /compute/v2.1/servers/dd4d15a1-3a71-49e8-9851-9b49fec6a9e3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 10:52:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-1ab8300d-a287-405a-8726-4b7df2cb30ef tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:52:51 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-1ab8300d-a287-405a-8726-4b7df2cb30ef tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] [instance: dd4d15a1-3a71-49e8-9851-9b49fec6a9e3] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:52:51 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-1ab8300d-a287-405a-8726-4b7df2cb30ef tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:52:51 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-1ab8300d-a287-405a-8726-4b7df2cb30ef tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:52:51 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-1ab8300d-a287-405a-8726-4b7df2cb30ef tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:52:51 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-1ab8300d-a287-405a-8726-4b7df2cb30ef tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:52:51 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-1ab8300d-a287-405a-8726-4b7df2cb30ef tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:52:51 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-1ab8300d-a287-405a-8726-4b7df2cb30ef tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:52:51 user devstack@n-api.service[61319]: INFO nova.api.openstack.wsgi [None req-1ab8300d-a287-405a-8726-4b7df2cb30ef tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] HTTP exception thrown: Instance dd4d15a1-3a71-49e8-9851-9b49fec6a9e3 could not be found. Apr 21 10:52:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-1ab8300d-a287-405a-8726-4b7df2cb30ef tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Request method failure captured: Apr 21 10:52:51 user devstack@n-api.service[61319]: request: GET /compute/v2.1/servers/dd4d15a1-3a71-49e8-9851-9b49fec6a9e3 HTTP/1.1 Apr 21 10:52:51 user devstack@n-api.service[61319]: Accept: application/json Apr 21 10:52:51 user devstack@n-api.service[61319]: Accept-Encoding: identity Apr 21 10:52:51 user devstack@n-api.service[61319]: Connection: close Apr 21 10:52:51 user devstack@n-api.service[61319]: Content-Length: 0 Apr 21 10:52:51 user devstack@n-api.service[61319]: Content-Type: application/json Apr 21 10:52:51 user devstack@n-api.service[61319]: Host: 10.0.0.210 Apr 21 10:52:51 user devstack@n-api.service[61319]: Openstack-System-Scope: None Apr 21 10:52:51 user devstack@n-api.service[61319]: User-Agent: python-urllib3/1.26.15 Apr 21 10:52:51 user devstack@n-api.service[61319]: X-Auth-Token: gAAAAABkQmmyoE94UhD7aOixNrzW5yWikQ9y3hf2iosOIcXd7YsrsXqnlxo0mLQnqv7Of5EM3jI9XC--6NTXguwTRjQvkx0EPZfaTtvPbHiP73WhTdRnGF7d1x0ywEQ9qMZFiVxsYPEIMR8PvzYiva5U8OAomeYoIOQ2rw41jxexff99JZutboE Apr 21 10:52:51 user devstack@n-api.service[61319]: X-Domain-Id: None Apr 21 10:52:51 user devstack@n-api.service[61319]: X-Domain-Name: None Apr 21 10:52:51 user devstack@n-api.service[61319]: X-Identity-Status: Confirmed Apr 21 10:52:51 user devstack@n-api.service[61319]: X-Is-Admin-Project: True Apr 21 10:52:51 user devstack@n-api.service[61319]: X-Project-Domain-Id: default Apr 21 10:52:51 user devstack@n-api.service[61319]: X-Project-Domain-Name: Default Apr 21 10:52:51 user devstack@n-api.service[61319]: X-Project-Id: d85f51547e5244e495343281725fe320 Apr 21 10:52:51 user devstack@n-api.service[61319]: X-Project-Name: tempest-AttachVolumeTestJSON-2130575493 Apr 21 10:52:51 user devstack@n-api.service[61319]: X-Role: reader,member Apr 21 10:52:51 user devstack@n-api.service[61319]: X-Roles: reader,member Apr 21 10:52:51 user devstack@n-api.service[61319]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d85f51547e5244e495343281725fe320"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d85f51547e5244e495343281725fe320"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d85f51547e5244e495343281725fe320"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 10:52:51 user devstack@n-api.service[61319]: X-Tenant: tempest-AttachVolumeTestJSON-2130575493 Apr 21 10:52:51 user devstack@n-api.service[61319]: X-Tenant-Id: d85f51547e5244e495343281725fe320 Apr 21 10:52:51 user devstack@n-api.service[61319]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2130575493 Apr 21 10:52:51 user devstack@n-api.service[61319]: X-User: tempest-AttachVolumeTestJSON-2130575493-project-member Apr 21 10:52:51 user devstack@n-api.service[61319]: X-User-Domain-Id: default Apr 21 10:52:51 user devstack@n-api.service[61319]: X-User-Domain-Name: Default Apr 21 10:52:51 user devstack@n-api.service[61319]: X-User-Id: 25fb0d890b594080bb1bb99dd6294ff1 Apr 21 10:52:51 user devstack@n-api.service[61319]: X-User-Name: tempest-AttachVolumeTestJSON-2130575493-project-member Apr 21 10:52:51 user devstack@n-api.service[61319]: method: > Apr 21 10:52:51 user devstack@n-api.service[61319]: exception: Instance dd4d15a1-3a71-49e8-9851-9b49fec6a9e3 could not be found. Apr 21 10:52:51 user devstack@n-api.service[61319]: action_args: {'id': 'dd4d15a1-3a71-49e8-9851-9b49fec6a9e3'} Apr 21 10:52:51 user devstack@n-api.service[61319]: {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd4d15a1-3a71-49e8-9851-9b49fec6a9e3 could not be found. Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd4d15a1-3a71-49e8-9851-9b49fec6a9e3 could not be found. Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd4d15a1-3a71-49e8-9851-9b49fec6a9e3 could not be found. Apr 21 10:52:51 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:52:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-1ab8300d-a287-405a-8726-4b7df2cb30ef tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] Returning 404 to user: Instance dd4d15a1-3a71-49e8-9851-9b49fec6a9e3 could not be found. {{(pid=61319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 10:52:51 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-1ab8300d-a287-405a-8726-4b7df2cb30ef tempest-AttachVolumeTestJSON-2130575493 tempest-AttachVolumeTestJSON-2130575493-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dd4d15a1-3a71-49e8-9851-9b49fec6a9e3" status: 404 len: 111 microversion: 2.1 time: 0.026896 Apr 21 10:52:51 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 82/244] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:52:51 2023] GET /compute/v2.1/servers/dd4d15a1-3a71-49e8-9851-9b49fec6a9e3 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 10:52:59 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-b20bb4a3-5ea6-433e-8670-4f7723f7c8c4 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:52:59 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-b20bb4a3-5ea6-433e-8670-4f7723f7c8c4 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] [instance: 69031436-19d1-4cc1-91e7-4d99381b6ae3] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:52:59 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-b20bb4a3-5ea6-433e-8670-4f7723f7c8c4 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:52:59 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-b20bb4a3-5ea6-433e-8670-4f7723f7c8c4 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:52:59 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-b20bb4a3-5ea6-433e-8670-4f7723f7c8c4 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:52:59 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-b20bb4a3-5ea6-433e-8670-4f7723f7c8c4 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:52:59 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-b20bb4a3-5ea6-433e-8670-4f7723f7c8c4 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:52:59 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-b20bb4a3-5ea6-433e-8670-4f7723f7c8c4 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:52:59 user devstack@n-api.service[61320]: DEBUG nova.policy [None req-b20bb4a3-5ea6-433e-8670-4f7723f7c8c4 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cae5a1734d24ac8aebc233dd31d3084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead44a7da0640cbb2cf8dece0ea4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61320) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:52:59 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-b20bb4a3-5ea6-433e-8670-4f7723f7c8c4 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] 10.0.0.210 "GET /compute/v2.1/servers/69031436-19d1-4cc1-91e7-4d99381b6ae3" status: 200 len: 1537 microversion: 2.1 time: 0.429571 Apr 21 10:52:59 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 83/245] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:52:59 2023] GET /compute/v2.1/servers/69031436-19d1-4cc1-91e7-4d99381b6ae3 => generated 1537 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:52:59 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-81460fc2-c05a-4bba-8c85-d2589f68cf24 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:52:59 user devstack@n-api.service[61318]: DEBUG nova.policy [None req-81460fc2-c05a-4bba-8c85-d2589f68cf24 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6cae5a1734d24ac8aebc233dd31d3084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead44a7da0640cbb2cf8dece0ea4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61318) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:52:59 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-81460fc2-c05a-4bba-8c85-d2589f68cf24 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Searching by: {'deleted': False, 'project_id': '9ead44a7da0640cbb2cf8dece0ea4f40'} {{(pid=61318) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 21 10:52:59 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-81460fc2-c05a-4bba-8c85-d2589f68cf24 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:52:59 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-81460fc2-c05a-4bba-8c85-d2589f68cf24 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:52:59 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-81460fc2-c05a-4bba-8c85-d2589f68cf24 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:52:59 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-81460fc2-c05a-4bba-8c85-d2589f68cf24 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:52:59 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-81460fc2-c05a-4bba-8c85-d2589f68cf24 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:52:59 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-81460fc2-c05a-4bba-8c85-d2589f68cf24 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:53:00 user devstack@n-api.service[61318]: DEBUG nova.compute.multi_cell_list [None req-81460fc2-c05a-4bba-8c85-d2589f68cf24 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61318) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 21 10:53:00 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-81460fc2-c05a-4bba-8c85-d2589f68cf24 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.189900 Apr 21 10:53:00 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 81/246] 10.0.0.210 () {62 vars in 1202 bytes} [Fri Apr 21 10:52:59 2023] GET /compute/v2.1/servers => generated 341 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:53:00 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-6660f78a-95a2-45da-b2f5-bf4320c436fd tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:53:00 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-6660f78a-95a2-45da-b2f5-bf4320c436fd tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] [instance: 69031436-19d1-4cc1-91e7-4d99381b6ae3] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:53:00 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-6660f78a-95a2-45da-b2f5-bf4320c436fd tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:53:00 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-6660f78a-95a2-45da-b2f5-bf4320c436fd tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:53:00 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-6660f78a-95a2-45da-b2f5-bf4320c436fd tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:53:00 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-6660f78a-95a2-45da-b2f5-bf4320c436fd tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:53:00 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-6660f78a-95a2-45da-b2f5-bf4320c436fd tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:53:00 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-6660f78a-95a2-45da-b2f5-bf4320c436fd tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:53:00 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-4cd9de5e-a6b4-45a8-85d8-933b8986afb9 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:53:00 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-4cd9de5e-a6b4-45a8-85d8-933b8986afb9 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] [instance: 8ae797bd-c587-43a3-b941-e6d6d6c74e51] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:53:00 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-4cd9de5e-a6b4-45a8-85d8-933b8986afb9 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:53:00 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-4cd9de5e-a6b4-45a8-85d8-933b8986afb9 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:53:00 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-4cd9de5e-a6b4-45a8-85d8-933b8986afb9 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:53:00 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-4cd9de5e-a6b4-45a8-85d8-933b8986afb9 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:53:00 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-4cd9de5e-a6b4-45a8-85d8-933b8986afb9 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:53:00 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-4cd9de5e-a6b4-45a8-85d8-933b8986afb9 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:53:00 user devstack@n-api.service[61319]: INFO nova.api.openstack.wsgi [None req-4cd9de5e-a6b4-45a8-85d8-933b8986afb9 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] HTTP exception thrown: Instance 8ae797bd-c587-43a3-b941-e6d6d6c74e51 could not be found. Apr 21 10:53:00 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-4cd9de5e-a6b4-45a8-85d8-933b8986afb9 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Request method failure captured: Apr 21 10:53:00 user devstack@n-api.service[61319]: request: GET /compute/v2.1/servers/8ae797bd-c587-43a3-b941-e6d6d6c74e51 HTTP/1.1 Apr 21 10:53:00 user devstack@n-api.service[61319]: Accept: application/json Apr 21 10:53:00 user devstack@n-api.service[61319]: Accept-Encoding: identity Apr 21 10:53:00 user devstack@n-api.service[61319]: Connection: close Apr 21 10:53:00 user devstack@n-api.service[61319]: Content-Length: 0 Apr 21 10:53:00 user devstack@n-api.service[61319]: Content-Type: application/json Apr 21 10:53:00 user devstack@n-api.service[61319]: Host: 10.0.0.210 Apr 21 10:53:00 user devstack@n-api.service[61319]: Openstack-System-Scope: None Apr 21 10:53:00 user devstack@n-api.service[61319]: User-Agent: python-urllib3/1.26.15 Apr 21 10:53:00 user devstack@n-api.service[61319]: X-Auth-Token: gAAAAABkQmmw-awH0BMXKrfo3YW1ctVO3zusEKCx5o8dxiv3co6lDaAMv_ajdIXsHgnHhuHUpuTMaSZSaXKS-zrhkGe2pfDtmILxh1gg-h9QBH9NODDO6bpXMPd4ivXY4t1Ef0v552wkATg__FY5HJgzwhZr0Qm7QMNpWOYcnh0LrVkOEERYfqg Apr 21 10:53:00 user devstack@n-api.service[61319]: X-Domain-Id: None Apr 21 10:53:00 user devstack@n-api.service[61319]: X-Domain-Name: None Apr 21 10:53:00 user devstack@n-api.service[61319]: X-Identity-Status: Confirmed Apr 21 10:53:00 user devstack@n-api.service[61319]: X-Is-Admin-Project: True Apr 21 10:53:00 user devstack@n-api.service[61319]: X-Project-Domain-Id: default Apr 21 10:53:00 user devstack@n-api.service[61319]: X-Project-Domain-Name: Default Apr 21 10:53:00 user devstack@n-api.service[61319]: X-Project-Id: 94e77e1735854e0c966c42e9a613017f Apr 21 10:53:00 user devstack@n-api.service[61319]: X-Project-Name: tempest-VolumesAdminNegativeTest-243340095 Apr 21 10:53:00 user devstack@n-api.service[61319]: X-Role: reader,member Apr 21 10:53:00 user devstack@n-api.service[61319]: X-Roles: reader,member Apr 21 10:53:00 user devstack@n-api.service[61319]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/94e77e1735854e0c966c42e9a613017f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/94e77e1735854e0c966c42e9a613017f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/94e77e1735854e0c966c42e9a613017f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 10:53:00 user devstack@n-api.service[61319]: X-Tenant: tempest-VolumesAdminNegativeTest-243340095 Apr 21 10:53:00 user devstack@n-api.service[61319]: X-Tenant-Id: 94e77e1735854e0c966c42e9a613017f Apr 21 10:53:00 user devstack@n-api.service[61319]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-243340095 Apr 21 10:53:00 user devstack@n-api.service[61319]: X-User: tempest-VolumesAdminNegativeTest-243340095-project-member Apr 21 10:53:00 user devstack@n-api.service[61319]: X-User-Domain-Id: default Apr 21 10:53:00 user devstack@n-api.service[61319]: X-User-Domain-Name: Default Apr 21 10:53:00 user devstack@n-api.service[61319]: X-User-Id: c600e01acfe140cabcdfe54958e66108 Apr 21 10:53:00 user devstack@n-api.service[61319]: X-User-Name: tempest-VolumesAdminNegativeTest-243340095-project-member Apr 21 10:53:00 user devstack@n-api.service[61319]: method: > Apr 21 10:53:00 user devstack@n-api.service[61319]: exception: Instance 8ae797bd-c587-43a3-b941-e6d6d6c74e51 could not be found. Apr 21 10:53:00 user devstack@n-api.service[61319]: action_args: {'id': '8ae797bd-c587-43a3-b941-e6d6d6c74e51'} Apr 21 10:53:00 user devstack@n-api.service[61319]: {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 10:53:00 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:53:00 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 10:53:00 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 10:53:00 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 10:53:00 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 10:53:00 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 10:53:00 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 10:53:00 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 10:53:00 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 10:53:00 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ae797bd-c587-43a3-b941-e6d6d6c74e51 could not be found. Apr 21 10:53:00 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:53:00 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:53:00 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:53:00 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:53:00 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 10:53:00 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 10:53:00 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 10:53:00 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 10:53:00 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 10:53:00 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 10:53:00 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 10:53:00 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 10:53:00 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 10:53:00 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 10:53:00 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 10:53:00 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 10:53:00 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ae797bd-c587-43a3-b941-e6d6d6c74e51 could not be found. Apr 21 10:53:00 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:53:00 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:53:00 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:53:00 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:53:00 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 10:53:00 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 10:53:00 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 10:53:00 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 10:53:00 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ae797bd-c587-43a3-b941-e6d6d6c74e51 could not be found. Apr 21 10:53:00 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:53:00 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-4cd9de5e-a6b4-45a8-85d8-933b8986afb9 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Returning 404 to user: Instance 8ae797bd-c587-43a3-b941-e6d6d6c74e51 could not be found. {{(pid=61319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 10:53:00 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-4cd9de5e-a6b4-45a8-85d8-933b8986afb9 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8ae797bd-c587-43a3-b941-e6d6d6c74e51" status: 404 len: 111 microversion: 2.1 time: 0.197000 Apr 21 10:53:00 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 83/247] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:53:00 2023] GET /compute/v2.1/servers/8ae797bd-c587-43a3-b941-e6d6d6c74e51 => generated 111 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 10:53:00 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-3aeefce2-6f5b-4bfe-9b58-289c64458450 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] Calling method '.version_select at 0x7f91a61ec160>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:53:00 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-3aeefce2-6f5b-4bfe-9b58-289c64458450 tempest-VolumesAdminNegativeTest-243340095 tempest-VolumesAdminNegativeTest-243340095-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1275342497" status: 202 len: 0 microversion: 2.1 time: 0.021552 Apr 21 10:53:00 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 82/248] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 21 10:53:00 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1275342497 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 10:53:00 user devstack@n-api.service[61320]: DEBUG nova.policy [None req-6660f78a-95a2-45da-b2f5-bf4320c436fd tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cae5a1734d24ac8aebc233dd31d3084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead44a7da0640cbb2cf8dece0ea4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61320) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:53:00 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-6660f78a-95a2-45da-b2f5-bf4320c436fd tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] 10.0.0.210 "GET /compute/v2.1/servers/69031436-19d1-4cc1-91e7-4d99381b6ae3" status: 200 len: 1537 microversion: 2.1 time: 0.227418 Apr 21 10:53:00 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 84/249] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:53:00 2023] GET /compute/v2.1/servers/69031436-19d1-4cc1-91e7-4d99381b6ae3 => generated 1537 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:53:01 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-ef4b6300-035d-42a2-8468-d856f091f737 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:53:01 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-ef4b6300-035d-42a2-8468-d856f091f737 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] [instance: 69031436-19d1-4cc1-91e7-4d99381b6ae3] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:53:01 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-ef4b6300-035d-42a2-8468-d856f091f737 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:53:01 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-ef4b6300-035d-42a2-8468-d856f091f737 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:53:01 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-ef4b6300-035d-42a2-8468-d856f091f737 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:53:01 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-ef4b6300-035d-42a2-8468-d856f091f737 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:53:01 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-ef4b6300-035d-42a2-8468-d856f091f737 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:53:01 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-ef4b6300-035d-42a2-8468-d856f091f737 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:53:01 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-ef4b6300-035d-42a2-8468-d856f091f737 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] [instance: 69031436-19d1-4cc1-91e7-4d99381b6ae3] Going to try to terminate instance {{(pid=61319) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 10:53:02 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-ef4b6300-035d-42a2-8468-d856f091f737 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/69031436-19d1-4cc1-91e7-4d99381b6ae3" status: 204 len: 0 microversion: 2.1 time: 0.121726 Apr 21 10:53:02 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 84/250] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 10:53:01 2023] DELETE /compute/v2.1/servers/69031436-19d1-4cc1-91e7-4d99381b6ae3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 10:53:02 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-0b0df4fe-d693-4066-aae8-787c39cdc718 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:53:02 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-0b0df4fe-d693-4066-aae8-787c39cdc718 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] [instance: 69031436-19d1-4cc1-91e7-4d99381b6ae3] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:53:02 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-0b0df4fe-d693-4066-aae8-787c39cdc718 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:53:02 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-0b0df4fe-d693-4066-aae8-787c39cdc718 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:53:02 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-0b0df4fe-d693-4066-aae8-787c39cdc718 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:53:02 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-0b0df4fe-d693-4066-aae8-787c39cdc718 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:53:02 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-0b0df4fe-d693-4066-aae8-787c39cdc718 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:53:02 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-0b0df4fe-d693-4066-aae8-787c39cdc718 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:53:02 user devstack@n-api.service[61318]: DEBUG nova.policy [None req-0b0df4fe-d693-4066-aae8-787c39cdc718 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cae5a1734d24ac8aebc233dd31d3084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead44a7da0640cbb2cf8dece0ea4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61318) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:53:02 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-0b0df4fe-d693-4066-aae8-787c39cdc718 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] 10.0.0.210 "GET /compute/v2.1/servers/69031436-19d1-4cc1-91e7-4d99381b6ae3" status: 200 len: 1543 microversion: 2.1 time: 0.357319 Apr 21 10:53:02 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 83/251] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:53:02 2023] GET /compute/v2.1/servers/69031436-19d1-4cc1-91e7-4d99381b6ae3 => generated 1543 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:53:02 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [req-cd6678b7-e402-4d77-a5ef-b0f5fa2d937c req-e1c95be9-ebc5-476c-b05c-fd21d7a29193 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69031436-19d1-4cc1-91e7-4d99381b6ae3", "name": "network-vif-unplugged", "status": "completed", "tag": "516728bc-fbfa-4318-bbac-6c94509ee008"}]} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:53:02 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-cd6678b7-e402-4d77-a5ef-b0f5fa2d937c req-e1c95be9-ebc5-476c-b05c-fd21d7a29193 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:53:02 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-cd6678b7-e402-4d77-a5ef-b0f5fa2d937c req-e1c95be9-ebc5-476c-b05c-fd21d7a29193 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:53:02 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-cd6678b7-e402-4d77-a5ef-b0f5fa2d937c req-e1c95be9-ebc5-476c-b05c-fd21d7a29193 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:53:02 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-cd6678b7-e402-4d77-a5ef-b0f5fa2d937c req-e1c95be9-ebc5-476c-b05c-fd21d7a29193 service nova] Creating event network-vif-unplugged:516728bc-fbfa-4318-bbac-6c94509ee008 for instance 69031436-19d1-4cc1-91e7-4d99381b6ae3 on user Apr 21 10:53:02 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [req-cd6678b7-e402-4d77-a5ef-b0f5fa2d937c req-e1c95be9-ebc5-476c-b05c-fd21d7a29193 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100057 Apr 21 10:53:02 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 85/252] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:53:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:53:02 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-167f8dc9-4244-4a94-857e-73f7caeb98ac tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Action: 'create', calling method: .version_select at 0x7f91a5ec75b0>, body: {"keypair": {"name": "tempest-keypair-962586907", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgvsOkIKKUlR/vc13NXCoQlDdgzN+g6wKzZajODT/6/BJRfaLwQgnuA3mDp4OA0MDn0gizzj2Pl2nG82WPwPorkuBJwINQHac9OchhGaDq4Fh1FeHhPPumdwSQw3oc8bA=="}} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:53:02 user devstack@n-api.service[61319]: DEBUG nova.quota [None req-167f8dc9-4244-4a94-857e-73f7caeb98ac tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Getting quotas for project 14bc6b0c20204c8287b3523814007856. Resources: {'key_pairs'} {{(pid=61319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 10:53:02 user devstack@n-api.service[61319]: DEBUG nova.quota [None req-167f8dc9-4244-4a94-857e-73f7caeb98ac tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Getting quotas for user d7fc66871488428e9842404d885bcfe3 and project 14bc6b0c20204c8287b3523814007856. Resources: {'key_pairs'} {{(pid=61319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 10:53:02 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-167f8dc9-4244-4a94-857e-73f7caeb98ac tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.086066 Apr 21 10:53:02 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 85/253] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 21 10:53:02 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:53:03 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [req-e7219855-2970-4727-8abf-f9b7c2d1e9c1 req-31315684-e288-46ab-a413-84220721ead9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69031436-19d1-4cc1-91e7-4d99381b6ae3", "name": "network-vif-deleted", "tag": "516728bc-fbfa-4318-bbac-6c94509ee008"}]} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:53:03 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-e7219855-2970-4727-8abf-f9b7c2d1e9c1 req-31315684-e288-46ab-a413-84220721ead9 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:53:03 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-e7219855-2970-4727-8abf-f9b7c2d1e9c1 req-31315684-e288-46ab-a413-84220721ead9 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:53:03 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-e7219855-2970-4727-8abf-f9b7c2d1e9c1 req-31315684-e288-46ab-a413-84220721ead9 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:53:03 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-e7219855-2970-4727-8abf-f9b7c2d1e9c1 req-31315684-e288-46ab-a413-84220721ead9 service nova] Creating event network-vif-deleted:516728bc-fbfa-4318-bbac-6c94509ee008 for instance 69031436-19d1-4cc1-91e7-4d99381b6ae3 on user Apr 21 10:53:03 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [req-e7219855-2970-4727-8abf-f9b7c2d1e9c1 req-31315684-e288-46ab-a413-84220721ead9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036547 Apr 21 10:53:03 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 84/254] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:53:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:53:03 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-da2dfb1a-30a9-4680-843f-f9f79b54d92d tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:53:03 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-da2dfb1a-30a9-4680-843f-f9f79b54d92d tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] [instance: f8609da3-c26d-482a-bc03-017baf4bce22] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:53:03 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-da2dfb1a-30a9-4680-843f-f9f79b54d92d tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:53:03 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-da2dfb1a-30a9-4680-843f-f9f79b54d92d tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:53:03 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-da2dfb1a-30a9-4680-843f-f9f79b54d92d tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:53:03 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-da2dfb1a-30a9-4680-843f-f9f79b54d92d tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:53:03 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-da2dfb1a-30a9-4680-843f-f9f79b54d92d tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:53:03 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-da2dfb1a-30a9-4680-843f-f9f79b54d92d tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:53:04 user devstack@n-api.service[61320]: DEBUG nova.policy [None req-da2dfb1a-30a9-4680-843f-f9f79b54d92d tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced216baa4a64c72946cf3f71eb873dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648163a728fc4b28b85a24e9198d356b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61320) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:53:04 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-da2dfb1a-30a9-4680-843f-f9f79b54d92d tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8609da3-c26d-482a-bc03-017baf4bce22" status: 200 len: 1656 microversion: 2.1 time: 0.237903 Apr 21 10:53:04 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 86/255] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:53:03 2023] GET /compute/v2.1/servers/f8609da3-c26d-482a-bc03-017baf4bce22 => generated 1656 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:53:04 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-1481f221-045e-4ef1-b280-abc7e77cab95 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2104835370", "imageRef": "3b29a01a-1fc0-4d0d-89fb-23d22b2de02e", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "e0ccd2d9-69df-40e0-be8e-8328039f1bd0"}], "security_groups": [{"name": "tempest-securitygroup--248256020"}], "key_name": "tempest-keypair-962586907", "user_data": "}} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:53:04 user devstack@n-api.service[61319]: DEBUG nova.network.neutron [None req-1481f221-045e-4ef1-b280-abc7e77cab95 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] validate_networks() for [('e0ccd2d9-69df-40e0-be8e-8328039f1bd0', None, None, None, None, None)] {{(pid=61319) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 10:53:04 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [req-3b03bf1f-d441-499f-9a33-b72a9cf2f3f7 req-b10c73aa-98c6-42e2-abb9-34cf7560f6fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69031436-19d1-4cc1-91e7-4d99381b6ae3", "name": "network-vif-plugged", "status": "completed", "tag": "516728bc-fbfa-4318-bbac-6c94509ee008"}]} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:53:04 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-3b03bf1f-d441-499f-9a33-b72a9cf2f3f7 req-b10c73aa-98c6-42e2-abb9-34cf7560f6fb service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:53:04 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-3b03bf1f-d441-499f-9a33-b72a9cf2f3f7 req-b10c73aa-98c6-42e2-abb9-34cf7560f6fb service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:53:04 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-3b03bf1f-d441-499f-9a33-b72a9cf2f3f7 req-b10c73aa-98c6-42e2-abb9-34cf7560f6fb service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:53:04 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-3b03bf1f-d441-499f-9a33-b72a9cf2f3f7 req-b10c73aa-98c6-42e2-abb9-34cf7560f6fb service nova] Creating event network-vif-plugged:516728bc-fbfa-4318-bbac-6c94509ee008 for instance 69031436-19d1-4cc1-91e7-4d99381b6ae3 on user Apr 21 10:53:04 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [req-3b03bf1f-d441-499f-9a33-b72a9cf2f3f7 req-b10c73aa-98c6-42e2-abb9-34cf7560f6fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027859 Apr 21 10:53:04 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 85/256] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:53:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:53:04 user devstack@n-api.service[61319]: DEBUG nova.virt.hardware [None req-1481f221-045e-4ef1-b280-abc7e77cab95 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Flavor limits 0:0:0 {{(pid=61319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 10:53:04 user devstack@n-api.service[61319]: DEBUG nova.virt.hardware [None req-1481f221-045e-4ef1-b280-abc7e77cab95 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Image limits 0:0:0 {{(pid=61319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 10:53:04 user devstack@n-api.service[61319]: DEBUG nova.virt.hardware [None req-1481f221-045e-4ef1-b280-abc7e77cab95 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Flavor pref 0:0:0 {{(pid=61319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 10:53:04 user devstack@n-api.service[61319]: DEBUG nova.virt.hardware [None req-1481f221-045e-4ef1-b280-abc7e77cab95 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Image pref 0:0:0 {{(pid=61319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 10:53:04 user devstack@n-api.service[61319]: DEBUG nova.virt.hardware [None req-1481f221-045e-4ef1-b280-abc7e77cab95 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 10:53:04 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-1481f221-045e-4ef1-b280-abc7e77cab95 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:53:04 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-1481f221-045e-4ef1-b280-abc7e77cab95 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:53:04 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-1481f221-045e-4ef1-b280-abc7e77cab95 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:53:04 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-1481f221-045e-4ef1-b280-abc7e77cab95 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:53:04 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-1481f221-045e-4ef1-b280-abc7e77cab95 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:53:04 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-1481f221-045e-4ef1-b280-abc7e77cab95 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:53:04 user devstack@n-api.service[61319]: DEBUG nova.quota [None req-1481f221-045e-4ef1-b280-abc7e77cab95 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Getting quotas for project 14bc6b0c20204c8287b3523814007856. Resources: {'cores', 'instances', 'ram'} {{(pid=61319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 10:53:04 user devstack@n-api.service[61319]: DEBUG nova.quota [None req-1481f221-045e-4ef1-b280-abc7e77cab95 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Getting quotas for user d7fc66871488428e9842404d885bcfe3 and project 14bc6b0c20204c8287b3523814007856. Resources: {'cores', 'instances', 'ram'} {{(pid=61319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 10:53:04 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-1481f221-045e-4ef1-b280-abc7e77cab95 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Going to run 1 instances... {{(pid=61319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 10:53:04 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-1481f221-045e-4ef1-b280-abc7e77cab95 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] [instance: d28e1e38-3ed5-468e-b672-8b94a909820c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3b29a01a-1fc0-4d0d-89fb-23d22b2de02e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 10:53:04 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-1481f221-045e-4ef1-b280-abc7e77cab95 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.649058 Apr 21 10:53:04 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 86/257] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 10:53:04 2023] POST /compute/v2.1/servers => generated 399 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 10:53:04 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-dff59e8a-d1ce-40ed-a2e6-a41008f79fb7 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:53:04 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-dff59e8a-d1ce-40ed-a2e6-a41008f79fb7 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] [instance: d28e1e38-3ed5-468e-b672-8b94a909820c] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:53:04 user devstack@n-api.service[61320]: DEBUG nova.policy [None req-dff59e8a-d1ce-40ed-a2e6-a41008f79fb7 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fc66871488428e9842404d885bcfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bc6b0c20204c8287b3523814007856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61320) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:53:04 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-dff59e8a-d1ce-40ed-a2e6-a41008f79fb7 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d28e1e38-3ed5-468e-b672-8b94a909820c" status: 200 len: 1235 microversion: 2.1 time: 0.057411 Apr 21 10:53:04 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 87/258] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:53:04 2023] GET /compute/v2.1/servers/d28e1e38-3ed5-468e-b672-8b94a909820c => generated 1235 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:53:07 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [req-24c434ed-7de8-4572-817d-553ed6c28218 req-606e6070-45bf-4acf-a988-e4ed8384e288 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d28e1e38-3ed5-468e-b672-8b94a909820c", "tag": "92fab70c-ebc3-4119-8fa9-874304b51cb5"}]} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:53:07 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-24c434ed-7de8-4572-817d-553ed6c28218 req-606e6070-45bf-4acf-a988-e4ed8384e288 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:53:07 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-24c434ed-7de8-4572-817d-553ed6c28218 req-606e6070-45bf-4acf-a988-e4ed8384e288 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:53:07 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-24c434ed-7de8-4572-817d-553ed6c28218 req-606e6070-45bf-4acf-a988-e4ed8384e288 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:53:08 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-24c434ed-7de8-4572-817d-553ed6c28218 req-606e6070-45bf-4acf-a988-e4ed8384e288 service nova] Creating event network-changed:92fab70c-ebc3-4119-8fa9-874304b51cb5 for instance d28e1e38-3ed5-468e-b672-8b94a909820c on user Apr 21 10:53:08 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [req-24c434ed-7de8-4572-817d-553ed6c28218 req-606e6070-45bf-4acf-a988-e4ed8384e288 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028248 Apr 21 10:53:08 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 86/259] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:53:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:53:09 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-f6f4095d-b893-44ae-9635-7ec676779906 tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:53:09 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-f6f4095d-b893-44ae-9635-7ec676779906 tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] [instance: 14bd5401-4cc1-4827-8d4a-fd1358bb9c6b] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:53:09 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-f6f4095d-b893-44ae-9635-7ec676779906 tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:53:09 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-f6f4095d-b893-44ae-9635-7ec676779906 tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:53:09 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-f6f4095d-b893-44ae-9635-7ec676779906 tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:53:09 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-f6f4095d-b893-44ae-9635-7ec676779906 tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:53:09 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-f6f4095d-b893-44ae-9635-7ec676779906 tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:53:09 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-f6f4095d-b893-44ae-9635-7ec676779906 tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:53:10 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [req-f23726ef-2ca6-4c1d-90d2-c58f9cb9fb21 req-abea490d-b9e9-4323-9385-99ca4d39c3dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d28e1e38-3ed5-468e-b672-8b94a909820c", "name": "network-vif-plugged", "status": "completed", "tag": "92fab70c-ebc3-4119-8fa9-874304b51cb5"}]} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:53:10 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-f23726ef-2ca6-4c1d-90d2-c58f9cb9fb21 req-abea490d-b9e9-4323-9385-99ca4d39c3dc service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:53:10 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-f23726ef-2ca6-4c1d-90d2-c58f9cb9fb21 req-abea490d-b9e9-4323-9385-99ca4d39c3dc service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:53:10 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-f23726ef-2ca6-4c1d-90d2-c58f9cb9fb21 req-abea490d-b9e9-4323-9385-99ca4d39c3dc service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:53:10 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-f23726ef-2ca6-4c1d-90d2-c58f9cb9fb21 req-abea490d-b9e9-4323-9385-99ca4d39c3dc service nova] Creating event network-vif-plugged:92fab70c-ebc3-4119-8fa9-874304b51cb5 for instance d28e1e38-3ed5-468e-b672-8b94a909820c on user Apr 21 10:53:10 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [req-f23726ef-2ca6-4c1d-90d2-c58f9cb9fb21 req-abea490d-b9e9-4323-9385-99ca4d39c3dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038990 Apr 21 10:53:10 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 88/260] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:53:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:53:10 user devstack@n-api.service[61319]: DEBUG nova.policy [None req-f6f4095d-b893-44ae-9635-7ec676779906 tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc80162b39bc4ff2a71a8ff4d34979c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eaf2efa4ddc4d8fbc5ec14e86d93c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61319) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:53:10 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-f6f4095d-b893-44ae-9635-7ec676779906 tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14bd5401-4cc1-4827-8d4a-fd1358bb9c6b" status: 200 len: 1487 microversion: 2.1 time: 0.393196 Apr 21 10:53:10 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 87/261] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:53:09 2023] GET /compute/v2.1/servers/14bd5401-4cc1-4827-8d4a-fd1358bb9c6b => generated 1487 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:53:12 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell0:SELECT=2 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:53:12 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [req-3710d2cb-ec77-4c2b-9e7a-d656683eb3aa req-e8454d5f-69ed-43e6-bde8-493507e654e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d28e1e38-3ed5-468e-b672-8b94a909820c", "name": "network-vif-plugged", "status": "completed", "tag": "92fab70c-ebc3-4119-8fa9-874304b51cb5"}]} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:53:12 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-3710d2cb-ec77-4c2b-9e7a-d656683eb3aa req-e8454d5f-69ed-43e6-bde8-493507e654e8 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:53:12 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-3710d2cb-ec77-4c2b-9e7a-d656683eb3aa req-e8454d5f-69ed-43e6-bde8-493507e654e8 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:53:12 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-3710d2cb-ec77-4c2b-9e7a-d656683eb3aa req-e8454d5f-69ed-43e6-bde8-493507e654e8 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:53:12 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-3710d2cb-ec77-4c2b-9e7a-d656683eb3aa req-e8454d5f-69ed-43e6-bde8-493507e654e8 service nova] Creating event network-vif-plugged:92fab70c-ebc3-4119-8fa9-874304b51cb5 for instance d28e1e38-3ed5-468e-b672-8b94a909820c on user Apr 21 10:53:12 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [req-3710d2cb-ec77-4c2b-9e7a-d656683eb3aa req-e8454d5f-69ed-43e6-bde8-493507e654e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034930 Apr 21 10:53:12 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 87/262] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:53:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:53:50 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell0:SELECT=2 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:53:50 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_api:SELECT=18 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:53:50 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell1:SELECT=26 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:53:50 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-5ca798db-ac27-47dc-949b-c6831060dc6a tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1257500458", "imageRef": "3b29a01a-1fc0-4d0d-89fb-23d22b2de02e", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "3b29a01a-1fc0-4d0d-89fb-23d22b2de02e", "destination_type": "volume"}], "networks": [{"uuid": "cfb4de90-44ea-486a-b5c4-c3b1111aa2bd"}]}} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:53:50 user devstack@n-api.service[61320]: DEBUG nova.network.neutron [None req-5ca798db-ac27-47dc-949b-c6831060dc6a tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] validate_networks() for [('cfb4de90-44ea-486a-b5c4-c3b1111aa2bd', None, None, None, None, None)] {{(pid=61320) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 10:53:51 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-5ca798db-ac27-47dc-949b-c6831060dc6a tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Flavor limits 0:0:0 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 10:53:51 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-5ca798db-ac27-47dc-949b-c6831060dc6a tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Image limits 0:0:0 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 10:53:51 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-5ca798db-ac27-47dc-949b-c6831060dc6a tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Flavor pref 0:0:0 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 10:53:51 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-5ca798db-ac27-47dc-949b-c6831060dc6a tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Image pref 0:0:0 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 10:53:51 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-5ca798db-ac27-47dc-949b-c6831060dc6a tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 10:53:51 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-5ca798db-ac27-47dc-949b-c6831060dc6a tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:53:51 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-5ca798db-ac27-47dc-949b-c6831060dc6a tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:53:51 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-5ca798db-ac27-47dc-949b-c6831060dc6a tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:53:51 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-5ca798db-ac27-47dc-949b-c6831060dc6a tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:53:51 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-5ca798db-ac27-47dc-949b-c6831060dc6a tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:53:51 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-5ca798db-ac27-47dc-949b-c6831060dc6a tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:53:51 user devstack@n-api.service[61320]: DEBUG nova.quota [None req-5ca798db-ac27-47dc-949b-c6831060dc6a tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Getting quotas for project aad84a0e014f47ddaeaddc88bf16b0a8. Resources: {'cores', 'instances', 'ram'} {{(pid=61320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 10:53:51 user devstack@n-api.service[61320]: DEBUG nova.quota [None req-5ca798db-ac27-47dc-949b-c6831060dc6a tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Getting quotas for user 54c67d90b6014d9ea24ef2552006bc04 and project aad84a0e014f47ddaeaddc88bf16b0a8. Resources: {'cores', 'instances', 'ram'} {{(pid=61320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 10:53:51 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-5ca798db-ac27-47dc-949b-c6831060dc6a tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Going to run 1 instances... {{(pid=61320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 10:53:51 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-5ca798db-ac27-47dc-949b-c6831060dc6a tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] [instance: a5418b3c-8587-4544-b562-fe01a69be3fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3b29a01a-1fc0-4d0d-89fb-23d22b2de02e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 10:53:51 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-5ca798db-ac27-47dc-949b-c6831060dc6a tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 1.049923 Apr 21 10:53:51 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 89/263] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 21 10:53:50 2023] POST /compute/v2.1/servers => generated 378 bytes in 1052 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 21 10:53:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-b7f5788e-0565-403a-b9c3-84f95554010f tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:53:51 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-b7f5788e-0565-403a-b9c3-84f95554010f tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] [instance: a5418b3c-8587-4544-b562-fe01a69be3fc] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:53:51 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell0:SELECT=2 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:53:51 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell0:SELECT=10 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:53:51 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:53:51 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:53:51 user devstack@n-api.service[61319]: DEBUG nova.policy [None req-b7f5788e-0565-403a-b9c3-84f95554010f tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c67d90b6014d9ea24ef2552006bc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad84a0e014f47ddaeaddc88bf16b0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61319) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:53:51 user devstack@n-api.service[61319]: DEBUG nova.policy [None req-b7f5788e-0565-403a-b9c3-84f95554010f tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c67d90b6014d9ea24ef2552006bc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad84a0e014f47ddaeaddc88bf16b0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61319) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:53:51 user devstack@n-api.service[61319]: DEBUG nova.policy [None req-b7f5788e-0565-403a-b9c3-84f95554010f tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c67d90b6014d9ea24ef2552006bc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad84a0e014f47ddaeaddc88bf16b0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61319) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:53:51 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-b7f5788e-0565-403a-b9c3-84f95554010f tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a5418b3c-8587-4544-b562-fe01a69be3fc" status: 200 len: 1395 microversion: 2.87 time: 0.094128 Apr 21 10:53:51 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 88/264] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 10:53:51 2023] GET /compute/v2.1/servers/a5418b3c-8587-4544-b562-fe01a69be3fc => generated 1395 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 10:53:52 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-8956a656-54fb-4801-8a58-985c36ce62c2 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:53:52 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-8956a656-54fb-4801-8a58-985c36ce62c2 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] [instance: 69031436-19d1-4cc1-91e7-4d99381b6ae3] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:53:52 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=2 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:53:52 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:53:52 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-8956a656-54fb-4801-8a58-985c36ce62c2 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:53:52 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-8956a656-54fb-4801-8a58-985c36ce62c2 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:53:52 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-8956a656-54fb-4801-8a58-985c36ce62c2 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:53:52 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-8956a656-54fb-4801-8a58-985c36ce62c2 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:53:52 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-8956a656-54fb-4801-8a58-985c36ce62c2 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:53:52 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-8956a656-54fb-4801-8a58-985c36ce62c2 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:53:52 user devstack@n-api.service[61318]: INFO nova.api.openstack.wsgi [None req-8956a656-54fb-4801-8a58-985c36ce62c2 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] HTTP exception thrown: Instance 69031436-19d1-4cc1-91e7-4d99381b6ae3 could not be found. Apr 21 10:53:52 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-8956a656-54fb-4801-8a58-985c36ce62c2 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Request method failure captured: Apr 21 10:53:52 user devstack@n-api.service[61318]: request: GET /compute/v2.1/servers/69031436-19d1-4cc1-91e7-4d99381b6ae3 HTTP/1.1 Apr 21 10:53:52 user devstack@n-api.service[61318]: Accept: application/json Apr 21 10:53:52 user devstack@n-api.service[61318]: Accept-Encoding: identity Apr 21 10:53:52 user devstack@n-api.service[61318]: Connection: close Apr 21 10:53:52 user devstack@n-api.service[61318]: Content-Length: 0 Apr 21 10:53:52 user devstack@n-api.service[61318]: Content-Type: application/json Apr 21 10:53:52 user devstack@n-api.service[61318]: Host: 10.0.0.210 Apr 21 10:53:52 user devstack@n-api.service[61318]: Openstack-System-Scope: None Apr 21 10:53:52 user devstack@n-api.service[61318]: User-Agent: python-urllib3/1.26.15 Apr 21 10:53:52 user devstack@n-api.service[61318]: X-Auth-Token: gAAAAABkQmqTJb4gMatwFnGNZlEDIlfd2J8GQxQYyUXpY8O4FjwKkGMA6MEjQ9zanV23iBtQM1YgNv-SkAJx50lUr5RFpX3B85mtI2vi-WZrRejfUDAggOOcMJYyCCkREc-9sOjPd5a1WnwIaad-Pm9bQOQ0tH_LCJnlRjHS-76kP0uJnY1Uk18 Apr 21 10:53:52 user devstack@n-api.service[61318]: X-Domain-Id: None Apr 21 10:53:52 user devstack@n-api.service[61318]: X-Domain-Name: None Apr 21 10:53:52 user devstack@n-api.service[61318]: X-Identity-Status: Confirmed Apr 21 10:53:52 user devstack@n-api.service[61318]: X-Is-Admin-Project: True Apr 21 10:53:52 user devstack@n-api.service[61318]: X-Project-Domain-Id: default Apr 21 10:53:52 user devstack@n-api.service[61318]: X-Project-Domain-Name: Default Apr 21 10:53:52 user devstack@n-api.service[61318]: X-Project-Id: 9ead44a7da0640cbb2cf8dece0ea4f40 Apr 21 10:53:52 user devstack@n-api.service[61318]: X-Project-Name: tempest-TestMinimumBasicScenario-339882477 Apr 21 10:53:52 user devstack@n-api.service[61318]: X-Role: reader,member Apr 21 10:53:52 user devstack@n-api.service[61318]: X-Roles: reader,member Apr 21 10:53:52 user devstack@n-api.service[61318]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9ead44a7da0640cbb2cf8dece0ea4f40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9ead44a7da0640cbb2cf8dece0ea4f40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9ead44a7da0640cbb2cf8dece0ea4f40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 10:53:52 user devstack@n-api.service[61318]: X-Tenant: tempest-TestMinimumBasicScenario-339882477 Apr 21 10:53:52 user devstack@n-api.service[61318]: X-Tenant-Id: 9ead44a7da0640cbb2cf8dece0ea4f40 Apr 21 10:53:52 user devstack@n-api.service[61318]: X-Tenant-Name: tempest-TestMinimumBasicScenario-339882477 Apr 21 10:53:52 user devstack@n-api.service[61318]: X-User: tempest-TestMinimumBasicScenario-339882477-project-member Apr 21 10:53:52 user devstack@n-api.service[61318]: X-User-Domain-Id: default Apr 21 10:53:52 user devstack@n-api.service[61318]: X-User-Domain-Name: Default Apr 21 10:53:52 user devstack@n-api.service[61318]: X-User-Id: 6cae5a1734d24ac8aebc233dd31d3084 Apr 21 10:53:52 user devstack@n-api.service[61318]: X-User-Name: tempest-TestMinimumBasicScenario-339882477-project-member Apr 21 10:53:52 user devstack@n-api.service[61318]: method: > Apr 21 10:53:52 user devstack@n-api.service[61318]: exception: Instance 69031436-19d1-4cc1-91e7-4d99381b6ae3 could not be found. Apr 21 10:53:52 user devstack@n-api.service[61318]: action_args: {'id': '69031436-19d1-4cc1-91e7-4d99381b6ae3'} Apr 21 10:53:52 user devstack@n-api.service[61318]: {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 10:53:52 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:53:52 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 10:53:52 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 10:53:52 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 10:53:52 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 10:53:52 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 10:53:52 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 10:53:52 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 10:53:52 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 10:53:52 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69031436-19d1-4cc1-91e7-4d99381b6ae3 could not be found. Apr 21 10:53:52 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:53:52 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:53:52 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:53:52 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:53:52 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 10:53:52 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 10:53:52 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 10:53:52 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 10:53:52 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 10:53:52 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 10:53:52 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 10:53:52 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 10:53:52 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 10:53:52 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 10:53:52 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 10:53:52 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 10:53:52 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69031436-19d1-4cc1-91e7-4d99381b6ae3 could not be found. Apr 21 10:53:52 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:53:52 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:53:52 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:53:52 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:53:52 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 10:53:52 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 10:53:52 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 10:53:52 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 10:53:52 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69031436-19d1-4cc1-91e7-4d99381b6ae3 could not be found. Apr 21 10:53:52 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:53:52 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-8956a656-54fb-4801-8a58-985c36ce62c2 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Returning 404 to user: Instance 69031436-19d1-4cc1-91e7-4d99381b6ae3 could not be found. {{(pid=61318) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 10:53:52 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-8956a656-54fb-4801-8a58-985c36ce62c2 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] 10.0.0.210 "GET /compute/v2.1/servers/69031436-19d1-4cc1-91e7-4d99381b6ae3" status: 404 len: 111 microversion: 2.1 time: 0.036094 Apr 21 10:53:52 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 88/265] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:53:52 2023] GET /compute/v2.1/servers/69031436-19d1-4cc1-91e7-4d99381b6ae3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 10:53:52 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-45f07a0d-d49c-4172-8af6-aa55115bead4 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Calling method '.version_select at 0x7f91a5d44c10>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:53:52 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-45f07a0d-d49c-4172-8af6-aa55115bead4 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-990689924" status: 202 len: 0 microversion: 2.1 time: 0.023060 Apr 21 10:53:52 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 90/266] 10.0.0.210 () {62 vars in 1346 bytes} [Fri Apr 21 10:53:52 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-990689924 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 10:53:53 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-e5da14c6-800b-4043-86cb-15f9a082e625 req-39a8052b-e02a-414a-883c-2b41df5f9f35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5418b3c-8587-4544-b562-fe01a69be3fc", "tag": "e67a2be9-b6b6-468f-867d-0e4930f5d56d"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:53:53 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-e5da14c6-800b-4043-86cb-15f9a082e625 req-39a8052b-e02a-414a-883c-2b41df5f9f35 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:53:53 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-e5da14c6-800b-4043-86cb-15f9a082e625 req-39a8052b-e02a-414a-883c-2b41df5f9f35 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:53:53 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-e5da14c6-800b-4043-86cb-15f9a082e625 req-39a8052b-e02a-414a-883c-2b41df5f9f35 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:53:54 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-e5da14c6-800b-4043-86cb-15f9a082e625 req-39a8052b-e02a-414a-883c-2b41df5f9f35 service nova] Creating event network-changed:e67a2be9-b6b6-468f-867d-0e4930f5d56d for instance a5418b3c-8587-4544-b562-fe01a69be3fc on user Apr 21 10:53:54 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-e5da14c6-800b-4043-86cb-15f9a082e625 req-39a8052b-e02a-414a-883c-2b41df5f9f35 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032667 Apr 21 10:53:54 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 89/267] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:53:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:53:54 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-54a56646-9bbd-49e4-b4dc-01dfdbe4d476 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Action: 'create', calling method: .version_select at 0x7f91a5d504c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1698854069", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5kEQk6hWARzkdAxYq+PejmYD/iouSlgR4Vlro63NFT4BV2SLZZTcJkpc9dGXv7UnIQQu9gOJSnEV3QeSQLSLjalHZp/U4BZsLF5Brm42aa21bVfKcjzsWQHuJOfIGbHg=="}} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:53:54 user devstack@n-api.service[61318]: DEBUG nova.quota [None req-54a56646-9bbd-49e4-b4dc-01dfdbe4d476 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Getting quotas for project 9ead44a7da0640cbb2cf8dece0ea4f40. Resources: {'key_pairs'} {{(pid=61318) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 10:53:54 user devstack@n-api.service[61318]: DEBUG nova.quota [None req-54a56646-9bbd-49e4-b4dc-01dfdbe4d476 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Getting quotas for user 6cae5a1734d24ac8aebc233dd31d3084 and project 9ead44a7da0640cbb2cf8dece0ea4f40. Resources: {'key_pairs'} {{(pid=61318) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 10:53:54 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-54a56646-9bbd-49e4-b4dc-01dfdbe4d476 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.041612 Apr 21 10:53:54 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 89/268] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 21 10:53:54 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:53:54 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-23ef1f3c-39be-4342-8242-beff1fe5793e tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-843445589", "imageRef": "d5ab5add-8fb7-4436-88e9-0cb945ddc863", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1698854069", "networks": [{"uuid": "89cc600b-891d-4913-9f39-935f5c5bce86"}]}} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:53:54 user devstack@n-api.service[61320]: DEBUG nova.network.neutron [None req-23ef1f3c-39be-4342-8242-beff1fe5793e tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] validate_networks() for [('89cc600b-891d-4913-9f39-935f5c5bce86', None, None, None, None, None)] {{(pid=61320) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 10:53:55 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-4e9c8c6c-3813-44da-b482-3d6b96134e6d tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:53:55 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-4e9c8c6c-3813-44da-b482-3d6b96134e6d tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] [instance: d28e1e38-3ed5-468e-b672-8b94a909820c] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:53:55 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-4e9c8c6c-3813-44da-b482-3d6b96134e6d tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:53:55 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-4e9c8c6c-3813-44da-b482-3d6b96134e6d tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:53:55 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-4e9c8c6c-3813-44da-b482-3d6b96134e6d tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:53:55 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-4e9c8c6c-3813-44da-b482-3d6b96134e6d tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:53:55 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-4e9c8c6c-3813-44da-b482-3d6b96134e6d tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:53:55 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-4e9c8c6c-3813-44da-b482-3d6b96134e6d tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:53:55 user devstack@n-api.service[61319]: DEBUG nova.policy [None req-4e9c8c6c-3813-44da-b482-3d6b96134e6d tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fc66871488428e9842404d885bcfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bc6b0c20204c8287b3523814007856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61319) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:53:55 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-4e9c8c6c-3813-44da-b482-3d6b96134e6d tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d28e1e38-3ed5-468e-b672-8b94a909820c" status: 200 len: 1543 microversion: 2.1 time: 0.394185 Apr 21 10:53:55 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 90/269] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:53:55 2023] GET /compute/v2.1/servers/d28e1e38-3ed5-468e-b672-8b94a909820c => generated 1543 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:53:55 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-23ef1f3c-39be-4342-8242-beff1fe5793e tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Flavor limits 0:0:0 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 10:53:55 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-23ef1f3c-39be-4342-8242-beff1fe5793e tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Image limits 0:0:0 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 10:53:55 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-23ef1f3c-39be-4342-8242-beff1fe5793e tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Flavor pref 0:0:0 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 10:53:55 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-23ef1f3c-39be-4342-8242-beff1fe5793e tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Image pref 0:0:0 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 10:53:55 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-23ef1f3c-39be-4342-8242-beff1fe5793e tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 10:53:55 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-23ef1f3c-39be-4342-8242-beff1fe5793e tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:53:55 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-23ef1f3c-39be-4342-8242-beff1fe5793e tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:53:55 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-23ef1f3c-39be-4342-8242-beff1fe5793e tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:53:55 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-23ef1f3c-39be-4342-8242-beff1fe5793e tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:53:55 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-23ef1f3c-39be-4342-8242-beff1fe5793e tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:53:55 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-23ef1f3c-39be-4342-8242-beff1fe5793e tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:53:55 user devstack@n-api.service[61320]: DEBUG nova.quota [None req-23ef1f3c-39be-4342-8242-beff1fe5793e tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Getting quotas for project 9ead44a7da0640cbb2cf8dece0ea4f40. Resources: {'cores', 'instances', 'ram'} {{(pid=61320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 10:53:55 user devstack@n-api.service[61320]: DEBUG nova.quota [None req-23ef1f3c-39be-4342-8242-beff1fe5793e tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Getting quotas for user 6cae5a1734d24ac8aebc233dd31d3084 and project 9ead44a7da0640cbb2cf8dece0ea4f40. Resources: {'cores', 'instances', 'ram'} {{(pid=61320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 10:53:55 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-23ef1f3c-39be-4342-8242-beff1fe5793e tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Going to run 1 instances... {{(pid=61320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 10:53:55 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-23ef1f3c-39be-4342-8242-beff1fe5793e tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] [instance: f3e0bc01-1cf2-4ff9-bec6-12a37e44171c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d5ab5add-8fb7-4436-88e9-0cb945ddc863',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 10:53:55 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-23ef1f3c-39be-4342-8242-beff1fe5793e tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.771521 Apr 21 10:53:55 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 91/270] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 10:53:54 2023] POST /compute/v2.1/servers => generated 378 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 10:53:55 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-e537a646-6b34-4ffb-9e94-db558fd21515 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:53:55 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-e537a646-6b34-4ffb-9e94-db558fd21515 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] [instance: f3e0bc01-1cf2-4ff9-bec6-12a37e44171c] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:53:55 user devstack@n-api.service[61318]: DEBUG nova.policy [None req-e537a646-6b34-4ffb-9e94-db558fd21515 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cae5a1734d24ac8aebc233dd31d3084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead44a7da0640cbb2cf8dece0ea4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61318) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:53:55 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-e537a646-6b34-4ffb-9e94-db558fd21515 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3e0bc01-1cf2-4ff9-bec6-12a37e44171c" status: 200 len: 1252 microversion: 2.1 time: 0.068007 Apr 21 10:53:55 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 90/271] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:53:55 2023] GET /compute/v2.1/servers/f3e0bc01-1cf2-4ff9-bec6-12a37e44171c => generated 1252 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:53:58 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-34de482a-e735-444e-b332-c369dc5cb4db req-0f94b517-e037-4f18-b878-68956960ff18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3e0bc01-1cf2-4ff9-bec6-12a37e44171c", "tag": "ec8edd23-eb04-4e01-874f-7a5ad305eacc"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:53:58 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-34de482a-e735-444e-b332-c369dc5cb4db req-0f94b517-e037-4f18-b878-68956960ff18 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:53:58 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-34de482a-e735-444e-b332-c369dc5cb4db req-0f94b517-e037-4f18-b878-68956960ff18 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:53:58 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-34de482a-e735-444e-b332-c369dc5cb4db req-0f94b517-e037-4f18-b878-68956960ff18 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:53:58 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-34de482a-e735-444e-b332-c369dc5cb4db req-0f94b517-e037-4f18-b878-68956960ff18 service nova] Creating event network-changed:ec8edd23-eb04-4e01-874f-7a5ad305eacc for instance f3e0bc01-1cf2-4ff9-bec6-12a37e44171c on user Apr 21 10:53:58 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-34de482a-e735-444e-b332-c369dc5cb4db req-0f94b517-e037-4f18-b878-68956960ff18 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030599 Apr 21 10:53:58 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 91/272] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:53:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:54:00 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [req-1240bd38-87be-4810-abde-0f05dcb4069d req-cae6d7b8-ef67-4335-86ff-fcb14e3710bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5418b3c-8587-4544-b562-fe01a69be3fc", "name": "network-vif-deleted", "tag": "e67a2be9-b6b6-468f-867d-0e4930f5d56d"}]} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:54:00 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-1240bd38-87be-4810-abde-0f05dcb4069d req-cae6d7b8-ef67-4335-86ff-fcb14e3710bd service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:54:00 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-1240bd38-87be-4810-abde-0f05dcb4069d req-cae6d7b8-ef67-4335-86ff-fcb14e3710bd service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:54:00 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-1240bd38-87be-4810-abde-0f05dcb4069d req-cae6d7b8-ef67-4335-86ff-fcb14e3710bd service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:54:00 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.compute.server_external_events [req-1240bd38-87be-4810-abde-0f05dcb4069d req-cae6d7b8-ef67-4335-86ff-fcb14e3710bd service nova] Unable to find a host for instance a5418b3c-8587-4544-b562-fe01a69be3fc. Dropping event network-vif-deleted {{(pid=61320) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 21 10:54:00 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [req-1240bd38-87be-4810-abde-0f05dcb4069d req-cae6d7b8-ef67-4335-86ff-fcb14e3710bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.032607 Apr 21 10:54:00 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 92/273] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:54:00 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 21 10:54:01 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [req-9e0b9c43-3407-4bc7-abe3-16c0b89922fc req-8fe0ea82-3672-4546-8926-5d46c3f66afd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3e0bc01-1cf2-4ff9-bec6-12a37e44171c", "name": "network-vif-plugged", "status": "completed", "tag": "ec8edd23-eb04-4e01-874f-7a5ad305eacc"}]} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:54:01 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-9e0b9c43-3407-4bc7-abe3-16c0b89922fc req-8fe0ea82-3672-4546-8926-5d46c3f66afd service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:54:01 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-9e0b9c43-3407-4bc7-abe3-16c0b89922fc req-8fe0ea82-3672-4546-8926-5d46c3f66afd service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:54:01 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-9e0b9c43-3407-4bc7-abe3-16c0b89922fc req-8fe0ea82-3672-4546-8926-5d46c3f66afd service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:54:01 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-9e0b9c43-3407-4bc7-abe3-16c0b89922fc req-8fe0ea82-3672-4546-8926-5d46c3f66afd service nova] Creating event network-vif-plugged:ec8edd23-eb04-4e01-874f-7a5ad305eacc for instance f3e0bc01-1cf2-4ff9-bec6-12a37e44171c on user Apr 21 10:54:01 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [req-9e0b9c43-3407-4bc7-abe3-16c0b89922fc req-8fe0ea82-3672-4546-8926-5d46c3f66afd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035572 Apr 21 10:54:01 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 91/274] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:54:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:54:03 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell0:SELECT=2 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:54:03 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-dd2e9920-9b17-4f35-8cc1-c50e3fe6b55a req-1afb10cb-8392-4660-827d-56d2879f7168 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3e0bc01-1cf2-4ff9-bec6-12a37e44171c", "name": "network-vif-plugged", "status": "completed", "tag": "ec8edd23-eb04-4e01-874f-7a5ad305eacc"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:54:03 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-dd2e9920-9b17-4f35-8cc1-c50e3fe6b55a req-1afb10cb-8392-4660-827d-56d2879f7168 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:54:03 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-dd2e9920-9b17-4f35-8cc1-c50e3fe6b55a req-1afb10cb-8392-4660-827d-56d2879f7168 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:54:03 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-dd2e9920-9b17-4f35-8cc1-c50e3fe6b55a req-1afb10cb-8392-4660-827d-56d2879f7168 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:54:03 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-dd2e9920-9b17-4f35-8cc1-c50e3fe6b55a req-1afb10cb-8392-4660-827d-56d2879f7168 service nova] Creating event network-vif-plugged:ec8edd23-eb04-4e01-874f-7a5ad305eacc for instance f3e0bc01-1cf2-4ff9-bec6-12a37e44171c on user Apr 21 10:54:03 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-dd2e9920-9b17-4f35-8cc1-c50e3fe6b55a req-1afb10cb-8392-4660-827d-56d2879f7168 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033107 Apr 21 10:54:03 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 92/275] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:54:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:54:04 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-302f4388-2ea2-4943-a05d-93965d362e80 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:54:04 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-302f4388-2ea2-4943-a05d-93965d362e80 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] [instance: f8609da3-c26d-482a-bc03-017baf4bce22] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:54:04 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-302f4388-2ea2-4943-a05d-93965d362e80 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:54:04 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-302f4388-2ea2-4943-a05d-93965d362e80 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:54:04 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-302f4388-2ea2-4943-a05d-93965d362e80 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:54:04 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-302f4388-2ea2-4943-a05d-93965d362e80 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:54:04 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-302f4388-2ea2-4943-a05d-93965d362e80 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:54:04 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-302f4388-2ea2-4943-a05d-93965d362e80 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:54:04 user devstack@n-api.service[61320]: DEBUG nova.policy [None req-302f4388-2ea2-4943-a05d-93965d362e80 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced216baa4a64c72946cf3f71eb873dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648163a728fc4b28b85a24e9198d356b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61320) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:54:04 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-302f4388-2ea2-4943-a05d-93965d362e80 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8609da3-c26d-482a-bc03-017baf4bce22" status: 200 len: 1656 microversion: 2.1 time: 0.261383 Apr 21 10:54:04 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 93/276] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:54:04 2023] GET /compute/v2.1/servers/f8609da3-c26d-482a-bc03-017baf4bce22 => generated 1656 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:54:04 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-a31174a0-8082-4bcd-a52e-ca22e6637d62 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:54:04 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-a31174a0-8082-4bcd-a52e-ca22e6637d62 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] [instance: f8609da3-c26d-482a-bc03-017baf4bce22] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:54:04 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-a31174a0-8082-4bcd-a52e-ca22e6637d62 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:54:04 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-a31174a0-8082-4bcd-a52e-ca22e6637d62 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:54:04 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-a31174a0-8082-4bcd-a52e-ca22e6637d62 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:54:04 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-a31174a0-8082-4bcd-a52e-ca22e6637d62 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:54:04 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-a31174a0-8082-4bcd-a52e-ca22e6637d62 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:54:04 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-a31174a0-8082-4bcd-a52e-ca22e6637d62 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:54:04 user devstack@n-api.service[61318]: DEBUG nova.policy [None req-a31174a0-8082-4bcd-a52e-ca22e6637d62 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced216baa4a64c72946cf3f71eb873dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648163a728fc4b28b85a24e9198d356b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61318) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:54:04 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-a31174a0-8082-4bcd-a52e-ca22e6637d62 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8609da3-c26d-482a-bc03-017baf4bce22" status: 200 len: 1656 microversion: 2.1 time: 0.252005 Apr 21 10:54:04 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 92/277] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:54:04 2023] GET /compute/v2.1/servers/f8609da3-c26d-482a-bc03-017baf4bce22 => generated 1656 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:54:04 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-434fa07b-1596-4398-8467-e85bbba34d27 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:54:04 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-434fa07b-1596-4398-8467-e85bbba34d27 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] [instance: f8609da3-c26d-482a-bc03-017baf4bce22] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:54:04 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-434fa07b-1596-4398-8467-e85bbba34d27 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:54:04 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-434fa07b-1596-4398-8467-e85bbba34d27 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:54:04 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-434fa07b-1596-4398-8467-e85bbba34d27 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:54:04 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-434fa07b-1596-4398-8467-e85bbba34d27 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:54:04 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-434fa07b-1596-4398-8467-e85bbba34d27 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:54:04 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-434fa07b-1596-4398-8467-e85bbba34d27 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:54:04 user devstack@n-api.service[61319]: DEBUG nova.policy [None req-434fa07b-1596-4398-8467-e85bbba34d27 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced216baa4a64c72946cf3f71eb873dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648163a728fc4b28b85a24e9198d356b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61319) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:54:04 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-434fa07b-1596-4398-8467-e85bbba34d27 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8609da3-c26d-482a-bc03-017baf4bce22" status: 200 len: 1656 microversion: 2.1 time: 0.147845 Apr 21 10:54:04 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 93/278] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:54:04 2023] GET /compute/v2.1/servers/f8609da3-c26d-482a-bc03-017baf4bce22 => generated 1656 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:54:12 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-8e0e8137-27be-48a9-abc0-96f50edd3b07 tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:54:12 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-8e0e8137-27be-48a9-abc0-96f50edd3b07 tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] [instance: 14bd5401-4cc1-4827-8d4a-fd1358bb9c6b] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:54:12 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell0:SELECT=4 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:54:12 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell0:SELECT=12 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:54:12 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-8e0e8137-27be-48a9-abc0-96f50edd3b07 tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:54:12 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-8e0e8137-27be-48a9-abc0-96f50edd3b07 tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:54:12 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-8e0e8137-27be-48a9-abc0-96f50edd3b07 tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:54:12 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-8e0e8137-27be-48a9-abc0-96f50edd3b07 tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:54:12 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-8e0e8137-27be-48a9-abc0-96f50edd3b07 tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:54:12 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-8e0e8137-27be-48a9-abc0-96f50edd3b07 tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:54:12 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-8e0e8137-27be-48a9-abc0-96f50edd3b07 tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] [instance: 14bd5401-4cc1-4827-8d4a-fd1358bb9c6b] Going to try to terminate instance {{(pid=61320) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 10:54:12 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-8e0e8137-27be-48a9-abc0-96f50edd3b07 tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/14bd5401-4cc1-4827-8d4a-fd1358bb9c6b" status: 204 len: 0 microversion: 2.1 time: 0.107076 Apr 21 10:54:12 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 94/279] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 10:54:12 2023] DELETE /compute/v2.1/servers/14bd5401-4cc1-4827-8d4a-fd1358bb9c6b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 10:54:12 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-793dc0f9-1f66-443c-848d-ad6aa1dbb5b9 tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:54:12 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-793dc0f9-1f66-443c-848d-ad6aa1dbb5b9 tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] [instance: 14bd5401-4cc1-4827-8d4a-fd1358bb9c6b] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:54:12 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell0:SELECT=6 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:54:12 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-793dc0f9-1f66-443c-848d-ad6aa1dbb5b9 tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:54:12 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-793dc0f9-1f66-443c-848d-ad6aa1dbb5b9 tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:54:12 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-793dc0f9-1f66-443c-848d-ad6aa1dbb5b9 tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:54:12 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-793dc0f9-1f66-443c-848d-ad6aa1dbb5b9 tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:54:12 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-793dc0f9-1f66-443c-848d-ad6aa1dbb5b9 tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:54:12 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-793dc0f9-1f66-443c-848d-ad6aa1dbb5b9 tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:54:12 user devstack@n-api.service[61318]: DEBUG nova.policy [None req-793dc0f9-1f66-443c-848d-ad6aa1dbb5b9 tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc80162b39bc4ff2a71a8ff4d34979c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eaf2efa4ddc4d8fbc5ec14e86d93c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61318) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:54:12 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-793dc0f9-1f66-443c-848d-ad6aa1dbb5b9 tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14bd5401-4cc1-4827-8d4a-fd1358bb9c6b" status: 200 len: 1493 microversion: 2.1 time: 0.323029 Apr 21 10:54:12 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 93/280] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:54:12 2023] GET /compute/v2.1/servers/14bd5401-4cc1-4827-8d4a-fd1358bb9c6b => generated 1493 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:54:12 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-36bbf5cc-20e4-4187-ab46-fb57f74ca030 req-d0557899-0524-4086-8f07-28042605c882 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14bd5401-4cc1-4827-8d4a-fd1358bb9c6b", "name": "network-vif-unplugged", "status": "completed", "tag": "d8b0279f-95ca-4143-8f78-c6faf74a3620"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:54:12 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-36bbf5cc-20e4-4187-ab46-fb57f74ca030 req-d0557899-0524-4086-8f07-28042605c882 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:54:12 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-36bbf5cc-20e4-4187-ab46-fb57f74ca030 req-d0557899-0524-4086-8f07-28042605c882 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:54:12 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-36bbf5cc-20e4-4187-ab46-fb57f74ca030 req-d0557899-0524-4086-8f07-28042605c882 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:54:12 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-36bbf5cc-20e4-4187-ab46-fb57f74ca030 req-d0557899-0524-4086-8f07-28042605c882 service nova] Creating event network-vif-unplugged:d8b0279f-95ca-4143-8f78-c6faf74a3620 for instance 14bd5401-4cc1-4827-8d4a-fd1358bb9c6b on user Apr 21 10:54:12 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-36bbf5cc-20e4-4187-ab46-fb57f74ca030 req-d0557899-0524-4086-8f07-28042605c882 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.221162 Apr 21 10:54:12 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 94/281] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:54:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:54:13 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [req-baa6b527-bdde-4ba4-83b7-1a4dc673730d req-96cf1493-3961-4bf6-a31f-ebd96f8494f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14bd5401-4cc1-4827-8d4a-fd1358bb9c6b", "name": "network-vif-deleted", "tag": "d8b0279f-95ca-4143-8f78-c6faf74a3620"}]} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:54:13 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-baa6b527-bdde-4ba4-83b7-1a4dc673730d req-96cf1493-3961-4bf6-a31f-ebd96f8494f1 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:54:13 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-baa6b527-bdde-4ba4-83b7-1a4dc673730d req-96cf1493-3961-4bf6-a31f-ebd96f8494f1 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:54:13 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-baa6b527-bdde-4ba4-83b7-1a4dc673730d req-96cf1493-3961-4bf6-a31f-ebd96f8494f1 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:54:13 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-baa6b527-bdde-4ba4-83b7-1a4dc673730d req-96cf1493-3961-4bf6-a31f-ebd96f8494f1 service nova] Creating event network-vif-deleted:d8b0279f-95ca-4143-8f78-c6faf74a3620 for instance 14bd5401-4cc1-4827-8d4a-fd1358bb9c6b on user Apr 21 10:54:13 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [req-baa6b527-bdde-4ba4-83b7-1a4dc673730d req-96cf1493-3961-4bf6-a31f-ebd96f8494f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029188 Apr 21 10:54:13 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 95/282] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:54:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:54:14 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [req-1132c827-14a9-45f4-8162-bf337b66e876 req-13b7922f-af94-4d74-a256-855ffab08af8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14bd5401-4cc1-4827-8d4a-fd1358bb9c6b", "name": "network-vif-plugged", "status": "completed", "tag": "d8b0279f-95ca-4143-8f78-c6faf74a3620"}]} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:54:14 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-1132c827-14a9-45f4-8162-bf337b66e876 req-13b7922f-af94-4d74-a256-855ffab08af8 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:54:14 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-1132c827-14a9-45f4-8162-bf337b66e876 req-13b7922f-af94-4d74-a256-855ffab08af8 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:54:14 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-1132c827-14a9-45f4-8162-bf337b66e876 req-13b7922f-af94-4d74-a256-855ffab08af8 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:54:14 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-1132c827-14a9-45f4-8162-bf337b66e876 req-13b7922f-af94-4d74-a256-855ffab08af8 service nova] Creating event network-vif-plugged:d8b0279f-95ca-4143-8f78-c6faf74a3620 for instance 14bd5401-4cc1-4827-8d4a-fd1358bb9c6b on user Apr 21 10:54:14 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [req-1132c827-14a9-45f4-8162-bf337b66e876 req-13b7922f-af94-4d74-a256-855ffab08af8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030043 Apr 21 10:54:14 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 94/283] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:54:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:54:41 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_api:SELECT=18 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:54:41 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell1:SELECT=20 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:54:41 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-edf77720-f77e-4d1d-8e3b-6dbe09382800 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:54:41 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-edf77720-f77e-4d1d-8e3b-6dbe09382800 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] [instance: a5418b3c-8587-4544-b562-fe01a69be3fc] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:54:41 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-edf77720-f77e-4d1d-8e3b-6dbe09382800 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:54:41 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-edf77720-f77e-4d1d-8e3b-6dbe09382800 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:54:41 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-edf77720-f77e-4d1d-8e3b-6dbe09382800 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:54:41 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-edf77720-f77e-4d1d-8e3b-6dbe09382800 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:54:41 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-edf77720-f77e-4d1d-8e3b-6dbe09382800 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:54:41 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-edf77720-f77e-4d1d-8e3b-6dbe09382800 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:54:41 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-edf77720-f77e-4d1d-8e3b-6dbe09382800 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:54:41 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-edf77720-f77e-4d1d-8e3b-6dbe09382800 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:54:41 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-edf77720-f77e-4d1d-8e3b-6dbe09382800 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:54:41 user devstack@n-api.service[61319]: DEBUG nova.objects.instance [None req-edf77720-f77e-4d1d-8e3b-6dbe09382800 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lazy-loading 'fault' on Instance uuid a5418b3c-8587-4544-b562-fe01a69be3fc {{(pid=61319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 21 10:54:41 user devstack@n-api.service[61319]: DEBUG nova.policy [None req-edf77720-f77e-4d1d-8e3b-6dbe09382800 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c67d90b6014d9ea24ef2552006bc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad84a0e014f47ddaeaddc88bf16b0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61319) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:54:41 user devstack@n-api.service[61319]: DEBUG nova.policy [None req-edf77720-f77e-4d1d-8e3b-6dbe09382800 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c67d90b6014d9ea24ef2552006bc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad84a0e014f47ddaeaddc88bf16b0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61319) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:54:41 user devstack@n-api.service[61319]: DEBUG nova.policy [None req-edf77720-f77e-4d1d-8e3b-6dbe09382800 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c67d90b6014d9ea24ef2552006bc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad84a0e014f47ddaeaddc88bf16b0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61319) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:54:41 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-edf77720-f77e-4d1d-8e3b-6dbe09382800 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a5418b3c-8587-4544-b562-fe01a69be3fc" status: 200 len: 1650 microversion: 2.87 time: 0.125636 Apr 21 10:54:41 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 95/284] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 10:54:41 2023] GET /compute/v2.1/servers/a5418b3c-8587-4544-b562-fe01a69be3fc => generated 1650 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 10:54:41 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:54:41 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:54:41 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-1836ff98-0e19-444f-ab11-180698d70df7 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:54:41 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-1836ff98-0e19-444f-ab11-180698d70df7 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] [instance: a5418b3c-8587-4544-b562-fe01a69be3fc] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:54:41 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-1836ff98-0e19-444f-ab11-180698d70df7 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:54:41 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-1836ff98-0e19-444f-ab11-180698d70df7 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:54:41 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-1836ff98-0e19-444f-ab11-180698d70df7 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:54:41 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-1836ff98-0e19-444f-ab11-180698d70df7 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:54:41 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-1836ff98-0e19-444f-ab11-180698d70df7 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:54:41 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-1836ff98-0e19-444f-ab11-180698d70df7 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:54:41 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-1836ff98-0e19-444f-ab11-180698d70df7 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] [instance: a5418b3c-8587-4544-b562-fe01a69be3fc] Going to try to terminate instance {{(pid=61320) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 10:54:41 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-1836ff98-0e19-444f-ab11-180698d70df7 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] [instance: a5418b3c-8587-4544-b562-fe01a69be3fc] Doing local delete in cell bb5ee891-ceca-455b-842d-847784699b19(cell1) {{(pid=61320) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 21 10:54:41 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-1836ff98-0e19-444f-ab11-180698d70df7 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:54:41 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-1836ff98-0e19-444f-ab11-180698d70df7 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:54:41 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-1836ff98-0e19-444f-ab11-180698d70df7 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:54:41 user devstack@n-api.service[61320]: WARNING nova.compute.api [None req-1836ff98-0e19-444f-ab11-180698d70df7 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] [instance: a5418b3c-8587-4544-b562-fe01a69be3fc] instance's host None is down, deleting from database Apr 21 10:54:41 user devstack@n-api.service[61320]: DEBUG nova.network.neutron [None req-1836ff98-0e19-444f-ab11-180698d70df7 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] [instance: a5418b3c-8587-4544-b562-fe01a69be3fc] deallocate_for_instance() {{(pid=61320) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 21 10:54:41 user devstack@n-api.service[61320]: DEBUG nova.network.neutron [None req-1836ff98-0e19-444f-ab11-180698d70df7 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] [instance: a5418b3c-8587-4544-b562-fe01a69be3fc] Instance cache missing network info. {{(pid=61320) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 21 10:54:41 user devstack@n-api.service[61320]: DEBUG nova.network.neutron [None req-1836ff98-0e19-444f-ab11-180698d70df7 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] [instance: a5418b3c-8587-4544-b562-fe01a69be3fc] Updating instance_info_cache with network_info: [] {{(pid=61320) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 21 10:54:41 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-1836ff98-0e19-444f-ab11-180698d70df7 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] [instance: a5418b3c-8587-4544-b562-fe01a69be3fc] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61320) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 21 10:54:41 user devstack@n-api.service[61320]: WARNING nova.compute.api [None req-1836ff98-0e19-444f-ab11-180698d70df7 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] [instance: a5418b3c-8587-4544-b562-fe01a69be3fc] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 21 10:54:42 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-1836ff98-0e19-444f-ab11-180698d70df7 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a5418b3c-8587-4544-b562-fe01a69be3fc" status: 204 len: 0 microversion: 2.87 time: 0.514760 Apr 21 10:54:42 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 96/285] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 21 10:54:41 2023] DELETE /compute/v2.1/servers/a5418b3c-8587-4544-b562-fe01a69be3fc => generated 0 bytes in 517 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 21 10:54:42 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-d8446dda-a37a-4bf3-9bc1-2b3bebaa4cbf tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:54:42 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-d8446dda-a37a-4bf3-9bc1-2b3bebaa4cbf tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] [instance: a5418b3c-8587-4544-b562-fe01a69be3fc] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:54:42 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:54:42 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell1:SELECT=18 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:54:42 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-d8446dda-a37a-4bf3-9bc1-2b3bebaa4cbf tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:54:42 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-d8446dda-a37a-4bf3-9bc1-2b3bebaa4cbf tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:54:42 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-d8446dda-a37a-4bf3-9bc1-2b3bebaa4cbf tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:54:42 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-d8446dda-a37a-4bf3-9bc1-2b3bebaa4cbf tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:54:42 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-d8446dda-a37a-4bf3-9bc1-2b3bebaa4cbf tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:54:42 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-d8446dda-a37a-4bf3-9bc1-2b3bebaa4cbf tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:54:42 user devstack@n-api.service[61318]: INFO nova.api.openstack.wsgi [None req-d8446dda-a37a-4bf3-9bc1-2b3bebaa4cbf tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] HTTP exception thrown: Instance a5418b3c-8587-4544-b562-fe01a69be3fc could not be found. Apr 21 10:54:42 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-d8446dda-a37a-4bf3-9bc1-2b3bebaa4cbf tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Request method failure captured: Apr 21 10:54:42 user devstack@n-api.service[61318]: request: GET /compute/v2.1/servers/a5418b3c-8587-4544-b562-fe01a69be3fc HTTP/1.1 Apr 21 10:54:42 user devstack@n-api.service[61318]: Accept: application/json Apr 21 10:54:42 user devstack@n-api.service[61318]: Accept-Encoding: identity Apr 21 10:54:42 user devstack@n-api.service[61318]: Connection: close Apr 21 10:54:42 user devstack@n-api.service[61318]: Content-Length: 0 Apr 21 10:54:42 user devstack@n-api.service[61318]: Content-Type: application/json Apr 21 10:54:42 user devstack@n-api.service[61318]: Host: 10.0.0.210 Apr 21 10:54:42 user devstack@n-api.service[61318]: Openstack-System-Scope: None Apr 21 10:54:42 user devstack@n-api.service[61318]: User-Agent: python-urllib3/1.26.15 Apr 21 10:54:42 user devstack@n-api.service[61318]: X-Auth-Token: gAAAAABkQmmi2qmN21XP1-DJ0fIuUyfzkDVvfbWGO-MUZXWhTOEnVzXhVFl8LUHS-yHejsXQJQDrMBGmIiXmN8jjX0f1kKLnGT_CoDsaSA6EPHkQhVh674tVagYFSv7PUgkhweI8_tY6juuaFpZwf7yRfTk8k_mK9rn7HdRsjMrpquoVzV7Q8q4 Apr 21 10:54:42 user devstack@n-api.service[61318]: X-Domain-Id: None Apr 21 10:54:42 user devstack@n-api.service[61318]: X-Domain-Name: None Apr 21 10:54:42 user devstack@n-api.service[61318]: X-Identity-Status: Confirmed Apr 21 10:54:42 user devstack@n-api.service[61318]: X-Is-Admin-Project: True Apr 21 10:54:42 user devstack@n-api.service[61318]: X-Openstack-Nova-Api-Version: 2.87 Apr 21 10:54:42 user devstack@n-api.service[61318]: X-Project-Domain-Id: default Apr 21 10:54:42 user devstack@n-api.service[61318]: X-Project-Domain-Name: Default Apr 21 10:54:42 user devstack@n-api.service[61318]: X-Project-Id: aad84a0e014f47ddaeaddc88bf16b0a8 Apr 21 10:54:42 user devstack@n-api.service[61318]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1980957418 Apr 21 10:54:42 user devstack@n-api.service[61318]: X-Role: reader,member Apr 21 10:54:42 user devstack@n-api.service[61318]: X-Roles: reader,member Apr 21 10:54:42 user devstack@n-api.service[61318]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/aad84a0e014f47ddaeaddc88bf16b0a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/aad84a0e014f47ddaeaddc88bf16b0a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/aad84a0e014f47ddaeaddc88bf16b0a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 10:54:42 user devstack@n-api.service[61318]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1980957418 Apr 21 10:54:42 user devstack@n-api.service[61318]: X-Tenant-Id: aad84a0e014f47ddaeaddc88bf16b0a8 Apr 21 10:54:42 user devstack@n-api.service[61318]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1980957418 Apr 21 10:54:42 user devstack@n-api.service[61318]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member Apr 21 10:54:42 user devstack@n-api.service[61318]: X-User-Domain-Id: default Apr 21 10:54:42 user devstack@n-api.service[61318]: X-User-Domain-Name: Default Apr 21 10:54:42 user devstack@n-api.service[61318]: X-User-Id: 54c67d90b6014d9ea24ef2552006bc04 Apr 21 10:54:42 user devstack@n-api.service[61318]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member Apr 21 10:54:42 user devstack@n-api.service[61318]: method: > Apr 21 10:54:42 user devstack@n-api.service[61318]: exception: Instance a5418b3c-8587-4544-b562-fe01a69be3fc could not be found. Apr 21 10:54:42 user devstack@n-api.service[61318]: action_args: {'id': 'a5418b3c-8587-4544-b562-fe01a69be3fc'} Apr 21 10:54:42 user devstack@n-api.service[61318]: {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 10:54:42 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:54:42 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 10:54:42 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 10:54:42 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 10:54:42 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 10:54:42 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 10:54:42 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 10:54:42 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 10:54:42 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 10:54:42 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5418b3c-8587-4544-b562-fe01a69be3fc could not be found. Apr 21 10:54:42 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:54:42 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:54:42 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:54:42 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:54:42 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 10:54:42 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 10:54:42 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 10:54:42 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 10:54:42 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 10:54:42 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 10:54:42 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 10:54:42 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 10:54:42 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 10:54:42 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 10:54:42 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 10:54:42 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 10:54:42 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5418b3c-8587-4544-b562-fe01a69be3fc could not be found. Apr 21 10:54:42 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:54:42 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:54:42 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:54:42 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:54:42 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 10:54:42 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 10:54:42 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 10:54:42 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 10:54:42 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5418b3c-8587-4544-b562-fe01a69be3fc could not be found. Apr 21 10:54:42 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:54:42 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-d8446dda-a37a-4bf3-9bc1-2b3bebaa4cbf tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Returning 404 to user: Instance a5418b3c-8587-4544-b562-fe01a69be3fc could not be found. {{(pid=61318) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 10:54:42 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-d8446dda-a37a-4bf3-9bc1-2b3bebaa4cbf tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a5418b3c-8587-4544-b562-fe01a69be3fc" status: 404 len: 111 microversion: 2.87 time: 0.036587 Apr 21 10:54:42 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 95/286] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 10:54:42 2023] GET /compute/v2.1/servers/a5418b3c-8587-4544-b562-fe01a69be3fc => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 21 10:54:42 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-39c0a007-3e3c-47c0-8aa1-03dd709572b6 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:54:42 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-39c0a007-3e3c-47c0-8aa1-03dd709572b6 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] [instance: f4dda568-8f3b-40eb-aff3-64d3e759c310] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:54:42 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-39c0a007-3e3c-47c0-8aa1-03dd709572b6 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:54:42 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-39c0a007-3e3c-47c0-8aa1-03dd709572b6 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:54:42 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-39c0a007-3e3c-47c0-8aa1-03dd709572b6 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:54:42 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-39c0a007-3e3c-47c0-8aa1-03dd709572b6 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:54:42 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-39c0a007-3e3c-47c0-8aa1-03dd709572b6 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:54:42 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-39c0a007-3e3c-47c0-8aa1-03dd709572b6 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:54:42 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-39c0a007-3e3c-47c0-8aa1-03dd709572b6 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] [instance: f4dda568-8f3b-40eb-aff3-64d3e759c310] Going to try to terminate instance {{(pid=61319) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 10:54:42 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-39c0a007-3e3c-47c0-8aa1-03dd709572b6 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f4dda568-8f3b-40eb-aff3-64d3e759c310" status: 204 len: 0 microversion: 2.87 time: 0.104240 Apr 21 10:54:42 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 96/287] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 21 10:54:42 2023] DELETE /compute/v2.1/servers/f4dda568-8f3b-40eb-aff3-64d3e759c310 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 21 10:54:42 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-da1d79a3-aac9-440a-9cee-efadc721489a tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:54:42 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-da1d79a3-aac9-440a-9cee-efadc721489a tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] [instance: f4dda568-8f3b-40eb-aff3-64d3e759c310] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:54:42 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-da1d79a3-aac9-440a-9cee-efadc721489a tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:54:42 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-da1d79a3-aac9-440a-9cee-efadc721489a tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:54:42 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-da1d79a3-aac9-440a-9cee-efadc721489a tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:54:42 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-da1d79a3-aac9-440a-9cee-efadc721489a tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:54:42 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-da1d79a3-aac9-440a-9cee-efadc721489a tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:54:42 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-da1d79a3-aac9-440a-9cee-efadc721489a tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:54:42 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [req-974f87fd-df78-4a52-877a-0cc9ce523925 req-b760edb7-6b6f-4353-8127-398045ed324f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4dda568-8f3b-40eb-aff3-64d3e759c310", "name": "network-vif-unplugged", "status": "completed", "tag": "0e9676a1-1652-48fd-affd-355632de3ca2"}]} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:54:42 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-974f87fd-df78-4a52-877a-0cc9ce523925 req-b760edb7-6b6f-4353-8127-398045ed324f service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:54:42 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-974f87fd-df78-4a52-877a-0cc9ce523925 req-b760edb7-6b6f-4353-8127-398045ed324f service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:54:42 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-974f87fd-df78-4a52-877a-0cc9ce523925 req-b760edb7-6b6f-4353-8127-398045ed324f service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:54:42 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-974f87fd-df78-4a52-877a-0cc9ce523925 req-b760edb7-6b6f-4353-8127-398045ed324f service nova] Creating event network-vif-unplugged:0e9676a1-1652-48fd-affd-355632de3ca2 for instance f4dda568-8f3b-40eb-aff3-64d3e759c310 on user Apr 21 10:54:42 user devstack@n-api.service[61320]: DEBUG nova.policy [None req-da1d79a3-aac9-440a-9cee-efadc721489a tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c67d90b6014d9ea24ef2552006bc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad84a0e014f47ddaeaddc88bf16b0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61320) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:54:42 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [req-974f87fd-df78-4a52-877a-0cc9ce523925 req-b760edb7-6b6f-4353-8127-398045ed324f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036397 Apr 21 10:54:42 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 96/288] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:54:42 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 10:54:42 user devstack@n-api.service[61320]: DEBUG nova.policy [None req-da1d79a3-aac9-440a-9cee-efadc721489a tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c67d90b6014d9ea24ef2552006bc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad84a0e014f47ddaeaddc88bf16b0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61320) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:54:42 user devstack@n-api.service[61320]: DEBUG nova.policy [None req-da1d79a3-aac9-440a-9cee-efadc721489a tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c67d90b6014d9ea24ef2552006bc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad84a0e014f47ddaeaddc88bf16b0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61320) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:54:42 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-da1d79a3-aac9-440a-9cee-efadc721489a tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f4dda568-8f3b-40eb-aff3-64d3e759c310" status: 200 len: 1698 microversion: 2.87 time: 0.276808 Apr 21 10:54:42 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 97/289] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 10:54:42 2023] GET /compute/v2.1/servers/f4dda568-8f3b-40eb-aff3-64d3e759c310 => generated 1698 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 10:54:43 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-7359489b-bf66-45c6-b0b8-f3a774751afa req-d98896af-bc39-4e27-b942-8485d78a5db2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4dda568-8f3b-40eb-aff3-64d3e759c310", "name": "network-vif-deleted", "tag": "0e9676a1-1652-48fd-affd-355632de3ca2"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:54:43 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-7359489b-bf66-45c6-b0b8-f3a774751afa req-d98896af-bc39-4e27-b942-8485d78a5db2 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:54:43 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-7359489b-bf66-45c6-b0b8-f3a774751afa req-d98896af-bc39-4e27-b942-8485d78a5db2 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:54:43 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-7359489b-bf66-45c6-b0b8-f3a774751afa req-d98896af-bc39-4e27-b942-8485d78a5db2 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:54:43 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-7359489b-bf66-45c6-b0b8-f3a774751afa req-d98896af-bc39-4e27-b942-8485d78a5db2 service nova] Creating event network-vif-deleted:0e9676a1-1652-48fd-affd-355632de3ca2 for instance f4dda568-8f3b-40eb-aff3-64d3e759c310 on user Apr 21 10:54:43 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-7359489b-bf66-45c6-b0b8-f3a774751afa req-d98896af-bc39-4e27-b942-8485d78a5db2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029287 Apr 21 10:54:43 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 97/290] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:54:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:54:44 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [req-445e6ce2-f64f-475a-8d68-667a35e91f63 req-2aa69d1f-b7b0-4544-afcf-1aae4af0034d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4dda568-8f3b-40eb-aff3-64d3e759c310", "name": "network-vif-plugged", "status": "completed", "tag": "0e9676a1-1652-48fd-affd-355632de3ca2"}]} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:54:44 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-445e6ce2-f64f-475a-8d68-667a35e91f63 req-2aa69d1f-b7b0-4544-afcf-1aae4af0034d service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:54:44 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-445e6ce2-f64f-475a-8d68-667a35e91f63 req-2aa69d1f-b7b0-4544-afcf-1aae4af0034d service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:54:44 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-445e6ce2-f64f-475a-8d68-667a35e91f63 req-2aa69d1f-b7b0-4544-afcf-1aae4af0034d service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:54:45 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-445e6ce2-f64f-475a-8d68-667a35e91f63 req-2aa69d1f-b7b0-4544-afcf-1aae4af0034d service nova] Creating event network-vif-plugged:0e9676a1-1652-48fd-affd-355632de3ca2 for instance f4dda568-8f3b-40eb-aff3-64d3e759c310 on user Apr 21 10:54:45 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [req-445e6ce2-f64f-475a-8d68-667a35e91f63 req-2aa69d1f-b7b0-4544-afcf-1aae4af0034d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035950 Apr 21 10:54:45 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 97/291] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:54:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:54:45 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-441f7cac-1e18-4909-afa9-f65933dce6df tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:54:45 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-441f7cac-1e18-4909-afa9-f65933dce6df tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] [instance: f3e0bc01-1cf2-4ff9-bec6-12a37e44171c] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:54:45 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-441f7cac-1e18-4909-afa9-f65933dce6df tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:54:45 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-441f7cac-1e18-4909-afa9-f65933dce6df tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:54:45 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-441f7cac-1e18-4909-afa9-f65933dce6df tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:54:45 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-441f7cac-1e18-4909-afa9-f65933dce6df tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:54:45 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-441f7cac-1e18-4909-afa9-f65933dce6df tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:54:45 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-441f7cac-1e18-4909-afa9-f65933dce6df tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:54:45 user devstack@n-api.service[61320]: DEBUG nova.policy [None req-441f7cac-1e18-4909-afa9-f65933dce6df tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cae5a1734d24ac8aebc233dd31d3084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead44a7da0640cbb2cf8dece0ea4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61320) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:54:45 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-441f7cac-1e18-4909-afa9-f65933dce6df tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3e0bc01-1cf2-4ff9-bec6-12a37e44171c" status: 200 len: 1537 microversion: 2.1 time: 0.241973 Apr 21 10:54:45 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 98/292] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:54:45 2023] GET /compute/v2.1/servers/f3e0bc01-1cf2-4ff9-bec6-12a37e44171c => generated 1537 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:54:55 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:54:55 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:54:55 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-4b1be9dc-b114-43db-bde8-bd64a19be987 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:54:55 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-4b1be9dc-b114-43db-bde8-bd64a19be987 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] [instance: d28e1e38-3ed5-468e-b672-8b94a909820c] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:54:55 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-4b1be9dc-b114-43db-bde8-bd64a19be987 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:54:55 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-4b1be9dc-b114-43db-bde8-bd64a19be987 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:54:55 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-4b1be9dc-b114-43db-bde8-bd64a19be987 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:54:55 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-4b1be9dc-b114-43db-bde8-bd64a19be987 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:54:55 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-4b1be9dc-b114-43db-bde8-bd64a19be987 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:54:55 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-4b1be9dc-b114-43db-bde8-bd64a19be987 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:54:55 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-4b1be9dc-b114-43db-bde8-bd64a19be987 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d28e1e38-3ed5-468e-b672-8b94a909820c/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.192549 Apr 21 10:54:55 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 98/293] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 21 10:54:55 2023] GET /compute/v2.1/servers/d28e1e38-3ed5-468e-b672-8b94a909820c/os-interface => generated 282 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:54:56 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [req-23a23dc0-bd3a-419e-a9da-1737ecfe7ede req-7118d547-e561-428e-9d26-46153da13aff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d28e1e38-3ed5-468e-b672-8b94a909820c", "tag": "92fab70c-ebc3-4119-8fa9-874304b51cb5"}]} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:54:56 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_api:SELECT=6 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:54:56 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell1:SELECT=6 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:54:56 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-23a23dc0-bd3a-419e-a9da-1737ecfe7ede req-7118d547-e561-428e-9d26-46153da13aff service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:54:56 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-23a23dc0-bd3a-419e-a9da-1737ecfe7ede req-7118d547-e561-428e-9d26-46153da13aff service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:54:56 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-23a23dc0-bd3a-419e-a9da-1737ecfe7ede req-7118d547-e561-428e-9d26-46153da13aff service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:54:56 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-23a23dc0-bd3a-419e-a9da-1737ecfe7ede req-7118d547-e561-428e-9d26-46153da13aff service nova] Creating event network-changed:92fab70c-ebc3-4119-8fa9-874304b51cb5 for instance d28e1e38-3ed5-468e-b672-8b94a909820c on user Apr 21 10:54:56 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [req-23a23dc0-bd3a-419e-a9da-1737ecfe7ede req-7118d547-e561-428e-9d26-46153da13aff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038434 Apr 21 10:54:56 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 98/294] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:54:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:54:56 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-76f41a62-b014-46d0-b716-03c63202d0c8 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:54:56 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-76f41a62-b014-46d0-b716-03c63202d0c8 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] [instance: d28e1e38-3ed5-468e-b672-8b94a909820c] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:54:56 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:54:56 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:54:56 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-76f41a62-b014-46d0-b716-03c63202d0c8 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:54:56 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-76f41a62-b014-46d0-b716-03c63202d0c8 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:54:56 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-76f41a62-b014-46d0-b716-03c63202d0c8 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:54:56 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-76f41a62-b014-46d0-b716-03c63202d0c8 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:54:56 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-76f41a62-b014-46d0-b716-03c63202d0c8 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:54:56 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-76f41a62-b014-46d0-b716-03c63202d0c8 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:54:56 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-76f41a62-b014-46d0-b716-03c63202d0c8 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d28e1e38-3ed5-468e-b672-8b94a909820c/ips" status: 200 len: 107 microversion: 2.1 time: 0.049341 Apr 21 10:54:56 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 99/295] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 21 10:54:56 2023] GET /compute/v2.1/servers/d28e1e38-3ed5-468e-b672-8b94a909820c/ips => generated 107 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:54:58 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-0d042f03-6a2a-419c-b3ab-fdb1f27c6755 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:54:58 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-0d042f03-6a2a-419c-b3ab-fdb1f27c6755 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] [instance: d28e1e38-3ed5-468e-b672-8b94a909820c] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:54:58 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-0d042f03-6a2a-419c-b3ab-fdb1f27c6755 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:54:58 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-0d042f03-6a2a-419c-b3ab-fdb1f27c6755 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:54:58 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-0d042f03-6a2a-419c-b3ab-fdb1f27c6755 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:54:58 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-0d042f03-6a2a-419c-b3ab-fdb1f27c6755 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:54:58 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-0d042f03-6a2a-419c-b3ab-fdb1f27c6755 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:54:58 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-0d042f03-6a2a-419c-b3ab-fdb1f27c6755 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:54:58 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-0d042f03-6a2a-419c-b3ab-fdb1f27c6755 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] [instance: d28e1e38-3ed5-468e-b672-8b94a909820c] Going to try to terminate instance {{(pid=61319) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 10:54:58 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-0d042f03-6a2a-419c-b3ab-fdb1f27c6755 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d28e1e38-3ed5-468e-b672-8b94a909820c" status: 204 len: 0 microversion: 2.1 time: 0.113683 Apr 21 10:54:58 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 99/296] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 10:54:58 2023] DELETE /compute/v2.1/servers/d28e1e38-3ed5-468e-b672-8b94a909820c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 10:54:58 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-ab0bd852-c77b-49a1-b6d5-bddec91ddb5c tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:54:58 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-ab0bd852-c77b-49a1-b6d5-bddec91ddb5c tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] [instance: d28e1e38-3ed5-468e-b672-8b94a909820c] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:54:58 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-ab0bd852-c77b-49a1-b6d5-bddec91ddb5c tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:54:58 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-ab0bd852-c77b-49a1-b6d5-bddec91ddb5c tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:54:58 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-ab0bd852-c77b-49a1-b6d5-bddec91ddb5c tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:54:58 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-ab0bd852-c77b-49a1-b6d5-bddec91ddb5c tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:54:58 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-ab0bd852-c77b-49a1-b6d5-bddec91ddb5c tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:54:58 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-ab0bd852-c77b-49a1-b6d5-bddec91ddb5c tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:54:58 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [req-1349ba17-ca8a-4df8-a17b-bccf3fbb354e req-caa4310a-41d1-4ce3-b532-d1d1c478f5bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d28e1e38-3ed5-468e-b672-8b94a909820c", "name": "network-vif-unplugged", "status": "completed", "tag": "92fab70c-ebc3-4119-8fa9-874304b51cb5"}]} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:54:58 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-1349ba17-ca8a-4df8-a17b-bccf3fbb354e req-caa4310a-41d1-4ce3-b532-d1d1c478f5bd service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:54:58 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-1349ba17-ca8a-4df8-a17b-bccf3fbb354e req-caa4310a-41d1-4ce3-b532-d1d1c478f5bd service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:54:58 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-1349ba17-ca8a-4df8-a17b-bccf3fbb354e req-caa4310a-41d1-4ce3-b532-d1d1c478f5bd service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:54:58 user devstack@n-api.service[61318]: DEBUG nova.policy [None req-ab0bd852-c77b-49a1-b6d5-bddec91ddb5c tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fc66871488428e9842404d885bcfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bc6b0c20204c8287b3523814007856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61318) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:54:58 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-ab0bd852-c77b-49a1-b6d5-bddec91ddb5c tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d28e1e38-3ed5-468e-b672-8b94a909820c" status: 200 len: 1668 microversion: 2.1 time: 0.265548 Apr 21 10:54:58 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 99/297] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:54:58 2023] GET /compute/v2.1/servers/d28e1e38-3ed5-468e-b672-8b94a909820c => generated 1668 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:54:58 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-1349ba17-ca8a-4df8-a17b-bccf3fbb354e req-caa4310a-41d1-4ce3-b532-d1d1c478f5bd service nova] Creating event network-vif-unplugged:92fab70c-ebc3-4119-8fa9-874304b51cb5 for instance d28e1e38-3ed5-468e-b672-8b94a909820c on user Apr 21 10:54:58 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [req-1349ba17-ca8a-4df8-a17b-bccf3fbb354e req-caa4310a-41d1-4ce3-b532-d1d1c478f5bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034270 Apr 21 10:54:58 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 100/298] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:54:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:55:00 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-3af9d7b5-2406-4a31-a516-e30e666ca5dc req-ecbadd18-812d-4623-8ed6-30d514e31c8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d28e1e38-3ed5-468e-b672-8b94a909820c", "name": "network-vif-plugged", "status": "completed", "tag": "92fab70c-ebc3-4119-8fa9-874304b51cb5"}, {"server_uuid": "d28e1e38-3ed5-468e-b672-8b94a909820c", "name": "network-vif-deleted", "tag": "92fab70c-ebc3-4119-8fa9-874304b51cb5"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:55:00 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-3af9d7b5-2406-4a31-a516-e30e666ca5dc req-ecbadd18-812d-4623-8ed6-30d514e31c8d service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:55:00 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-3af9d7b5-2406-4a31-a516-e30e666ca5dc req-ecbadd18-812d-4623-8ed6-30d514e31c8d service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:55:00 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-3af9d7b5-2406-4a31-a516-e30e666ca5dc req-ecbadd18-812d-4623-8ed6-30d514e31c8d service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:55:00 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-3af9d7b5-2406-4a31-a516-e30e666ca5dc req-ecbadd18-812d-4623-8ed6-30d514e31c8d service nova] Creating event network-vif-plugged:92fab70c-ebc3-4119-8fa9-874304b51cb5 for instance d28e1e38-3ed5-468e-b672-8b94a909820c on user Apr 21 10:55:00 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-3af9d7b5-2406-4a31-a516-e30e666ca5dc req-ecbadd18-812d-4623-8ed6-30d514e31c8d service nova] Creating event network-vif-deleted:92fab70c-ebc3-4119-8fa9-874304b51cb5 for instance d28e1e38-3ed5-468e-b672-8b94a909820c on user Apr 21 10:55:00 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-3af9d7b5-2406-4a31-a516-e30e666ca5dc req-ecbadd18-812d-4623-8ed6-30d514e31c8d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029589 Apr 21 10:55:00 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 100/299] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:55:00 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:55:02 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-1d82fdee-242c-4b67-a5ea-7e22ad296744 tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:55:02 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-1d82fdee-242c-4b67-a5ea-7e22ad296744 tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] [instance: 14bd5401-4cc1-4827-8d4a-fd1358bb9c6b] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:55:02 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-1d82fdee-242c-4b67-a5ea-7e22ad296744 tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:55:02 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-1d82fdee-242c-4b67-a5ea-7e22ad296744 tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:55:02 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-1d82fdee-242c-4b67-a5ea-7e22ad296744 tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:55:02 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-1d82fdee-242c-4b67-a5ea-7e22ad296744 tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:55:02 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-1d82fdee-242c-4b67-a5ea-7e22ad296744 tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:55:02 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-1d82fdee-242c-4b67-a5ea-7e22ad296744 tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:55:02 user devstack@n-api.service[61318]: INFO nova.api.openstack.wsgi [None req-1d82fdee-242c-4b67-a5ea-7e22ad296744 tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] HTTP exception thrown: Instance 14bd5401-4cc1-4827-8d4a-fd1358bb9c6b could not be found. Apr 21 10:55:02 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-1d82fdee-242c-4b67-a5ea-7e22ad296744 tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Request method failure captured: Apr 21 10:55:02 user devstack@n-api.service[61318]: request: GET /compute/v2.1/servers/14bd5401-4cc1-4827-8d4a-fd1358bb9c6b HTTP/1.1 Apr 21 10:55:02 user devstack@n-api.service[61318]: Accept: application/json Apr 21 10:55:02 user devstack@n-api.service[61318]: Accept-Encoding: identity Apr 21 10:55:02 user devstack@n-api.service[61318]: Connection: close Apr 21 10:55:02 user devstack@n-api.service[61318]: Content-Length: 0 Apr 21 10:55:02 user devstack@n-api.service[61318]: Content-Type: application/json Apr 21 10:55:02 user devstack@n-api.service[61318]: Host: 10.0.0.210 Apr 21 10:55:02 user devstack@n-api.service[61318]: Openstack-System-Scope: None Apr 21 10:55:02 user devstack@n-api.service[61318]: User-Agent: python-urllib3/1.26.15 Apr 21 10:55:02 user devstack@n-api.service[61318]: X-Auth-Token: gAAAAABkQmrh-mP-kUUv8aHICwHiG65i7qb4qMhJ3Hs5AuUqC_xgjXrRa1s4q950SUDAbnU5t7h2UZfZNRk6vCKg9y-1qqXLGRDmvo6s8EyTZTU-svdcSN678GQ7owNaJ-lmOGOlDsi_7IcS6V4HU6KEM8mYvanIRp9L6ylF6ofyOqHODu4Z8hs Apr 21 10:55:02 user devstack@n-api.service[61318]: X-Domain-Id: None Apr 21 10:55:02 user devstack@n-api.service[61318]: X-Domain-Name: None Apr 21 10:55:02 user devstack@n-api.service[61318]: X-Identity-Status: Confirmed Apr 21 10:55:02 user devstack@n-api.service[61318]: X-Is-Admin-Project: True Apr 21 10:55:02 user devstack@n-api.service[61318]: X-Project-Domain-Id: default Apr 21 10:55:02 user devstack@n-api.service[61318]: X-Project-Domain-Name: Default Apr 21 10:55:02 user devstack@n-api.service[61318]: X-Project-Id: 8eaf2efa4ddc4d8fbc5ec14e86d93c53 Apr 21 10:55:02 user devstack@n-api.service[61318]: X-Project-Name: tempest-VolumesActionsTest-301211957 Apr 21 10:55:02 user devstack@n-api.service[61318]: X-Role: reader,member Apr 21 10:55:02 user devstack@n-api.service[61318]: X-Roles: reader,member Apr 21 10:55:02 user devstack@n-api.service[61318]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8eaf2efa4ddc4d8fbc5ec14e86d93c53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8eaf2efa4ddc4d8fbc5ec14e86d93c53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8eaf2efa4ddc4d8fbc5ec14e86d93c53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 10:55:02 user devstack@n-api.service[61318]: X-Tenant: tempest-VolumesActionsTest-301211957 Apr 21 10:55:02 user devstack@n-api.service[61318]: X-Tenant-Id: 8eaf2efa4ddc4d8fbc5ec14e86d93c53 Apr 21 10:55:02 user devstack@n-api.service[61318]: X-Tenant-Name: tempest-VolumesActionsTest-301211957 Apr 21 10:55:02 user devstack@n-api.service[61318]: X-User: tempest-VolumesActionsTest-301211957-project-member Apr 21 10:55:02 user devstack@n-api.service[61318]: X-User-Domain-Id: default Apr 21 10:55:02 user devstack@n-api.service[61318]: X-User-Domain-Name: Default Apr 21 10:55:02 user devstack@n-api.service[61318]: X-User-Id: dc80162b39bc4ff2a71a8ff4d34979c3 Apr 21 10:55:02 user devstack@n-api.service[61318]: X-User-Name: tempest-VolumesActionsTest-301211957-project-member Apr 21 10:55:02 user devstack@n-api.service[61318]: method: > Apr 21 10:55:02 user devstack@n-api.service[61318]: exception: Instance 14bd5401-4cc1-4827-8d4a-fd1358bb9c6b could not be found. Apr 21 10:55:02 user devstack@n-api.service[61318]: action_args: {'id': '14bd5401-4cc1-4827-8d4a-fd1358bb9c6b'} Apr 21 10:55:02 user devstack@n-api.service[61318]: {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 10:55:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:55:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 10:55:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 10:55:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 10:55:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 10:55:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 10:55:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 10:55:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 10:55:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 10:55:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14bd5401-4cc1-4827-8d4a-fd1358bb9c6b could not be found. Apr 21 10:55:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:55:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:55:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:55:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:55:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 10:55:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 10:55:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 10:55:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 10:55:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 10:55:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 10:55:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 10:55:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 10:55:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 10:55:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 10:55:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 10:55:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 10:55:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14bd5401-4cc1-4827-8d4a-fd1358bb9c6b could not be found. Apr 21 10:55:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:55:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:55:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:55:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:55:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 10:55:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 10:55:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 10:55:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 10:55:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14bd5401-4cc1-4827-8d4a-fd1358bb9c6b could not be found. Apr 21 10:55:02 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:55:02 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-1d82fdee-242c-4b67-a5ea-7e22ad296744 tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] Returning 404 to user: Instance 14bd5401-4cc1-4827-8d4a-fd1358bb9c6b could not be found. {{(pid=61318) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 10:55:02 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-1d82fdee-242c-4b67-a5ea-7e22ad296744 tempest-VolumesActionsTest-301211957 tempest-VolumesActionsTest-301211957-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14bd5401-4cc1-4827-8d4a-fd1358bb9c6b" status: 404 len: 111 microversion: 2.1 time: 0.034015 Apr 21 10:55:02 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 100/300] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:55:02 2023] GET /compute/v2.1/servers/14bd5401-4cc1-4827-8d4a-fd1358bb9c6b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 10:55:06 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-589f7a86-50de-48ac-b785-d5547fdae8e5 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:55:06 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-589f7a86-50de-48ac-b785-d5547fdae8e5 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] [instance: f8609da3-c26d-482a-bc03-017baf4bce22] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:55:06 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-589f7a86-50de-48ac-b785-d5547fdae8e5 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:55:06 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-589f7a86-50de-48ac-b785-d5547fdae8e5 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:55:06 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-589f7a86-50de-48ac-b785-d5547fdae8e5 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:55:06 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-589f7a86-50de-48ac-b785-d5547fdae8e5 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:55:06 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-589f7a86-50de-48ac-b785-d5547fdae8e5 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:55:06 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-589f7a86-50de-48ac-b785-d5547fdae8e5 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:55:06 user devstack@n-api.service[61320]: DEBUG nova.policy [None req-589f7a86-50de-48ac-b785-d5547fdae8e5 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced216baa4a64c72946cf3f71eb873dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648163a728fc4b28b85a24e9198d356b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61320) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:55:06 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-589f7a86-50de-48ac-b785-d5547fdae8e5 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8609da3-c26d-482a-bc03-017baf4bce22" status: 200 len: 1656 microversion: 2.1 time: 0.204287 Apr 21 10:55:06 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 101/301] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:55:06 2023] GET /compute/v2.1/servers/f8609da3-c26d-482a-bc03-017baf4bce22 => generated 1656 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:55:33 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:55:33 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:55:33 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-d1439c98-2f4c-4276-b305-3f7256a2e222 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:55:33 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-d1439c98-2f4c-4276-b305-3f7256a2e222 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] [instance: f4dda568-8f3b-40eb-aff3-64d3e759c310] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:55:33 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-d1439c98-2f4c-4276-b305-3f7256a2e222 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:55:33 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-d1439c98-2f4c-4276-b305-3f7256a2e222 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:55:33 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-d1439c98-2f4c-4276-b305-3f7256a2e222 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:55:33 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-d1439c98-2f4c-4276-b305-3f7256a2e222 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:55:33 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-d1439c98-2f4c-4276-b305-3f7256a2e222 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:55:33 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-d1439c98-2f4c-4276-b305-3f7256a2e222 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:55:33 user devstack@n-api.service[61319]: INFO nova.api.openstack.wsgi [None req-d1439c98-2f4c-4276-b305-3f7256a2e222 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] HTTP exception thrown: Instance f4dda568-8f3b-40eb-aff3-64d3e759c310 could not be found. Apr 21 10:55:33 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-d1439c98-2f4c-4276-b305-3f7256a2e222 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Request method failure captured: Apr 21 10:55:33 user devstack@n-api.service[61319]: request: GET /compute/v2.1/servers/f4dda568-8f3b-40eb-aff3-64d3e759c310 HTTP/1.1 Apr 21 10:55:33 user devstack@n-api.service[61319]: Accept: application/json Apr 21 10:55:33 user devstack@n-api.service[61319]: Accept-Encoding: identity Apr 21 10:55:33 user devstack@n-api.service[61319]: Connection: close Apr 21 10:55:33 user devstack@n-api.service[61319]: Content-Length: 0 Apr 21 10:55:33 user devstack@n-api.service[61319]: Content-Type: application/json Apr 21 10:55:33 user devstack@n-api.service[61319]: Host: 10.0.0.210 Apr 21 10:55:33 user devstack@n-api.service[61319]: Openstack-System-Scope: None Apr 21 10:55:33 user devstack@n-api.service[61319]: User-Agent: python-urllib3/1.26.15 Apr 21 10:55:33 user devstack@n-api.service[61319]: X-Auth-Token: gAAAAABkQmmi2qmN21XP1-DJ0fIuUyfzkDVvfbWGO-MUZXWhTOEnVzXhVFl8LUHS-yHejsXQJQDrMBGmIiXmN8jjX0f1kKLnGT_CoDsaSA6EPHkQhVh674tVagYFSv7PUgkhweI8_tY6juuaFpZwf7yRfTk8k_mK9rn7HdRsjMrpquoVzV7Q8q4 Apr 21 10:55:33 user devstack@n-api.service[61319]: X-Domain-Id: None Apr 21 10:55:33 user devstack@n-api.service[61319]: X-Domain-Name: None Apr 21 10:55:33 user devstack@n-api.service[61319]: X-Identity-Status: Confirmed Apr 21 10:55:33 user devstack@n-api.service[61319]: X-Is-Admin-Project: True Apr 21 10:55:33 user devstack@n-api.service[61319]: X-Openstack-Nova-Api-Version: 2.87 Apr 21 10:55:33 user devstack@n-api.service[61319]: X-Project-Domain-Id: default Apr 21 10:55:33 user devstack@n-api.service[61319]: X-Project-Domain-Name: Default Apr 21 10:55:33 user devstack@n-api.service[61319]: X-Project-Id: aad84a0e014f47ddaeaddc88bf16b0a8 Apr 21 10:55:33 user devstack@n-api.service[61319]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1980957418 Apr 21 10:55:33 user devstack@n-api.service[61319]: X-Role: reader,member Apr 21 10:55:33 user devstack@n-api.service[61319]: X-Roles: reader,member Apr 21 10:55:33 user devstack@n-api.service[61319]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/aad84a0e014f47ddaeaddc88bf16b0a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/aad84a0e014f47ddaeaddc88bf16b0a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/aad84a0e014f47ddaeaddc88bf16b0a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 10:55:33 user devstack@n-api.service[61319]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1980957418 Apr 21 10:55:33 user devstack@n-api.service[61319]: X-Tenant-Id: aad84a0e014f47ddaeaddc88bf16b0a8 Apr 21 10:55:33 user devstack@n-api.service[61319]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1980957418 Apr 21 10:55:33 user devstack@n-api.service[61319]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member Apr 21 10:55:33 user devstack@n-api.service[61319]: X-User-Domain-Id: default Apr 21 10:55:33 user devstack@n-api.service[61319]: X-User-Domain-Name: Default Apr 21 10:55:33 user devstack@n-api.service[61319]: X-User-Id: 54c67d90b6014d9ea24ef2552006bc04 Apr 21 10:55:33 user devstack@n-api.service[61319]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member Apr 21 10:55:33 user devstack@n-api.service[61319]: method: > Apr 21 10:55:33 user devstack@n-api.service[61319]: exception: Instance f4dda568-8f3b-40eb-aff3-64d3e759c310 could not be found. Apr 21 10:55:33 user devstack@n-api.service[61319]: action_args: {'id': 'f4dda568-8f3b-40eb-aff3-64d3e759c310'} Apr 21 10:55:33 user devstack@n-api.service[61319]: {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 10:55:33 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:55:33 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 10:55:33 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 10:55:33 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 10:55:33 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 10:55:33 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 10:55:33 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 10:55:33 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 10:55:33 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 10:55:33 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4dda568-8f3b-40eb-aff3-64d3e759c310 could not be found. Apr 21 10:55:33 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:55:33 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:55:33 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:55:33 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:55:33 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 10:55:33 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 10:55:33 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 10:55:33 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 10:55:33 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 10:55:33 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 10:55:33 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 10:55:33 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 10:55:33 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 10:55:33 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 10:55:33 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 10:55:33 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 10:55:33 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4dda568-8f3b-40eb-aff3-64d3e759c310 could not be found. Apr 21 10:55:33 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:55:33 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:55:33 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:55:33 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:55:33 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 10:55:33 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 10:55:33 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 10:55:33 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 10:55:33 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4dda568-8f3b-40eb-aff3-64d3e759c310 could not be found. Apr 21 10:55:33 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:55:33 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-d1439c98-2f4c-4276-b305-3f7256a2e222 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Returning 404 to user: Instance f4dda568-8f3b-40eb-aff3-64d3e759c310 could not be found. {{(pid=61319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 10:55:33 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-d1439c98-2f4c-4276-b305-3f7256a2e222 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f4dda568-8f3b-40eb-aff3-64d3e759c310" status: 404 len: 111 microversion: 2.87 time: 0.039244 Apr 21 10:55:33 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 101/302] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 10:55:33 2023] GET /compute/v2.1/servers/f4dda568-8f3b-40eb-aff3-64d3e759c310 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 21 10:55:33 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-65357e91-8af4-4fbb-ace7-81f46050dea6 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:55:33 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-65357e91-8af4-4fbb-ace7-81f46050dea6 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] [instance: 84b55fc0-e748-4c05-97ad-a6994c0487d2] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:55:33 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_api:SELECT=6 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:55:33 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell1:SELECT=10 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:55:33 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-65357e91-8af4-4fbb-ace7-81f46050dea6 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:55:33 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-65357e91-8af4-4fbb-ace7-81f46050dea6 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:55:33 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-65357e91-8af4-4fbb-ace7-81f46050dea6 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:55:33 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-65357e91-8af4-4fbb-ace7-81f46050dea6 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:55:33 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-65357e91-8af4-4fbb-ace7-81f46050dea6 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:55:33 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-65357e91-8af4-4fbb-ace7-81f46050dea6 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:55:33 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-65357e91-8af4-4fbb-ace7-81f46050dea6 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] [instance: 84b55fc0-e748-4c05-97ad-a6994c0487d2] Going to try to terminate instance {{(pid=61318) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 10:55:33 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-65357e91-8af4-4fbb-ace7-81f46050dea6 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/84b55fc0-e748-4c05-97ad-a6994c0487d2" status: 204 len: 0 microversion: 2.87 time: 0.124487 Apr 21 10:55:33 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 101/303] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 21 10:55:33 2023] DELETE /compute/v2.1/servers/84b55fc0-e748-4c05-97ad-a6994c0487d2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 21 10:55:33 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-fa0bbfba-bc28-475f-9d0e-33a175050f59 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:55:33 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-fa0bbfba-bc28-475f-9d0e-33a175050f59 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] [instance: 84b55fc0-e748-4c05-97ad-a6994c0487d2] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:55:33 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_api:SELECT=6 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:55:33 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell1:SELECT=12 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:55:33 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-fa0bbfba-bc28-475f-9d0e-33a175050f59 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:55:33 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-fa0bbfba-bc28-475f-9d0e-33a175050f59 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:55:33 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-fa0bbfba-bc28-475f-9d0e-33a175050f59 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:55:33 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-fa0bbfba-bc28-475f-9d0e-33a175050f59 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:55:33 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-fa0bbfba-bc28-475f-9d0e-33a175050f59 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:55:33 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-fa0bbfba-bc28-475f-9d0e-33a175050f59 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:55:33 user devstack@n-api.service[61320]: DEBUG nova.policy [None req-fa0bbfba-bc28-475f-9d0e-33a175050f59 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c67d90b6014d9ea24ef2552006bc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad84a0e014f47ddaeaddc88bf16b0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61320) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:55:33 user devstack@n-api.service[61320]: DEBUG nova.policy [None req-fa0bbfba-bc28-475f-9d0e-33a175050f59 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c67d90b6014d9ea24ef2552006bc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad84a0e014f47ddaeaddc88bf16b0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61320) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:55:33 user devstack@n-api.service[61320]: DEBUG nova.policy [None req-fa0bbfba-bc28-475f-9d0e-33a175050f59 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c67d90b6014d9ea24ef2552006bc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad84a0e014f47ddaeaddc88bf16b0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61320) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:55:33 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-aa9a7202-897c-4e98-87e4-2f445f764e40 req-1547c05d-de8f-4881-8bb7-269d1f4b9c99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84b55fc0-e748-4c05-97ad-a6994c0487d2", "name": "network-vif-unplugged", "status": "completed", "tag": "2a49817a-aed1-49bd-96b6-36286ff71e1c"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:55:33 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-fa0bbfba-bc28-475f-9d0e-33a175050f59 tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84b55fc0-e748-4c05-97ad-a6994c0487d2" status: 200 len: 1696 microversion: 2.87 time: 0.320954 Apr 21 10:55:33 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 102/304] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 10:55:33 2023] GET /compute/v2.1/servers/84b55fc0-e748-4c05-97ad-a6994c0487d2 => generated 1696 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 10:55:33 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-aa9a7202-897c-4e98-87e4-2f445f764e40 req-1547c05d-de8f-4881-8bb7-269d1f4b9c99 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:55:33 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-aa9a7202-897c-4e98-87e4-2f445f764e40 req-1547c05d-de8f-4881-8bb7-269d1f4b9c99 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:55:33 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-aa9a7202-897c-4e98-87e4-2f445f764e40 req-1547c05d-de8f-4881-8bb7-269d1f4b9c99 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:55:33 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-aa9a7202-897c-4e98-87e4-2f445f764e40 req-1547c05d-de8f-4881-8bb7-269d1f4b9c99 service nova] Creating event network-vif-unplugged:2a49817a-aed1-49bd-96b6-36286ff71e1c for instance 84b55fc0-e748-4c05-97ad-a6994c0487d2 on user Apr 21 10:55:33 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-aa9a7202-897c-4e98-87e4-2f445f764e40 req-1547c05d-de8f-4881-8bb7-269d1f4b9c99 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029120 Apr 21 10:55:33 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 102/305] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:55:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:55:35 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [req-8fb8b663-1dff-4882-8db2-88780bf94013 req-f92ea705-513d-47ea-a3b3-e4f4748ded05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84b55fc0-e748-4c05-97ad-a6994c0487d2", "name": "network-vif-plugged", "status": "completed", "tag": "2a49817a-aed1-49bd-96b6-36286ff71e1c"}, {"server_uuid": "84b55fc0-e748-4c05-97ad-a6994c0487d2", "name": "network-vif-deleted", "tag": "2a49817a-aed1-49bd-96b6-36286ff71e1c"}]} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:55:35 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-8fb8b663-1dff-4882-8db2-88780bf94013 req-f92ea705-513d-47ea-a3b3-e4f4748ded05 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:55:35 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-8fb8b663-1dff-4882-8db2-88780bf94013 req-f92ea705-513d-47ea-a3b3-e4f4748ded05 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:55:35 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-8fb8b663-1dff-4882-8db2-88780bf94013 req-f92ea705-513d-47ea-a3b3-e4f4748ded05 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:55:35 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-8fb8b663-1dff-4882-8db2-88780bf94013 req-f92ea705-513d-47ea-a3b3-e4f4748ded05 service nova] Creating event network-vif-plugged:2a49817a-aed1-49bd-96b6-36286ff71e1c for instance 84b55fc0-e748-4c05-97ad-a6994c0487d2 on user Apr 21 10:55:35 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-8fb8b663-1dff-4882-8db2-88780bf94013 req-f92ea705-513d-47ea-a3b3-e4f4748ded05 service nova] Creating event network-vif-deleted:2a49817a-aed1-49bd-96b6-36286ff71e1c for instance 84b55fc0-e748-4c05-97ad-a6994c0487d2 on user Apr 21 10:55:35 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [req-8fb8b663-1dff-4882-8db2-88780bf94013 req-f92ea705-513d-47ea-a3b3-e4f4748ded05 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031473 Apr 21 10:55:35 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 102/306] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:55:35 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:55:46 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-67e3e3da-3980-49b5-888d-6978e5e53b49 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:55:46 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-67e3e3da-3980-49b5-888d-6978e5e53b49 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] [instance: f3e0bc01-1cf2-4ff9-bec6-12a37e44171c] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:55:46 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell1:SELECT=6 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:55:46 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_api:SELECT=4 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:55:46 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-67e3e3da-3980-49b5-888d-6978e5e53b49 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:55:46 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-67e3e3da-3980-49b5-888d-6978e5e53b49 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:55:46 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-67e3e3da-3980-49b5-888d-6978e5e53b49 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:55:46 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-67e3e3da-3980-49b5-888d-6978e5e53b49 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:55:46 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-67e3e3da-3980-49b5-888d-6978e5e53b49 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:55:46 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-67e3e3da-3980-49b5-888d-6978e5e53b49 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:55:46 user devstack@n-api.service[61320]: DEBUG nova.policy [None req-67e3e3da-3980-49b5-888d-6978e5e53b49 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cae5a1734d24ac8aebc233dd31d3084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead44a7da0640cbb2cf8dece0ea4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61320) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:55:46 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-67e3e3da-3980-49b5-888d-6978e5e53b49 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3e0bc01-1cf2-4ff9-bec6-12a37e44171c" status: 200 len: 1537 microversion: 2.1 time: 0.245071 Apr 21 10:55:46 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 103/307] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:55:46 2023] GET /compute/v2.1/servers/f3e0bc01-1cf2-4ff9-bec6-12a37e44171c => generated 1537 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:55:46 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_api:SELECT=4 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:55:46 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell1:SELECT=4 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:55:46 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-46f3b8ae-1fcd-49c4-9acc-8493279cfd9d tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:55:46 user devstack@n-api.service[61319]: DEBUG nova.policy [None req-46f3b8ae-1fcd-49c4-9acc-8493279cfd9d tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6cae5a1734d24ac8aebc233dd31d3084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead44a7da0640cbb2cf8dece0ea4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61319) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:55:46 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-46f3b8ae-1fcd-49c4-9acc-8493279cfd9d tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Searching by: {'deleted': False, 'project_id': '9ead44a7da0640cbb2cf8dece0ea4f40'} {{(pid=61319) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 21 10:55:46 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-46f3b8ae-1fcd-49c4-9acc-8493279cfd9d tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:55:46 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-46f3b8ae-1fcd-49c4-9acc-8493279cfd9d tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:55:46 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-46f3b8ae-1fcd-49c4-9acc-8493279cfd9d tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:55:46 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-46f3b8ae-1fcd-49c4-9acc-8493279cfd9d tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:55:46 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-46f3b8ae-1fcd-49c4-9acc-8493279cfd9d tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:55:46 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-46f3b8ae-1fcd-49c4-9acc-8493279cfd9d tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:55:46 user devstack@n-api.service[61319]: DEBUG nova.compute.multi_cell_list [None req-46f3b8ae-1fcd-49c4-9acc-8493279cfd9d tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61319) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 21 10:55:46 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-46f3b8ae-1fcd-49c4-9acc-8493279cfd9d tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.180235 Apr 21 10:55:46 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 103/308] 10.0.0.210 () {62 vars in 1202 bytes} [Fri Apr 21 10:55:46 2023] GET /compute/v2.1/servers => generated 340 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:55:46 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:55:46 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:55:46 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-a0ea794c-0c84-43f3-8256-9b464490f93e tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:55:46 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-a0ea794c-0c84-43f3-8256-9b464490f93e tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] [instance: f3e0bc01-1cf2-4ff9-bec6-12a37e44171c] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:55:46 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-a0ea794c-0c84-43f3-8256-9b464490f93e tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:55:46 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-a0ea794c-0c84-43f3-8256-9b464490f93e tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:55:46 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-a0ea794c-0c84-43f3-8256-9b464490f93e tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:55:46 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-a0ea794c-0c84-43f3-8256-9b464490f93e tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:55:46 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-a0ea794c-0c84-43f3-8256-9b464490f93e tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:55:46 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-a0ea794c-0c84-43f3-8256-9b464490f93e tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:55:46 user devstack@n-api.service[61318]: DEBUG nova.policy [None req-a0ea794c-0c84-43f3-8256-9b464490f93e tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cae5a1734d24ac8aebc233dd31d3084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead44a7da0640cbb2cf8dece0ea4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61318) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:55:46 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-a0ea794c-0c84-43f3-8256-9b464490f93e tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3e0bc01-1cf2-4ff9-bec6-12a37e44171c" status: 200 len: 1537 microversion: 2.1 time: 0.240466 Apr 21 10:55:46 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 103/309] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:55:46 2023] GET /compute/v2.1/servers/f3e0bc01-1cf2-4ff9-bec6-12a37e44171c => generated 1537 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:55:48 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-f28a08f9-0f2d-47a9-8019-f4c01a01704c tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:55:48 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-f28a08f9-0f2d-47a9-8019-f4c01a01704c tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] [instance: f3e0bc01-1cf2-4ff9-bec6-12a37e44171c] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:55:48 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-f28a08f9-0f2d-47a9-8019-f4c01a01704c tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:55:48 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-f28a08f9-0f2d-47a9-8019-f4c01a01704c tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:55:48 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-f28a08f9-0f2d-47a9-8019-f4c01a01704c tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:55:48 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-f28a08f9-0f2d-47a9-8019-f4c01a01704c tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:55:48 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-f28a08f9-0f2d-47a9-8019-f4c01a01704c tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:55:48 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-f28a08f9-0f2d-47a9-8019-f4c01a01704c tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:55:48 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-f28a08f9-0f2d-47a9-8019-f4c01a01704c tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] [instance: f3e0bc01-1cf2-4ff9-bec6-12a37e44171c] Going to try to terminate instance {{(pid=61320) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 10:55:48 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-f28a08f9-0f2d-47a9-8019-f4c01a01704c tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f3e0bc01-1cf2-4ff9-bec6-12a37e44171c" status: 204 len: 0 microversion: 2.1 time: 0.168986 Apr 21 10:55:48 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 104/310] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 10:55:48 2023] DELETE /compute/v2.1/servers/f3e0bc01-1cf2-4ff9-bec6-12a37e44171c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 10:55:48 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-d28684a0-cea4-4be9-a38b-9882bea40ff2 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:55:48 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-d28684a0-cea4-4be9-a38b-9882bea40ff2 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] [instance: f3e0bc01-1cf2-4ff9-bec6-12a37e44171c] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:55:48 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-d28684a0-cea4-4be9-a38b-9882bea40ff2 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:55:48 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-d28684a0-cea4-4be9-a38b-9882bea40ff2 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:55:48 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-d28684a0-cea4-4be9-a38b-9882bea40ff2 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:55:48 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-d28684a0-cea4-4be9-a38b-9882bea40ff2 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:55:48 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-d28684a0-cea4-4be9-a38b-9882bea40ff2 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:55:48 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-d28684a0-cea4-4be9-a38b-9882bea40ff2 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:55:48 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-e949e9c9-fc7f-41ef-9a2a-3b260610eb90 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:55:48 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-e949e9c9-fc7f-41ef-9a2a-3b260610eb90 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] [instance: d28e1e38-3ed5-468e-b672-8b94a909820c] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:55:48 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-e949e9c9-fc7f-41ef-9a2a-3b260610eb90 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:55:48 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-e949e9c9-fc7f-41ef-9a2a-3b260610eb90 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:55:48 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-e949e9c9-fc7f-41ef-9a2a-3b260610eb90 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:55:48 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-e949e9c9-fc7f-41ef-9a2a-3b260610eb90 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:55:48 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-e949e9c9-fc7f-41ef-9a2a-3b260610eb90 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:55:48 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-e949e9c9-fc7f-41ef-9a2a-3b260610eb90 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:55:48 user devstack@n-api.service[61318]: INFO nova.api.openstack.wsgi [None req-e949e9c9-fc7f-41ef-9a2a-3b260610eb90 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] HTTP exception thrown: Instance d28e1e38-3ed5-468e-b672-8b94a909820c could not be found. Apr 21 10:55:48 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-e949e9c9-fc7f-41ef-9a2a-3b260610eb90 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Request method failure captured: Apr 21 10:55:48 user devstack@n-api.service[61318]: request: GET /compute/v2.1/servers/d28e1e38-3ed5-468e-b672-8b94a909820c HTTP/1.1 Apr 21 10:55:48 user devstack@n-api.service[61318]: Accept: application/json Apr 21 10:55:48 user devstack@n-api.service[61318]: Accept-Encoding: identity Apr 21 10:55:48 user devstack@n-api.service[61318]: Connection: close Apr 21 10:55:48 user devstack@n-api.service[61318]: Content-Length: 0 Apr 21 10:55:48 user devstack@n-api.service[61318]: Content-Type: application/json Apr 21 10:55:48 user devstack@n-api.service[61318]: Host: 10.0.0.210 Apr 21 10:55:48 user devstack@n-api.service[61318]: Openstack-System-Scope: None Apr 21 10:55:48 user devstack@n-api.service[61318]: User-Agent: python-urllib3/1.26.15 Apr 21 10:55:48 user devstack@n-api.service[61318]: X-Auth-Token: gAAAAABkQmsO4Ti6hs69z_6Ogvs4ejj7r0BZKsyfzT9wT_akUX9UJiysHbmUPTFlIxRZV4GzaKcEHtXLtDCyrbqof8A_RuWS8jMqwQkpCNmO8LpbZakx3A5g2MVGEzhF0EvvdFwMh7oY0TESImzQadQsU3RwS-vJMRw092Oq4oo7uZmU7xd_izU Apr 21 10:55:48 user devstack@n-api.service[61318]: X-Domain-Id: None Apr 21 10:55:48 user devstack@n-api.service[61318]: X-Domain-Name: None Apr 21 10:55:48 user devstack@n-api.service[61318]: X-Identity-Status: Confirmed Apr 21 10:55:48 user devstack@n-api.service[61318]: X-Is-Admin-Project: True Apr 21 10:55:48 user devstack@n-api.service[61318]: X-Project-Domain-Id: default Apr 21 10:55:48 user devstack@n-api.service[61318]: X-Project-Domain-Name: Default Apr 21 10:55:48 user devstack@n-api.service[61318]: X-Project-Id: 14bc6b0c20204c8287b3523814007856 Apr 21 10:55:48 user devstack@n-api.service[61318]: X-Project-Name: tempest-AttachVolumeNegativeTest-159654333 Apr 21 10:55:48 user devstack@n-api.service[61318]: X-Role: reader,member Apr 21 10:55:48 user devstack@n-api.service[61318]: X-Roles: reader,member Apr 21 10:55:48 user devstack@n-api.service[61318]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/14bc6b0c20204c8287b3523814007856"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/14bc6b0c20204c8287b3523814007856"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/14bc6b0c20204c8287b3523814007856"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 10:55:48 user devstack@n-api.service[61318]: X-Tenant: tempest-AttachVolumeNegativeTest-159654333 Apr 21 10:55:48 user devstack@n-api.service[61318]: X-Tenant-Id: 14bc6b0c20204c8287b3523814007856 Apr 21 10:55:48 user devstack@n-api.service[61318]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-159654333 Apr 21 10:55:48 user devstack@n-api.service[61318]: X-User: tempest-AttachVolumeNegativeTest-159654333-project-member Apr 21 10:55:48 user devstack@n-api.service[61318]: X-User-Domain-Id: default Apr 21 10:55:48 user devstack@n-api.service[61318]: X-User-Domain-Name: Default Apr 21 10:55:48 user devstack@n-api.service[61318]: X-User-Id: d7fc66871488428e9842404d885bcfe3 Apr 21 10:55:48 user devstack@n-api.service[61318]: X-User-Name: tempest-AttachVolumeNegativeTest-159654333-project-member Apr 21 10:55:48 user devstack@n-api.service[61318]: method: > Apr 21 10:55:48 user devstack@n-api.service[61318]: exception: Instance d28e1e38-3ed5-468e-b672-8b94a909820c could not be found. Apr 21 10:55:48 user devstack@n-api.service[61318]: action_args: {'id': 'd28e1e38-3ed5-468e-b672-8b94a909820c'} Apr 21 10:55:48 user devstack@n-api.service[61318]: {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 10:55:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:55:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 10:55:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 10:55:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 10:55:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 10:55:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 10:55:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 10:55:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 10:55:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 10:55:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d28e1e38-3ed5-468e-b672-8b94a909820c could not be found. Apr 21 10:55:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:55:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:55:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:55:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:55:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 10:55:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 10:55:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 10:55:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 10:55:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 10:55:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 10:55:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 10:55:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 10:55:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 10:55:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 10:55:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 10:55:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 10:55:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d28e1e38-3ed5-468e-b672-8b94a909820c could not be found. Apr 21 10:55:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:55:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:55:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:55:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:55:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 10:55:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 10:55:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 10:55:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 10:55:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d28e1e38-3ed5-468e-b672-8b94a909820c could not be found. Apr 21 10:55:48 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:55:48 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-e949e9c9-fc7f-41ef-9a2a-3b260610eb90 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Returning 404 to user: Instance d28e1e38-3ed5-468e-b672-8b94a909820c could not be found. {{(pid=61318) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 10:55:48 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-e949e9c9-fc7f-41ef-9a2a-3b260610eb90 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d28e1e38-3ed5-468e-b672-8b94a909820c" status: 404 len: 111 microversion: 2.1 time: 0.027112 Apr 21 10:55:48 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 104/311] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:55:48 2023] GET /compute/v2.1/servers/d28e1e38-3ed5-468e-b672-8b94a909820c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 10:55:48 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-fc702d22-9fcf-48c8-9661-16d14cf94ced tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Calling method '.version_select at 0x7f91a5dd3b50>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:55:48 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-fc702d22-9fcf-48c8-9661-16d14cf94ced tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-962586907" status: 202 len: 0 microversion: 2.1 time: 0.033797 Apr 21 10:55:48 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 105/312] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 21 10:55:48 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-962586907 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 10:55:48 user devstack@n-api.service[61319]: DEBUG nova.policy [None req-d28684a0-cea4-4be9-a38b-9882bea40ff2 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cae5a1734d24ac8aebc233dd31d3084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead44a7da0640cbb2cf8dece0ea4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61319) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:55:48 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-d28684a0-cea4-4be9-a38b-9882bea40ff2 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3e0bc01-1cf2-4ff9-bec6-12a37e44171c" status: 200 len: 1543 microversion: 2.1 time: 0.166312 Apr 21 10:55:48 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 104/313] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:55:48 2023] GET /compute/v2.1/servers/f3e0bc01-1cf2-4ff9-bec6-12a37e44171c => generated 1543 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:55:48 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [req-94ea02dd-d604-4b30-9130-d0173e838e38 req-80882831-6e5d-4bf1-b28d-68046bfc3e7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3e0bc01-1cf2-4ff9-bec6-12a37e44171c", "name": "network-vif-unplugged", "status": "completed", "tag": "ec8edd23-eb04-4e01-874f-7a5ad305eacc"}]} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:55:48 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-94ea02dd-d604-4b30-9130-d0173e838e38 req-80882831-6e5d-4bf1-b28d-68046bfc3e7d service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:55:48 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-94ea02dd-d604-4b30-9130-d0173e838e38 req-80882831-6e5d-4bf1-b28d-68046bfc3e7d service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:55:48 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-94ea02dd-d604-4b30-9130-d0173e838e38 req-80882831-6e5d-4bf1-b28d-68046bfc3e7d service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:55:48 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-94ea02dd-d604-4b30-9130-d0173e838e38 req-80882831-6e5d-4bf1-b28d-68046bfc3e7d service nova] Creating event network-vif-unplugged:ec8edd23-eb04-4e01-874f-7a5ad305eacc for instance f3e0bc01-1cf2-4ff9-bec6-12a37e44171c on user Apr 21 10:55:48 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [req-94ea02dd-d604-4b30-9130-d0173e838e38 req-80882831-6e5d-4bf1-b28d-68046bfc3e7d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030317 Apr 21 10:55:48 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 105/314] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:55:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:55:49 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-575930cb-3601-40f5-a3d7-32cd57540492 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Action: 'create', calling method: .version_select at 0x7f91a5c1d120>, body: {"keypair": {"name": "tempest-keypair-610711731", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHp6Xpoy4by46AxWCAbGiYDwkQpafANsc/yEMfhdZjZu+ouzXhRTZE2gofYmbc0DufFTp50aDb84APASGieWAMislJ/20uHZwVFUyEEqhMGv/VNdPqJyM1DgvCFkYCmKMQ=="}} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:55:49 user devstack@n-api.service[61320]: DEBUG nova.quota [None req-575930cb-3601-40f5-a3d7-32cd57540492 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Getting quotas for project 14bc6b0c20204c8287b3523814007856. Resources: {'key_pairs'} {{(pid=61320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 10:55:49 user devstack@n-api.service[61320]: DEBUG nova.quota [None req-575930cb-3601-40f5-a3d7-32cd57540492 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Getting quotas for user d7fc66871488428e9842404d885bcfe3 and project 14bc6b0c20204c8287b3523814007856. Resources: {'key_pairs'} {{(pid=61320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 10:55:49 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-575930cb-3601-40f5-a3d7-32cd57540492 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052086 Apr 21 10:55:49 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 106/315] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 21 10:55:49 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:55:49 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-80fa3837-670d-4f8b-b58c-327fd66ec919 req-c1447460-842d-4249-94c2-52da89e9588b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3e0bc01-1cf2-4ff9-bec6-12a37e44171c", "name": "network-vif-deleted", "tag": "ec8edd23-eb04-4e01-874f-7a5ad305eacc"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:55:49 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-80fa3837-670d-4f8b-b58c-327fd66ec919 req-c1447460-842d-4249-94c2-52da89e9588b service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:55:49 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-80fa3837-670d-4f8b-b58c-327fd66ec919 req-c1447460-842d-4249-94c2-52da89e9588b service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:55:49 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-80fa3837-670d-4f8b-b58c-327fd66ec919 req-c1447460-842d-4249-94c2-52da89e9588b service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:55:49 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-80fa3837-670d-4f8b-b58c-327fd66ec919 req-c1447460-842d-4249-94c2-52da89e9588b service nova] Creating event network-vif-deleted:ec8edd23-eb04-4e01-874f-7a5ad305eacc for instance f3e0bc01-1cf2-4ff9-bec6-12a37e44171c on user Apr 21 10:55:49 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-80fa3837-670d-4f8b-b58c-327fd66ec919 req-c1447460-842d-4249-94c2-52da89e9588b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029892 Apr 21 10:55:49 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 105/316] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:55:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:55:50 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [req-3193da52-2ce8-487f-93cc-1520f91e52e2 req-73c21077-a704-46a3-80e1-3fdde6dac9de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3e0bc01-1cf2-4ff9-bec6-12a37e44171c", "name": "network-vif-plugged", "status": "completed", "tag": "ec8edd23-eb04-4e01-874f-7a5ad305eacc"}]} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:55:50 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-3193da52-2ce8-487f-93cc-1520f91e52e2 req-73c21077-a704-46a3-80e1-3fdde6dac9de service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:55:50 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-3193da52-2ce8-487f-93cc-1520f91e52e2 req-73c21077-a704-46a3-80e1-3fdde6dac9de service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:55:50 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-3193da52-2ce8-487f-93cc-1520f91e52e2 req-73c21077-a704-46a3-80e1-3fdde6dac9de service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:55:50 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-3193da52-2ce8-487f-93cc-1520f91e52e2 req-73c21077-a704-46a3-80e1-3fdde6dac9de service nova] Creating event network-vif-plugged:ec8edd23-eb04-4e01-874f-7a5ad305eacc for instance f3e0bc01-1cf2-4ff9-bec6-12a37e44171c on user Apr 21 10:55:50 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-4c31f005-a915-4da5-b60e-f1454bb6e0cc tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1645771321", "imageRef": "3b29a01a-1fc0-4d0d-89fb-23d22b2de02e", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "e0ccd2d9-69df-40e0-be8e-8328039f1bd0"}], "security_groups": [{"name": "tempest-securitygroup--477386517"}], "key_name": "tempest-keypair-610711731", "user_data": "}} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:55:50 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [req-3193da52-2ce8-487f-93cc-1520f91e52e2 req-73c21077-a704-46a3-80e1-3fdde6dac9de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029003 Apr 21 10:55:50 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 106/317] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:55:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:55:50 user devstack@n-api.service[61320]: DEBUG nova.network.neutron [None req-4c31f005-a915-4da5-b60e-f1454bb6e0cc tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] validate_networks() for [('e0ccd2d9-69df-40e0-be8e-8328039f1bd0', None, None, None, None, None)] {{(pid=61320) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 10:55:51 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-4c31f005-a915-4da5-b60e-f1454bb6e0cc tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Flavor limits 0:0:0 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 10:55:51 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-4c31f005-a915-4da5-b60e-f1454bb6e0cc tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Image limits 0:0:0 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 10:55:51 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-4c31f005-a915-4da5-b60e-f1454bb6e0cc tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Flavor pref 0:0:0 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 10:55:51 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-4c31f005-a915-4da5-b60e-f1454bb6e0cc tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Image pref 0:0:0 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 10:55:51 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-4c31f005-a915-4da5-b60e-f1454bb6e0cc tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 10:55:51 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-4c31f005-a915-4da5-b60e-f1454bb6e0cc tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:55:51 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-4c31f005-a915-4da5-b60e-f1454bb6e0cc tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:55:51 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-4c31f005-a915-4da5-b60e-f1454bb6e0cc tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:55:51 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-4c31f005-a915-4da5-b60e-f1454bb6e0cc tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:55:51 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-4c31f005-a915-4da5-b60e-f1454bb6e0cc tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:55:51 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-4c31f005-a915-4da5-b60e-f1454bb6e0cc tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:55:51 user devstack@n-api.service[61320]: DEBUG nova.quota [None req-4c31f005-a915-4da5-b60e-f1454bb6e0cc tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Getting quotas for project 14bc6b0c20204c8287b3523814007856. Resources: {'cores', 'instances', 'ram'} {{(pid=61320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 10:55:51 user devstack@n-api.service[61320]: DEBUG nova.quota [None req-4c31f005-a915-4da5-b60e-f1454bb6e0cc tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Getting quotas for user d7fc66871488428e9842404d885bcfe3 and project 14bc6b0c20204c8287b3523814007856. Resources: {'cores', 'instances', 'ram'} {{(pid=61320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 10:55:51 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-4c31f005-a915-4da5-b60e-f1454bb6e0cc tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Going to run 1 instances... {{(pid=61320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 10:55:51 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-4c31f005-a915-4da5-b60e-f1454bb6e0cc tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] [instance: c70df604-601e-4451-828d-20c649b6052a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3b29a01a-1fc0-4d0d-89fb-23d22b2de02e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 10:55:51 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-4c31f005-a915-4da5-b60e-f1454bb6e0cc tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.651630 Apr 21 10:55:51 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 107/318] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 10:55:50 2023] POST /compute/v2.1/servers => generated 399 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 10:55:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-39fb7f92-3689-4dc6-b37c-a2a98b414815 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:55:51 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-39fb7f92-3689-4dc6-b37c-a2a98b414815 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] [instance: c70df604-601e-4451-828d-20c649b6052a] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:55:51 user devstack@n-api.service[61319]: DEBUG nova.policy [None req-39fb7f92-3689-4dc6-b37c-a2a98b414815 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fc66871488428e9842404d885bcfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bc6b0c20204c8287b3523814007856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61319) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:55:51 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-39fb7f92-3689-4dc6-b37c-a2a98b414815 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c70df604-601e-4451-828d-20c649b6052a" status: 200 len: 1235 microversion: 2.1 time: 0.432988 Apr 21 10:55:51 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 106/319] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:55:51 2023] GET /compute/v2.1/servers/c70df604-601e-4451-828d-20c649b6052a => generated 1235 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:55:53 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [req-a1e7c6d8-a97c-4b11-a021-168d803c1123 req-7e24370d-dc38-4dbd-953c-5b3fbe5e91b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c70df604-601e-4451-828d-20c649b6052a", "tag": "5751ca80-5041-4999-b832-b427fb0af8a2"}]} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:55:53 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-a1e7c6d8-a97c-4b11-a021-168d803c1123 req-7e24370d-dc38-4dbd-953c-5b3fbe5e91b8 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:55:53 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-a1e7c6d8-a97c-4b11-a021-168d803c1123 req-7e24370d-dc38-4dbd-953c-5b3fbe5e91b8 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:55:53 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-a1e7c6d8-a97c-4b11-a021-168d803c1123 req-7e24370d-dc38-4dbd-953c-5b3fbe5e91b8 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:55:54 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-a1e7c6d8-a97c-4b11-a021-168d803c1123 req-7e24370d-dc38-4dbd-953c-5b3fbe5e91b8 service nova] Creating event network-changed:5751ca80-5041-4999-b832-b427fb0af8a2 for instance c70df604-601e-4451-828d-20c649b6052a on user Apr 21 10:55:54 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [req-a1e7c6d8-a97c-4b11-a021-168d803c1123 req-7e24370d-dc38-4dbd-953c-5b3fbe5e91b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027838 Apr 21 10:55:54 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 107/320] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:55:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:55:55 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [req-db3a53fe-3d55-4177-8e04-271a80af59ff req-735f2519-3396-48fe-ad93-79a02af9891c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c70df604-601e-4451-828d-20c649b6052a", "name": "network-vif-plugged", "status": "completed", "tag": "5751ca80-5041-4999-b832-b427fb0af8a2"}]} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:55:55 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-db3a53fe-3d55-4177-8e04-271a80af59ff req-735f2519-3396-48fe-ad93-79a02af9891c service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:55:55 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-db3a53fe-3d55-4177-8e04-271a80af59ff req-735f2519-3396-48fe-ad93-79a02af9891c service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:55:55 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-db3a53fe-3d55-4177-8e04-271a80af59ff req-735f2519-3396-48fe-ad93-79a02af9891c service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:55:55 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-db3a53fe-3d55-4177-8e04-271a80af59ff req-735f2519-3396-48fe-ad93-79a02af9891c service nova] Creating event network-vif-plugged:5751ca80-5041-4999-b832-b427fb0af8a2 for instance c70df604-601e-4451-828d-20c649b6052a on user Apr 21 10:55:55 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [req-db3a53fe-3d55-4177-8e04-271a80af59ff req-735f2519-3396-48fe-ad93-79a02af9891c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049057 Apr 21 10:55:55 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 108/321] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:55:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:55:58 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell0:SELECT=2 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:55:58 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-e7efc24f-0e41-4ddf-a852-e9210bdb4a42 req-a2835900-9031-4873-82b5-66b1d17a5d30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c70df604-601e-4451-828d-20c649b6052a", "name": "network-vif-plugged", "status": "completed", "tag": "5751ca80-5041-4999-b832-b427fb0af8a2"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:55:58 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-e7efc24f-0e41-4ddf-a852-e9210bdb4a42 req-a2835900-9031-4873-82b5-66b1d17a5d30 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:55:58 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-e7efc24f-0e41-4ddf-a852-e9210bdb4a42 req-a2835900-9031-4873-82b5-66b1d17a5d30 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:55:58 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-e7efc24f-0e41-4ddf-a852-e9210bdb4a42 req-a2835900-9031-4873-82b5-66b1d17a5d30 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:55:58 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-e7efc24f-0e41-4ddf-a852-e9210bdb4a42 req-a2835900-9031-4873-82b5-66b1d17a5d30 service nova] Creating event network-vif-plugged:5751ca80-5041-4999-b832-b427fb0af8a2 for instance c70df604-601e-4451-828d-20c649b6052a on user Apr 21 10:55:58 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-e7efc24f-0e41-4ddf-a852-e9210bdb4a42 req-a2835900-9031-4873-82b5-66b1d17a5d30 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035487 Apr 21 10:55:58 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 107/322] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:55:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:56:07 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_api:SELECT=10 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:56:07 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell1:SELECT=14 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:56:07 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-46507153-9774-4c6b-ae6d-d2448087cdae tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:56:07 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-46507153-9774-4c6b-ae6d-d2448087cdae tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] [instance: f8609da3-c26d-482a-bc03-017baf4bce22] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:56:07 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-46507153-9774-4c6b-ae6d-d2448087cdae tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:56:07 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-46507153-9774-4c6b-ae6d-d2448087cdae tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:56:07 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-46507153-9774-4c6b-ae6d-d2448087cdae tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:56:07 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-46507153-9774-4c6b-ae6d-d2448087cdae tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:56:07 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-46507153-9774-4c6b-ae6d-d2448087cdae tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:56:07 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-46507153-9774-4c6b-ae6d-d2448087cdae tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:56:07 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-46507153-9774-4c6b-ae6d-d2448087cdae tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] [instance: f8609da3-c26d-482a-bc03-017baf4bce22] Going to try to terminate instance {{(pid=61318) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 10:56:07 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-46507153-9774-4c6b-ae6d-d2448087cdae tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f8609da3-c26d-482a-bc03-017baf4bce22" status: 204 len: 0 microversion: 2.1 time: 0.162241 Apr 21 10:56:07 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 108/323] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 10:56:07 2023] DELETE /compute/v2.1/servers/f8609da3-c26d-482a-bc03-017baf4bce22 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 10:56:07 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell0:SELECT=2 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:56:07 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell0:SELECT=10 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:56:07 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:56:07 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:56:07 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-d1c7ed88-ebe8-47a6-8c6d-bbf5ef2875e4 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:56:07 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-d1c7ed88-ebe8-47a6-8c6d-bbf5ef2875e4 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] [instance: f8609da3-c26d-482a-bc03-017baf4bce22] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:56:07 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-d1c7ed88-ebe8-47a6-8c6d-bbf5ef2875e4 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:56:07 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-d1c7ed88-ebe8-47a6-8c6d-bbf5ef2875e4 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:56:07 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-d1c7ed88-ebe8-47a6-8c6d-bbf5ef2875e4 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:56:07 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-d1c7ed88-ebe8-47a6-8c6d-bbf5ef2875e4 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:56:07 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-d1c7ed88-ebe8-47a6-8c6d-bbf5ef2875e4 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:56:07 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-d1c7ed88-ebe8-47a6-8c6d-bbf5ef2875e4 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:56:07 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell0:SELECT=2 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:56:07 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-6cea336d-c90f-47e0-bf48-571609867391 req-6173f3bb-2943-4b2e-a5d5-80b24b37a85d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8609da3-c26d-482a-bc03-017baf4bce22", "name": "network-vif-unplugged", "status": "completed", "tag": "f210779b-302b-4a17-8b57-07837ea54e12"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:56:07 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-6cea336d-c90f-47e0-bf48-571609867391 req-6173f3bb-2943-4b2e-a5d5-80b24b37a85d service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:56:07 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-6cea336d-c90f-47e0-bf48-571609867391 req-6173f3bb-2943-4b2e-a5d5-80b24b37a85d service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:56:07 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-6cea336d-c90f-47e0-bf48-571609867391 req-6173f3bb-2943-4b2e-a5d5-80b24b37a85d service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:56:07 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-6cea336d-c90f-47e0-bf48-571609867391 req-6173f3bb-2943-4b2e-a5d5-80b24b37a85d service nova] Creating event network-vif-unplugged:f210779b-302b-4a17-8b57-07837ea54e12 for instance f8609da3-c26d-482a-bc03-017baf4bce22 on user Apr 21 10:56:07 user devstack@n-api.service[61320]: DEBUG nova.policy [None req-d1c7ed88-ebe8-47a6-8c6d-bbf5ef2875e4 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced216baa4a64c72946cf3f71eb873dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648163a728fc4b28b85a24e9198d356b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61320) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:56:07 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-6cea336d-c90f-47e0-bf48-571609867391 req-6173f3bb-2943-4b2e-a5d5-80b24b37a85d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047455 Apr 21 10:56:07 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 108/324] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:56:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:56:07 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-d1c7ed88-ebe8-47a6-8c6d-bbf5ef2875e4 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8609da3-c26d-482a-bc03-017baf4bce22" status: 200 len: 1662 microversion: 2.1 time: 0.289687 Apr 21 10:56:07 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 109/325] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:56:07 2023] GET /compute/v2.1/servers/f8609da3-c26d-482a-bc03-017baf4bce22 => generated 1662 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:56:08 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [req-567bd3e5-3be5-478f-a15e-9e8e3fc8686d req-56ac6ece-1362-49ae-be10-5c05a1312633 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8609da3-c26d-482a-bc03-017baf4bce22", "name": "network-vif-deleted", "tag": "f210779b-302b-4a17-8b57-07837ea54e12"}]} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:56:08 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-567bd3e5-3be5-478f-a15e-9e8e3fc8686d req-56ac6ece-1362-49ae-be10-5c05a1312633 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:56:08 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-567bd3e5-3be5-478f-a15e-9e8e3fc8686d req-56ac6ece-1362-49ae-be10-5c05a1312633 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:56:08 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-567bd3e5-3be5-478f-a15e-9e8e3fc8686d req-56ac6ece-1362-49ae-be10-5c05a1312633 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:56:08 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-567bd3e5-3be5-478f-a15e-9e8e3fc8686d req-56ac6ece-1362-49ae-be10-5c05a1312633 service nova] Creating event network-vif-deleted:f210779b-302b-4a17-8b57-07837ea54e12 for instance f8609da3-c26d-482a-bc03-017baf4bce22 on user Apr 21 10:56:08 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [req-567bd3e5-3be5-478f-a15e-9e8e3fc8686d req-56ac6ece-1362-49ae-be10-5c05a1312633 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030272 Apr 21 10:56:08 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 109/326] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:56:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:56:09 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-4f8a6846-ea8b-4893-a907-bb850099c5ea req-4a5312ed-e9c7-467d-8626-faded27349a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8609da3-c26d-482a-bc03-017baf4bce22", "name": "network-vif-plugged", "status": "completed", "tag": "f210779b-302b-4a17-8b57-07837ea54e12"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:56:09 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-4f8a6846-ea8b-4893-a907-bb850099c5ea req-4a5312ed-e9c7-467d-8626-faded27349a4 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:56:09 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-4f8a6846-ea8b-4893-a907-bb850099c5ea req-4a5312ed-e9c7-467d-8626-faded27349a4 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:56:09 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-4f8a6846-ea8b-4893-a907-bb850099c5ea req-4a5312ed-e9c7-467d-8626-faded27349a4 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:56:09 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-4f8a6846-ea8b-4893-a907-bb850099c5ea req-4a5312ed-e9c7-467d-8626-faded27349a4 service nova] Creating event network-vif-plugged:f210779b-302b-4a17-8b57-07837ea54e12 for instance f8609da3-c26d-482a-bc03-017baf4bce22 on user Apr 21 10:56:09 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-4f8a6846-ea8b-4893-a907-bb850099c5ea req-4a5312ed-e9c7-467d-8626-faded27349a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030986 Apr 21 10:56:09 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 109/327] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:56:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:56:23 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-d54b4b74-de01-4dea-b1eb-8c277899bbad tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:56:23 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-d54b4b74-de01-4dea-b1eb-8c277899bbad tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] [instance: 84b55fc0-e748-4c05-97ad-a6994c0487d2] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:56:23 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_api:SELECT=2 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:56:23 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell1:SELECT=6 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:56:23 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-d54b4b74-de01-4dea-b1eb-8c277899bbad tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:56:23 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-d54b4b74-de01-4dea-b1eb-8c277899bbad tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:56:23 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-d54b4b74-de01-4dea-b1eb-8c277899bbad tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:56:23 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-d54b4b74-de01-4dea-b1eb-8c277899bbad tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:56:23 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-d54b4b74-de01-4dea-b1eb-8c277899bbad tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:56:23 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-d54b4b74-de01-4dea-b1eb-8c277899bbad tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:56:23 user devstack@n-api.service[61320]: INFO nova.api.openstack.wsgi [None req-d54b4b74-de01-4dea-b1eb-8c277899bbad tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] HTTP exception thrown: Instance 84b55fc0-e748-4c05-97ad-a6994c0487d2 could not be found. Apr 21 10:56:23 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-d54b4b74-de01-4dea-b1eb-8c277899bbad tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Request method failure captured: Apr 21 10:56:23 user devstack@n-api.service[61320]: request: GET /compute/v2.1/servers/84b55fc0-e748-4c05-97ad-a6994c0487d2 HTTP/1.1 Apr 21 10:56:23 user devstack@n-api.service[61320]: Accept: application/json Apr 21 10:56:23 user devstack@n-api.service[61320]: Accept-Encoding: identity Apr 21 10:56:23 user devstack@n-api.service[61320]: Connection: close Apr 21 10:56:23 user devstack@n-api.service[61320]: Content-Length: 0 Apr 21 10:56:23 user devstack@n-api.service[61320]: Content-Type: application/json Apr 21 10:56:23 user devstack@n-api.service[61320]: Host: 10.0.0.210 Apr 21 10:56:23 user devstack@n-api.service[61320]: Openstack-System-Scope: None Apr 21 10:56:23 user devstack@n-api.service[61320]: User-Agent: python-urllib3/1.26.15 Apr 21 10:56:23 user devstack@n-api.service[61320]: X-Auth-Token: gAAAAABkQmmi2qmN21XP1-DJ0fIuUyfzkDVvfbWGO-MUZXWhTOEnVzXhVFl8LUHS-yHejsXQJQDrMBGmIiXmN8jjX0f1kKLnGT_CoDsaSA6EPHkQhVh674tVagYFSv7PUgkhweI8_tY6juuaFpZwf7yRfTk8k_mK9rn7HdRsjMrpquoVzV7Q8q4 Apr 21 10:56:23 user devstack@n-api.service[61320]: X-Domain-Id: None Apr 21 10:56:23 user devstack@n-api.service[61320]: X-Domain-Name: None Apr 21 10:56:23 user devstack@n-api.service[61320]: X-Identity-Status: Confirmed Apr 21 10:56:23 user devstack@n-api.service[61320]: X-Is-Admin-Project: True Apr 21 10:56:23 user devstack@n-api.service[61320]: X-Openstack-Nova-Api-Version: 2.87 Apr 21 10:56:23 user devstack@n-api.service[61320]: X-Project-Domain-Id: default Apr 21 10:56:23 user devstack@n-api.service[61320]: X-Project-Domain-Name: Default Apr 21 10:56:23 user devstack@n-api.service[61320]: X-Project-Id: aad84a0e014f47ddaeaddc88bf16b0a8 Apr 21 10:56:23 user devstack@n-api.service[61320]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1980957418 Apr 21 10:56:23 user devstack@n-api.service[61320]: X-Role: reader,member Apr 21 10:56:23 user devstack@n-api.service[61320]: X-Roles: reader,member Apr 21 10:56:23 user devstack@n-api.service[61320]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/aad84a0e014f47ddaeaddc88bf16b0a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/aad84a0e014f47ddaeaddc88bf16b0a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/aad84a0e014f47ddaeaddc88bf16b0a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 10:56:23 user devstack@n-api.service[61320]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1980957418 Apr 21 10:56:23 user devstack@n-api.service[61320]: X-Tenant-Id: aad84a0e014f47ddaeaddc88bf16b0a8 Apr 21 10:56:23 user devstack@n-api.service[61320]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1980957418 Apr 21 10:56:23 user devstack@n-api.service[61320]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member Apr 21 10:56:23 user devstack@n-api.service[61320]: X-User-Domain-Id: default Apr 21 10:56:23 user devstack@n-api.service[61320]: X-User-Domain-Name: Default Apr 21 10:56:23 user devstack@n-api.service[61320]: X-User-Id: 54c67d90b6014d9ea24ef2552006bc04 Apr 21 10:56:23 user devstack@n-api.service[61320]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member Apr 21 10:56:23 user devstack@n-api.service[61320]: method: > Apr 21 10:56:23 user devstack@n-api.service[61320]: exception: Instance 84b55fc0-e748-4c05-97ad-a6994c0487d2 could not be found. Apr 21 10:56:23 user devstack@n-api.service[61320]: action_args: {'id': '84b55fc0-e748-4c05-97ad-a6994c0487d2'} Apr 21 10:56:23 user devstack@n-api.service[61320]: {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 10:56:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:56:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 10:56:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 10:56:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 10:56:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 10:56:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 10:56:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 10:56:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 10:56:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 10:56:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84b55fc0-e748-4c05-97ad-a6994c0487d2 could not be found. Apr 21 10:56:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:56:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:56:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:56:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:56:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 10:56:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 10:56:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 10:56:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 10:56:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 10:56:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 10:56:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 10:56:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 10:56:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 10:56:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 10:56:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 10:56:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 10:56:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84b55fc0-e748-4c05-97ad-a6994c0487d2 could not be found. Apr 21 10:56:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:56:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:56:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:56:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:56:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 10:56:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 10:56:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 10:56:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 10:56:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84b55fc0-e748-4c05-97ad-a6994c0487d2 could not be found. Apr 21 10:56:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:56:23 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-d54b4b74-de01-4dea-b1eb-8c277899bbad tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] Returning 404 to user: Instance 84b55fc0-e748-4c05-97ad-a6994c0487d2 could not be found. {{(pid=61320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 10:56:23 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-d54b4b74-de01-4dea-b1eb-8c277899bbad tempest-ServerBootFromVolumeStableRescueTest-1980957418 tempest-ServerBootFromVolumeStableRescueTest-1980957418-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84b55fc0-e748-4c05-97ad-a6994c0487d2" status: 404 len: 111 microversion: 2.87 time: 0.034737 Apr 21 10:56:23 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 110/328] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 10:56:23 2023] GET /compute/v2.1/servers/84b55fc0-e748-4c05-97ad-a6994c0487d2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 21 10:56:34 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:56:34 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:56:34 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-a82dd866-9e37-47da-8db9-c3e084848b4a tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2123160889", "imageRef": "3b29a01a-1fc0-4d0d-89fb-23d22b2de02e", "flavorRef": "42", "networks": [{"uuid": "3e633eed-7c28-4111-849c-3ab0f46c0c5c"}]}} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:56:34 user devstack@n-api.service[61318]: DEBUG nova.network.neutron [None req-a82dd866-9e37-47da-8db9-c3e084848b4a tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] validate_networks() for [('3e633eed-7c28-4111-849c-3ab0f46c0c5c', None, None, None, None, None)] {{(pid=61318) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 10:56:34 user devstack@n-api.service[61318]: DEBUG nova.virt.hardware [None req-a82dd866-9e37-47da-8db9-c3e084848b4a tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Flavor limits 0:0:0 {{(pid=61318) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 10:56:34 user devstack@n-api.service[61318]: DEBUG nova.virt.hardware [None req-a82dd866-9e37-47da-8db9-c3e084848b4a tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Image limits 0:0:0 {{(pid=61318) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 10:56:34 user devstack@n-api.service[61318]: DEBUG nova.virt.hardware [None req-a82dd866-9e37-47da-8db9-c3e084848b4a tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Flavor pref 0:0:0 {{(pid=61318) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 10:56:34 user devstack@n-api.service[61318]: DEBUG nova.virt.hardware [None req-a82dd866-9e37-47da-8db9-c3e084848b4a tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Image pref 0:0:0 {{(pid=61318) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 10:56:34 user devstack@n-api.service[61318]: DEBUG nova.virt.hardware [None req-a82dd866-9e37-47da-8db9-c3e084848b4a tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61318) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 10:56:34 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-a82dd866-9e37-47da-8db9-c3e084848b4a tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:56:34 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-a82dd866-9e37-47da-8db9-c3e084848b4a tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:56:34 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-a82dd866-9e37-47da-8db9-c3e084848b4a tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:56:34 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-a82dd866-9e37-47da-8db9-c3e084848b4a tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:56:34 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-a82dd866-9e37-47da-8db9-c3e084848b4a tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:56:34 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-a82dd866-9e37-47da-8db9-c3e084848b4a tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:56:34 user devstack@n-api.service[61318]: DEBUG nova.quota [None req-a82dd866-9e37-47da-8db9-c3e084848b4a tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Getting quotas for project acc12d15daf34c5e9d26a6cc53795efe. Resources: {'cores', 'instances', 'ram'} {{(pid=61318) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 10:56:34 user devstack@n-api.service[61318]: DEBUG nova.quota [None req-a82dd866-9e37-47da-8db9-c3e084848b4a tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Getting quotas for user 95956d2e4ea84534b6d5628eb8dd184d and project acc12d15daf34c5e9d26a6cc53795efe. Resources: {'cores', 'instances', 'ram'} {{(pid=61318) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 10:56:34 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-a82dd866-9e37-47da-8db9-c3e084848b4a tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Going to run 1 instances... {{(pid=61318) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 10:56:34 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-a82dd866-9e37-47da-8db9-c3e084848b4a tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] [instance: 595d41a4-9a01-4aa2-96a1-c2c763475184] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3b29a01a-1fc0-4d0d-89fb-23d22b2de02e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61318) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 10:56:34 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-a82dd866-9e37-47da-8db9-c3e084848b4a tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.706553 Apr 21 10:56:34 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 110/329] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 10:56:34 2023] POST /compute/v2.1/servers => generated 378 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 10:56:35 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_api:SELECT=16 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:56:35 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell1:SELECT=22 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:56:35 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-25cdd63d-e8ed-43d8-9bcf-14caed74baa6 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:56:35 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-25cdd63d-e8ed-43d8-9bcf-14caed74baa6 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] [instance: 595d41a4-9a01-4aa2-96a1-c2c763475184] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:56:35 user devstack@n-api.service[61319]: DEBUG nova.policy [None req-25cdd63d-e8ed-43d8-9bcf-14caed74baa6 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95956d2e4ea84534b6d5628eb8dd184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc12d15daf34c5e9d26a6cc53795efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61319) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:56:35 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-25cdd63d-e8ed-43d8-9bcf-14caed74baa6 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] 10.0.0.210 "GET /compute/v2.1/servers/595d41a4-9a01-4aa2-96a1-c2c763475184" status: 200 len: 1211 microversion: 2.1 time: 0.094167 Apr 21 10:56:35 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 110/330] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:56:35 2023] GET /compute/v2.1/servers/595d41a4-9a01-4aa2-96a1-c2c763475184 => generated 1211 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:56:37 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [req-25e5f47c-9f3f-47c7-b694-bc5617756697 req-537c5212-a301-4dd7-b881-178d9baaa154 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "595d41a4-9a01-4aa2-96a1-c2c763475184", "tag": "eb0b0125-965b-4825-aab1-3ba81be44c2f"}]} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:56:37 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_api:SELECT=2 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:56:37 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell1:SELECT=2 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:56:37 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-25e5f47c-9f3f-47c7-b694-bc5617756697 req-537c5212-a301-4dd7-b881-178d9baaa154 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:56:37 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-25e5f47c-9f3f-47c7-b694-bc5617756697 req-537c5212-a301-4dd7-b881-178d9baaa154 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:56:37 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-25e5f47c-9f3f-47c7-b694-bc5617756697 req-537c5212-a301-4dd7-b881-178d9baaa154 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:56:37 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-25e5f47c-9f3f-47c7-b694-bc5617756697 req-537c5212-a301-4dd7-b881-178d9baaa154 service nova] Creating event network-changed:eb0b0125-965b-4825-aab1-3ba81be44c2f for instance 595d41a4-9a01-4aa2-96a1-c2c763475184 on user Apr 21 10:56:37 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [req-25e5f47c-9f3f-47c7-b694-bc5617756697 req-537c5212-a301-4dd7-b881-178d9baaa154 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035523 Apr 21 10:56:37 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 111/331] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:56:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:56:38 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-2c6c9a1c-76f8-429b-afa5-20a74016054d tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:56:38 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-2c6c9a1c-76f8-429b-afa5-20a74016054d tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] [instance: f3e0bc01-1cf2-4ff9-bec6-12a37e44171c] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:56:38 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-2c6c9a1c-76f8-429b-afa5-20a74016054d tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:56:38 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-2c6c9a1c-76f8-429b-afa5-20a74016054d tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:56:38 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-2c6c9a1c-76f8-429b-afa5-20a74016054d tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:56:38 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-2c6c9a1c-76f8-429b-afa5-20a74016054d tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:56:38 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-2c6c9a1c-76f8-429b-afa5-20a74016054d tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:56:38 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-2c6c9a1c-76f8-429b-afa5-20a74016054d tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:56:38 user devstack@n-api.service[61318]: INFO nova.api.openstack.wsgi [None req-2c6c9a1c-76f8-429b-afa5-20a74016054d tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] HTTP exception thrown: Instance f3e0bc01-1cf2-4ff9-bec6-12a37e44171c could not be found. Apr 21 10:56:38 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-2c6c9a1c-76f8-429b-afa5-20a74016054d tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Request method failure captured: Apr 21 10:56:38 user devstack@n-api.service[61318]: request: GET /compute/v2.1/servers/f3e0bc01-1cf2-4ff9-bec6-12a37e44171c HTTP/1.1 Apr 21 10:56:38 user devstack@n-api.service[61318]: Accept: application/json Apr 21 10:56:38 user devstack@n-api.service[61318]: Accept-Encoding: identity Apr 21 10:56:38 user devstack@n-api.service[61318]: Connection: close Apr 21 10:56:38 user devstack@n-api.service[61318]: Content-Length: 0 Apr 21 10:56:38 user devstack@n-api.service[61318]: Content-Type: application/json Apr 21 10:56:38 user devstack@n-api.service[61318]: Host: 10.0.0.210 Apr 21 10:56:38 user devstack@n-api.service[61318]: Openstack-System-Scope: None Apr 21 10:56:38 user devstack@n-api.service[61318]: User-Agent: python-urllib3/1.26.15 Apr 21 10:56:38 user devstack@n-api.service[61318]: X-Auth-Token: gAAAAABkQmqTJb4gMatwFnGNZlEDIlfd2J8GQxQYyUXpY8O4FjwKkGMA6MEjQ9zanV23iBtQM1YgNv-SkAJx50lUr5RFpX3B85mtI2vi-WZrRejfUDAggOOcMJYyCCkREc-9sOjPd5a1WnwIaad-Pm9bQOQ0tH_LCJnlRjHS-76kP0uJnY1Uk18 Apr 21 10:56:38 user devstack@n-api.service[61318]: X-Domain-Id: None Apr 21 10:56:38 user devstack@n-api.service[61318]: X-Domain-Name: None Apr 21 10:56:38 user devstack@n-api.service[61318]: X-Identity-Status: Confirmed Apr 21 10:56:38 user devstack@n-api.service[61318]: X-Is-Admin-Project: True Apr 21 10:56:38 user devstack@n-api.service[61318]: X-Project-Domain-Id: default Apr 21 10:56:38 user devstack@n-api.service[61318]: X-Project-Domain-Name: Default Apr 21 10:56:38 user devstack@n-api.service[61318]: X-Project-Id: 9ead44a7da0640cbb2cf8dece0ea4f40 Apr 21 10:56:38 user devstack@n-api.service[61318]: X-Project-Name: tempest-TestMinimumBasicScenario-339882477 Apr 21 10:56:38 user devstack@n-api.service[61318]: X-Role: reader,member Apr 21 10:56:38 user devstack@n-api.service[61318]: X-Roles: reader,member Apr 21 10:56:38 user devstack@n-api.service[61318]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9ead44a7da0640cbb2cf8dece0ea4f40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9ead44a7da0640cbb2cf8dece0ea4f40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9ead44a7da0640cbb2cf8dece0ea4f40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 10:56:38 user devstack@n-api.service[61318]: X-Tenant: tempest-TestMinimumBasicScenario-339882477 Apr 21 10:56:38 user devstack@n-api.service[61318]: X-Tenant-Id: 9ead44a7da0640cbb2cf8dece0ea4f40 Apr 21 10:56:38 user devstack@n-api.service[61318]: X-Tenant-Name: tempest-TestMinimumBasicScenario-339882477 Apr 21 10:56:38 user devstack@n-api.service[61318]: X-User: tempest-TestMinimumBasicScenario-339882477-project-member Apr 21 10:56:38 user devstack@n-api.service[61318]: X-User-Domain-Id: default Apr 21 10:56:38 user devstack@n-api.service[61318]: X-User-Domain-Name: Default Apr 21 10:56:38 user devstack@n-api.service[61318]: X-User-Id: 6cae5a1734d24ac8aebc233dd31d3084 Apr 21 10:56:38 user devstack@n-api.service[61318]: X-User-Name: tempest-TestMinimumBasicScenario-339882477-project-member Apr 21 10:56:38 user devstack@n-api.service[61318]: method: > Apr 21 10:56:38 user devstack@n-api.service[61318]: exception: Instance f3e0bc01-1cf2-4ff9-bec6-12a37e44171c could not be found. Apr 21 10:56:38 user devstack@n-api.service[61318]: action_args: {'id': 'f3e0bc01-1cf2-4ff9-bec6-12a37e44171c'} Apr 21 10:56:38 user devstack@n-api.service[61318]: {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 10:56:38 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:56:38 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 10:56:38 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 10:56:38 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 10:56:38 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 10:56:38 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 10:56:38 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 10:56:38 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 10:56:38 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 10:56:38 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3e0bc01-1cf2-4ff9-bec6-12a37e44171c could not be found. Apr 21 10:56:38 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:56:38 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:56:38 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:56:38 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:56:38 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 10:56:38 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 10:56:38 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 10:56:38 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 10:56:38 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 10:56:38 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 10:56:38 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 10:56:38 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 10:56:38 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 10:56:38 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 10:56:38 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 10:56:38 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 10:56:38 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3e0bc01-1cf2-4ff9-bec6-12a37e44171c could not be found. Apr 21 10:56:38 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:56:38 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:56:38 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:56:38 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:56:38 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 10:56:38 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 10:56:38 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 10:56:38 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 10:56:38 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3e0bc01-1cf2-4ff9-bec6-12a37e44171c could not be found. Apr 21 10:56:38 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 10:56:38 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-2c6c9a1c-76f8-429b-afa5-20a74016054d tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Returning 404 to user: Instance f3e0bc01-1cf2-4ff9-bec6-12a37e44171c could not be found. {{(pid=61318) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 10:56:38 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-2c6c9a1c-76f8-429b-afa5-20a74016054d tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3e0bc01-1cf2-4ff9-bec6-12a37e44171c" status: 404 len: 111 microversion: 2.1 time: 0.176983 Apr 21 10:56:38 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 111/332] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:56:38 2023] GET /compute/v2.1/servers/f3e0bc01-1cf2-4ff9-bec6-12a37e44171c => generated 111 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 10:56:38 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-6ea71470-365d-422e-807e-93d707599b14 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] Calling method '.version_select at 0x7f91a5ec5d80>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:56:38 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-6ea71470-365d-422e-807e-93d707599b14 tempest-TestMinimumBasicScenario-339882477 tempest-TestMinimumBasicScenario-339882477-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1698854069" status: 202 len: 0 microversion: 2.1 time: 0.025635 Apr 21 10:56:38 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 111/333] 10.0.0.210 () {62 vars in 1349 bytes} [Fri Apr 21 10:56:38 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1698854069 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 10:56:39 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [req-276b9752-4df5-4a73-b49b-63f7ece5ac89 req-1ff1e6fc-979d-449d-87d4-b3bb5a462a0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "595d41a4-9a01-4aa2-96a1-c2c763475184", "name": "network-vif-plugged", "status": "completed", "tag": "eb0b0125-965b-4825-aab1-3ba81be44c2f"}]} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:56:39 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-276b9752-4df5-4a73-b49b-63f7ece5ac89 req-1ff1e6fc-979d-449d-87d4-b3bb5a462a0a service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:56:39 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-276b9752-4df5-4a73-b49b-63f7ece5ac89 req-1ff1e6fc-979d-449d-87d4-b3bb5a462a0a service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:56:39 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-276b9752-4df5-4a73-b49b-63f7ece5ac89 req-1ff1e6fc-979d-449d-87d4-b3bb5a462a0a service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:56:39 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-276b9752-4df5-4a73-b49b-63f7ece5ac89 req-1ff1e6fc-979d-449d-87d4-b3bb5a462a0a service nova] Creating event network-vif-plugged:eb0b0125-965b-4825-aab1-3ba81be44c2f for instance 595d41a4-9a01-4aa2-96a1-c2c763475184 on user Apr 21 10:56:39 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [req-276b9752-4df5-4a73-b49b-63f7ece5ac89 req-1ff1e6fc-979d-449d-87d4-b3bb5a462a0a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031475 Apr 21 10:56:39 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 112/334] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:56:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:56:41 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [req-d94b905a-75d9-48f8-b75c-a2bf059833bd req-ad2ddf72-7c5a-46b3-b180-5be326230140 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "595d41a4-9a01-4aa2-96a1-c2c763475184", "name": "network-vif-plugged", "status": "completed", "tag": "eb0b0125-965b-4825-aab1-3ba81be44c2f"}]} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:56:41 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-d94b905a-75d9-48f8-b75c-a2bf059833bd req-ad2ddf72-7c5a-46b3-b180-5be326230140 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:56:41 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-d94b905a-75d9-48f8-b75c-a2bf059833bd req-ad2ddf72-7c5a-46b3-b180-5be326230140 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:56:41 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-d94b905a-75d9-48f8-b75c-a2bf059833bd req-ad2ddf72-7c5a-46b3-b180-5be326230140 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:56:41 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-d94b905a-75d9-48f8-b75c-a2bf059833bd req-ad2ddf72-7c5a-46b3-b180-5be326230140 service nova] Creating event network-vif-plugged:eb0b0125-965b-4825-aab1-3ba81be44c2f for instance 595d41a4-9a01-4aa2-96a1-c2c763475184 on user Apr 21 10:56:41 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [req-d94b905a-75d9-48f8-b75c-a2bf059833bd req-ad2ddf72-7c5a-46b3-b180-5be326230140 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028303 Apr 21 10:56:41 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 112/335] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:56:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:56:41 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-b7f93487-6c75-4e2c-b906-62a80ec563d7 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:56:41 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-b7f93487-6c75-4e2c-b906-62a80ec563d7 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] [instance: c70df604-601e-4451-828d-20c649b6052a] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:56:41 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-b7f93487-6c75-4e2c-b906-62a80ec563d7 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:56:41 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-b7f93487-6c75-4e2c-b906-62a80ec563d7 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:56:41 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-b7f93487-6c75-4e2c-b906-62a80ec563d7 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:56:41 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-b7f93487-6c75-4e2c-b906-62a80ec563d7 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:56:41 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-b7f93487-6c75-4e2c-b906-62a80ec563d7 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:56:41 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-b7f93487-6c75-4e2c-b906-62a80ec563d7 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:56:42 user devstack@n-api.service[61319]: DEBUG nova.policy [None req-b7f93487-6c75-4e2c-b906-62a80ec563d7 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fc66871488428e9842404d885bcfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bc6b0c20204c8287b3523814007856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61319) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:56:42 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-b7f93487-6c75-4e2c-b906-62a80ec563d7 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c70df604-601e-4451-828d-20c649b6052a" status: 200 len: 1543 microversion: 2.1 time: 0.284125 Apr 21 10:56:42 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 112/336] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:56:41 2023] GET /compute/v2.1/servers/c70df604-601e-4451-828d-20c649b6052a => generated 1543 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:56:57 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_api:SELECT=4 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:56:57 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell1:SELECT=4 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:56:57 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-5168a48d-337b-4076-9d27-c7ee74ea75f4 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:56:57 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-5168a48d-337b-4076-9d27-c7ee74ea75f4 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] [instance: f8609da3-c26d-482a-bc03-017baf4bce22] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:56:57 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-5168a48d-337b-4076-9d27-c7ee74ea75f4 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:56:57 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-5168a48d-337b-4076-9d27-c7ee74ea75f4 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:56:57 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-5168a48d-337b-4076-9d27-c7ee74ea75f4 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:56:57 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-5168a48d-337b-4076-9d27-c7ee74ea75f4 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:56:57 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-5168a48d-337b-4076-9d27-c7ee74ea75f4 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:56:57 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-5168a48d-337b-4076-9d27-c7ee74ea75f4 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:56:57 user devstack@n-api.service[61320]: INFO nova.api.openstack.wsgi [None req-5168a48d-337b-4076-9d27-c7ee74ea75f4 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] HTTP exception thrown: Instance f8609da3-c26d-482a-bc03-017baf4bce22 could not be found. Apr 21 10:56:57 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-5168a48d-337b-4076-9d27-c7ee74ea75f4 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Request method failure captured: Apr 21 10:56:57 user devstack@n-api.service[61320]: request: GET /compute/v2.1/servers/f8609da3-c26d-482a-bc03-017baf4bce22 HTTP/1.1 Apr 21 10:56:57 user devstack@n-api.service[61320]: Accept: application/json Apr 21 10:56:57 user devstack@n-api.service[61320]: Accept-Encoding: identity Apr 21 10:56:57 user devstack@n-api.service[61320]: Connection: close Apr 21 10:56:57 user devstack@n-api.service[61320]: Content-Length: 0 Apr 21 10:56:57 user devstack@n-api.service[61320]: Content-Type: application/json Apr 21 10:56:57 user devstack@n-api.service[61320]: Host: 10.0.0.210 Apr 21 10:56:57 user devstack@n-api.service[61320]: Openstack-System-Scope: None Apr 21 10:56:57 user devstack@n-api.service[61320]: User-Agent: python-urllib3/1.26.15 Apr 21 10:56:57 user devstack@n-api.service[61320]: X-Auth-Token: gAAAAABkQmmqH4SZ9_o-4q5VsFPaKl4IxMJKzU_19R2QmuD0OnAcHkPd3mPOqrzyvSmHRH4fl5pwSRve-R8DeAK9Jeaqb5TxifLZifcvXw5Rbf8OIk1lr0MYA4jbffdN5PZSoWiUuEfz21FreT-uicj8ae0JtANkC8GYlHKgCSdTr3o2bdwpY4I Apr 21 10:56:57 user devstack@n-api.service[61320]: X-Domain-Id: None Apr 21 10:56:57 user devstack@n-api.service[61320]: X-Domain-Name: None Apr 21 10:56:57 user devstack@n-api.service[61320]: X-Identity-Status: Confirmed Apr 21 10:56:57 user devstack@n-api.service[61320]: X-Is-Admin-Project: True Apr 21 10:56:57 user devstack@n-api.service[61320]: X-Project-Domain-Id: default Apr 21 10:56:57 user devstack@n-api.service[61320]: X-Project-Domain-Name: Default Apr 21 10:56:57 user devstack@n-api.service[61320]: X-Project-Id: 648163a728fc4b28b85a24e9198d356b Apr 21 10:56:57 user devstack@n-api.service[61320]: X-Project-Name: tempest-ServerActionsTestJSON-1614287361 Apr 21 10:56:57 user devstack@n-api.service[61320]: X-Role: reader,member Apr 21 10:56:57 user devstack@n-api.service[61320]: X-Roles: reader,member Apr 21 10:56:57 user devstack@n-api.service[61320]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/648163a728fc4b28b85a24e9198d356b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/648163a728fc4b28b85a24e9198d356b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/648163a728fc4b28b85a24e9198d356b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 10:56:57 user devstack@n-api.service[61320]: X-Tenant: tempest-ServerActionsTestJSON-1614287361 Apr 21 10:56:57 user devstack@n-api.service[61320]: X-Tenant-Id: 648163a728fc4b28b85a24e9198d356b Apr 21 10:56:57 user devstack@n-api.service[61320]: X-Tenant-Name: tempest-ServerActionsTestJSON-1614287361 Apr 21 10:56:57 user devstack@n-api.service[61320]: X-User: tempest-ServerActionsTestJSON-1614287361-project-member Apr 21 10:56:57 user devstack@n-api.service[61320]: X-User-Domain-Id: default Apr 21 10:56:57 user devstack@n-api.service[61320]: X-User-Domain-Name: Default Apr 21 10:56:57 user devstack@n-api.service[61320]: X-User-Id: ced216baa4a64c72946cf3f71eb873dd Apr 21 10:56:57 user devstack@n-api.service[61320]: X-User-Name: tempest-ServerActionsTestJSON-1614287361-project-member Apr 21 10:56:57 user devstack@n-api.service[61320]: method: > Apr 21 10:56:57 user devstack@n-api.service[61320]: exception: Instance f8609da3-c26d-482a-bc03-017baf4bce22 could not be found. Apr 21 10:56:57 user devstack@n-api.service[61320]: action_args: {'id': 'f8609da3-c26d-482a-bc03-017baf4bce22'} Apr 21 10:56:57 user devstack@n-api.service[61320]: {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 10:56:57 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:56:57 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 10:56:57 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 10:56:57 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 10:56:57 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 10:56:57 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 10:56:57 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 10:56:57 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 10:56:57 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 10:56:57 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8609da3-c26d-482a-bc03-017baf4bce22 could not be found. Apr 21 10:56:57 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:56:57 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:56:57 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:56:57 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:56:57 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 10:56:57 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 10:56:57 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 10:56:57 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 10:56:57 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 10:56:57 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 10:56:57 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 10:56:57 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 10:56:57 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 10:56:57 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 10:56:57 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 10:56:57 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 10:56:57 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8609da3-c26d-482a-bc03-017baf4bce22 could not be found. Apr 21 10:56:57 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:56:57 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:56:57 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:56:57 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:56:57 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 10:56:57 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 10:56:57 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 10:56:57 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 10:56:57 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8609da3-c26d-482a-bc03-017baf4bce22 could not be found. Apr 21 10:56:57 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 10:56:57 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-5168a48d-337b-4076-9d27-c7ee74ea75f4 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Returning 404 to user: Instance f8609da3-c26d-482a-bc03-017baf4bce22 could not be found. {{(pid=61320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 10:56:57 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-5168a48d-337b-4076-9d27-c7ee74ea75f4 tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8609da3-c26d-482a-bc03-017baf4bce22" status: 404 len: 111 microversion: 2.1 time: 0.032785 Apr 21 10:56:57 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 113/337] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:56:57 2023] GET /compute/v2.1/servers/f8609da3-c26d-482a-bc03-017baf4bce22 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 10:56:57 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell0:SELECT=2 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:56:57 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell0:SELECT=6 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:56:57 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:56:57 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell1:SELECT=6 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:56:57 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-4e2e07c1-537b-4538-9775-ef0a08520c4d tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] Calling method '.version_select at 0x7f91a5d51b40>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:56:57 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-4e2e07c1-537b-4538-9775-ef0a08520c4d tempest-ServerActionsTestJSON-1614287361 tempest-ServerActionsTestJSON-1614287361-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1735824251" status: 202 len: 0 microversion: 2.1 time: 0.032371 Apr 21 10:56:57 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 113/338] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 21 10:56:57 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1735824251 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 10:57:08 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell0:SELECT=2 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:57:08 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:57:09 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell1:SELECT=6 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:57:09 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-7cdc0be1-c923-476e-b012-e3f6cd0b8d95 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1050316627", "imageRef": "3b29a01a-1fc0-4d0d-89fb-23d22b2de02e", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:57:09 user devstack@n-api.service[61319]: DEBUG nova.network.neutron [None req-7cdc0be1-c923-476e-b012-e3f6cd0b8d95 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] validate_networks() for [('72777f52-fe61-4f05-b2c6-5edb74fb3138', None, None, None, None, None)] {{(pid=61319) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 10:57:09 user devstack@n-api.service[61319]: DEBUG nova.virt.hardware [None req-7cdc0be1-c923-476e-b012-e3f6cd0b8d95 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Flavor limits 0:0:0 {{(pid=61319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 10:57:09 user devstack@n-api.service[61319]: DEBUG nova.virt.hardware [None req-7cdc0be1-c923-476e-b012-e3f6cd0b8d95 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Image limits 0:0:0 {{(pid=61319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 10:57:09 user devstack@n-api.service[61319]: DEBUG nova.virt.hardware [None req-7cdc0be1-c923-476e-b012-e3f6cd0b8d95 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Flavor pref 0:0:0 {{(pid=61319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 10:57:09 user devstack@n-api.service[61319]: DEBUG nova.virt.hardware [None req-7cdc0be1-c923-476e-b012-e3f6cd0b8d95 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Image pref 0:0:0 {{(pid=61319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 10:57:09 user devstack@n-api.service[61319]: DEBUG nova.virt.hardware [None req-7cdc0be1-c923-476e-b012-e3f6cd0b8d95 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 10:57:09 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-7cdc0be1-c923-476e-b012-e3f6cd0b8d95 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:57:09 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-7cdc0be1-c923-476e-b012-e3f6cd0b8d95 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:57:09 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-7cdc0be1-c923-476e-b012-e3f6cd0b8d95 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:57:09 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-7cdc0be1-c923-476e-b012-e3f6cd0b8d95 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:57:09 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-7cdc0be1-c923-476e-b012-e3f6cd0b8d95 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:57:09 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-7cdc0be1-c923-476e-b012-e3f6cd0b8d95 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:57:09 user devstack@n-api.service[61319]: DEBUG nova.quota [None req-7cdc0be1-c923-476e-b012-e3f6cd0b8d95 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Getting quotas for project c0a611b8a8d54522929c37807054b2f6. Resources: {'cores', 'instances', 'ram'} {{(pid=61319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 10:57:09 user devstack@n-api.service[61319]: DEBUG nova.quota [None req-7cdc0be1-c923-476e-b012-e3f6cd0b8d95 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Getting quotas for user 0f73ac02062c4411bde0c97f6a719926 and project c0a611b8a8d54522929c37807054b2f6. Resources: {'cores', 'instances', 'ram'} {{(pid=61319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 10:57:09 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-7cdc0be1-c923-476e-b012-e3f6cd0b8d95 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Going to run 1 instances... {{(pid=61319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 10:57:09 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-7cdc0be1-c923-476e-b012-e3f6cd0b8d95 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] [instance: 476dbf2e-b02a-47bc-a8c6-6d0d66d5d433] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3b29a01a-1fc0-4d0d-89fb-23d22b2de02e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 10:57:09 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-7cdc0be1-c923-476e-b012-e3f6cd0b8d95 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.732382 Apr 21 10:57:09 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 113/339] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 10:57:08 2023] POST /compute/v2.1/servers => generated 381 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 10:57:09 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-4f254e60-8438-42d1-9178-1c18740f6ff3 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:57:09 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-4f254e60-8438-42d1-9178-1c18740f6ff3 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] [instance: 476dbf2e-b02a-47bc-a8c6-6d0d66d5d433] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:57:09 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_api:SELECT=2 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:57:09 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell1:SELECT=2 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:57:09 user devstack@n-api.service[61320]: DEBUG nova.policy [None req-4f254e60-8438-42d1-9178-1c18740f6ff3 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f73ac02062c4411bde0c97f6a719926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a611b8a8d54522929c37807054b2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61320) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:57:09 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-4f254e60-8438-42d1-9178-1c18740f6ff3 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] 10.0.0.210 "GET /compute/v2.1/servers/476dbf2e-b02a-47bc-a8c6-6d0d66d5d433" status: 200 len: 1216 microversion: 2.1 time: 0.117504 Apr 21 10:57:09 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 114/340] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:57:09 2023] GET /compute/v2.1/servers/476dbf2e-b02a-47bc-a8c6-6d0d66d5d433 => generated 1216 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:57:09 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:57:09 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-f674a2a2-76ef-4a7e-87c7-6690f36e17b2 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-6822012", "imageRef": "3b29a01a-1fc0-4d0d-89fb-23d22b2de02e", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:57:10 user devstack@n-api.service[61318]: DEBUG nova.network.neutron [None req-f674a2a2-76ef-4a7e-87c7-6690f36e17b2 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] validate_networks() for [('72777f52-fe61-4f05-b2c6-5edb74fb3138', None, None, None, None, None)] {{(pid=61318) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 10:57:10 user devstack@n-api.service[61318]: DEBUG nova.virt.hardware [None req-f674a2a2-76ef-4a7e-87c7-6690f36e17b2 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Flavor limits 0:0:0 {{(pid=61318) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 10:57:10 user devstack@n-api.service[61318]: DEBUG nova.virt.hardware [None req-f674a2a2-76ef-4a7e-87c7-6690f36e17b2 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Image limits 0:0:0 {{(pid=61318) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 10:57:10 user devstack@n-api.service[61318]: DEBUG nova.virt.hardware [None req-f674a2a2-76ef-4a7e-87c7-6690f36e17b2 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Flavor pref 0:0:0 {{(pid=61318) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 10:57:10 user devstack@n-api.service[61318]: DEBUG nova.virt.hardware [None req-f674a2a2-76ef-4a7e-87c7-6690f36e17b2 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Image pref 0:0:0 {{(pid=61318) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 10:57:10 user devstack@n-api.service[61318]: DEBUG nova.virt.hardware [None req-f674a2a2-76ef-4a7e-87c7-6690f36e17b2 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61318) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 10:57:10 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-f674a2a2-76ef-4a7e-87c7-6690f36e17b2 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:57:10 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-f674a2a2-76ef-4a7e-87c7-6690f36e17b2 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:57:10 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-f674a2a2-76ef-4a7e-87c7-6690f36e17b2 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:57:10 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-f674a2a2-76ef-4a7e-87c7-6690f36e17b2 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:57:10 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-f674a2a2-76ef-4a7e-87c7-6690f36e17b2 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:57:10 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-f674a2a2-76ef-4a7e-87c7-6690f36e17b2 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:57:10 user devstack@n-api.service[61318]: DEBUG nova.quota [None req-f674a2a2-76ef-4a7e-87c7-6690f36e17b2 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Getting quotas for project c0a611b8a8d54522929c37807054b2f6. Resources: {'cores', 'instances', 'ram'} {{(pid=61318) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 10:57:10 user devstack@n-api.service[61318]: DEBUG nova.quota [None req-f674a2a2-76ef-4a7e-87c7-6690f36e17b2 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Getting quotas for user 0f73ac02062c4411bde0c97f6a719926 and project c0a611b8a8d54522929c37807054b2f6. Resources: {'cores', 'instances', 'ram'} {{(pid=61318) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 10:57:10 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-f674a2a2-76ef-4a7e-87c7-6690f36e17b2 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Going to run 1 instances... {{(pid=61318) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 10:57:10 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-f674a2a2-76ef-4a7e-87c7-6690f36e17b2 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] [instance: d1fca309-1d26-4a34-b932-716064b86b00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3b29a01a-1fc0-4d0d-89fb-23d22b2de02e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61318) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 10:57:10 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-f674a2a2-76ef-4a7e-87c7-6690f36e17b2 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.736210 Apr 21 10:57:10 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 114/341] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 10:57:09 2023] POST /compute/v2.1/servers => generated 381 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 10:57:10 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-6469a55d-6e65-44ce-a0ea-a94a6bb17082 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:57:10 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-6469a55d-6e65-44ce-a0ea-a94a6bb17082 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] [instance: d1fca309-1d26-4a34-b932-716064b86b00] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:57:10 user devstack@n-api.service[61319]: DEBUG nova.policy [None req-6469a55d-6e65-44ce-a0ea-a94a6bb17082 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f73ac02062c4411bde0c97f6a719926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a611b8a8d54522929c37807054b2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61319) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:57:10 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-6469a55d-6e65-44ce-a0ea-a94a6bb17082 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d1fca309-1d26-4a34-b932-716064b86b00" status: 200 len: 1213 microversion: 2.1 time: 0.066900 Apr 21 10:57:10 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 114/342] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:57:10 2023] GET /compute/v2.1/servers/d1fca309-1d26-4a34-b932-716064b86b00 => generated 1213 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:57:12 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [req-a1d1edcf-51cd-4cc9-92e9-055ec99eea3f req-bbfc9c6b-aa5a-4923-abc5-2d427bd8b9ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "476dbf2e-b02a-47bc-a8c6-6d0d66d5d433", "tag": "fb82372c-8c1a-43e8-9eba-5f5469b8ac66"}]} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:57:12 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-a1d1edcf-51cd-4cc9-92e9-055ec99eea3f req-bbfc9c6b-aa5a-4923-abc5-2d427bd8b9ca service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:57:12 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-a1d1edcf-51cd-4cc9-92e9-055ec99eea3f req-bbfc9c6b-aa5a-4923-abc5-2d427bd8b9ca service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:57:12 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-a1d1edcf-51cd-4cc9-92e9-055ec99eea3f req-bbfc9c6b-aa5a-4923-abc5-2d427bd8b9ca service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:57:12 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-a1d1edcf-51cd-4cc9-92e9-055ec99eea3f req-bbfc9c6b-aa5a-4923-abc5-2d427bd8b9ca service nova] Creating event network-changed:fb82372c-8c1a-43e8-9eba-5f5469b8ac66 for instance 476dbf2e-b02a-47bc-a8c6-6d0d66d5d433 on user Apr 21 10:57:12 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [req-a1d1edcf-51cd-4cc9-92e9-055ec99eea3f req-bbfc9c6b-aa5a-4923-abc5-2d427bd8b9ca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028141 Apr 21 10:57:12 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 115/343] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:57:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:57:14 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [req-e0e04265-ea6e-4d1b-ac6f-5be79f2782ab req-9952e3b5-30a0-4e95-b1ff-8fdad6bd2064 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1fca309-1d26-4a34-b932-716064b86b00", "tag": "8abc9260-fa02-4915-a056-63262b57e3be"}]} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:57:14 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-e0e04265-ea6e-4d1b-ac6f-5be79f2782ab req-9952e3b5-30a0-4e95-b1ff-8fdad6bd2064 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:57:14 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-e0e04265-ea6e-4d1b-ac6f-5be79f2782ab req-9952e3b5-30a0-4e95-b1ff-8fdad6bd2064 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:57:14 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-e0e04265-ea6e-4d1b-ac6f-5be79f2782ab req-9952e3b5-30a0-4e95-b1ff-8fdad6bd2064 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:57:14 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-e0e04265-ea6e-4d1b-ac6f-5be79f2782ab req-9952e3b5-30a0-4e95-b1ff-8fdad6bd2064 service nova] Creating event network-changed:8abc9260-fa02-4915-a056-63262b57e3be for instance d1fca309-1d26-4a34-b932-716064b86b00 on user Apr 21 10:57:14 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [req-e0e04265-ea6e-4d1b-ac6f-5be79f2782ab req-9952e3b5-30a0-4e95-b1ff-8fdad6bd2064 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029788 Apr 21 10:57:14 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 115/344] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:57:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:57:16 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-ea573502-067d-43d8-ba9a-205bd666c889 req-1324fa70-ae94-448e-bb7f-6c269b2d4c54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1fca309-1d26-4a34-b932-716064b86b00", "name": "network-vif-plugged", "status": "completed", "tag": "8abc9260-fa02-4915-a056-63262b57e3be"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:57:16 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-ea573502-067d-43d8-ba9a-205bd666c889 req-1324fa70-ae94-448e-bb7f-6c269b2d4c54 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:57:16 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-ea573502-067d-43d8-ba9a-205bd666c889 req-1324fa70-ae94-448e-bb7f-6c269b2d4c54 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:57:16 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-ea573502-067d-43d8-ba9a-205bd666c889 req-1324fa70-ae94-448e-bb7f-6c269b2d4c54 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:57:16 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-ea573502-067d-43d8-ba9a-205bd666c889 req-1324fa70-ae94-448e-bb7f-6c269b2d4c54 service nova] Creating event network-vif-plugged:8abc9260-fa02-4915-a056-63262b57e3be for instance d1fca309-1d26-4a34-b932-716064b86b00 on user Apr 21 10:57:16 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-ea573502-067d-43d8-ba9a-205bd666c889 req-1324fa70-ae94-448e-bb7f-6c269b2d4c54 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034501 Apr 21 10:57:16 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 115/345] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:57:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:57:16 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [req-d0d8a8ad-a6f5-42f2-9e80-f62ebf30e192 req-2601674b-3b94-404c-b2cb-941f991bdc16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "476dbf2e-b02a-47bc-a8c6-6d0d66d5d433", "name": "network-vif-plugged", "status": "completed", "tag": "fb82372c-8c1a-43e8-9eba-5f5469b8ac66"}, {"server_uuid": "476dbf2e-b02a-47bc-a8c6-6d0d66d5d433", "name": "network-vif-plugged", "status": "completed", "tag": "fb82372c-8c1a-43e8-9eba-5f5469b8ac66"}]} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:57:16 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-d0d8a8ad-a6f5-42f2-9e80-f62ebf30e192 req-2601674b-3b94-404c-b2cb-941f991bdc16 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:57:16 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-d0d8a8ad-a6f5-42f2-9e80-f62ebf30e192 req-2601674b-3b94-404c-b2cb-941f991bdc16 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:57:16 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-d0d8a8ad-a6f5-42f2-9e80-f62ebf30e192 req-2601674b-3b94-404c-b2cb-941f991bdc16 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:57:17 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-d0d8a8ad-a6f5-42f2-9e80-f62ebf30e192 req-2601674b-3b94-404c-b2cb-941f991bdc16 service nova] Creating event network-vif-plugged:fb82372c-8c1a-43e8-9eba-5f5469b8ac66 for instance 476dbf2e-b02a-47bc-a8c6-6d0d66d5d433 on user Apr 21 10:57:17 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-d0d8a8ad-a6f5-42f2-9e80-f62ebf30e192 req-2601674b-3b94-404c-b2cb-941f991bdc16 service nova] Creating event network-vif-plugged:fb82372c-8c1a-43e8-9eba-5f5469b8ac66 for instance 476dbf2e-b02a-47bc-a8c6-6d0d66d5d433 on user Apr 21 10:57:17 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [req-d0d8a8ad-a6f5-42f2-9e80-f62ebf30e192 req-2601674b-3b94-404c-b2cb-941f991bdc16 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038830 Apr 21 10:57:17 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 116/346] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:57:16 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:57:18 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [req-51b6dd0b-b340-46da-8156-1489881872a7 req-9827126e-b236-4968-887f-a7adc17d5625 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1fca309-1d26-4a34-b932-716064b86b00", "name": "network-vif-plugged", "status": "completed", "tag": "8abc9260-fa02-4915-a056-63262b57e3be"}]} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:57:18 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-51b6dd0b-b340-46da-8156-1489881872a7 req-9827126e-b236-4968-887f-a7adc17d5625 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:57:18 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-51b6dd0b-b340-46da-8156-1489881872a7 req-9827126e-b236-4968-887f-a7adc17d5625 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:57:18 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-51b6dd0b-b340-46da-8156-1489881872a7 req-9827126e-b236-4968-887f-a7adc17d5625 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:57:18 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-51b6dd0b-b340-46da-8156-1489881872a7 req-9827126e-b236-4968-887f-a7adc17d5625 service nova] Creating event network-vif-plugged:8abc9260-fa02-4915-a056-63262b57e3be for instance d1fca309-1d26-4a34-b932-716064b86b00 on user Apr 21 10:57:18 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [req-51b6dd0b-b340-46da-8156-1489881872a7 req-9827126e-b236-4968-887f-a7adc17d5625 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035222 Apr 21 10:57:18 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 116/347] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:57:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:57:25 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-93f95a38-91d8-4e8f-acc8-f8fd4531a690 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:57:25 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-93f95a38-91d8-4e8f-acc8-f8fd4531a690 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] [instance: 595d41a4-9a01-4aa2-96a1-c2c763475184] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:57:25 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell0:SELECT=2 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:57:25 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell0:SELECT=8 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:57:25 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-93f95a38-91d8-4e8f-acc8-f8fd4531a690 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:57:25 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-93f95a38-91d8-4e8f-acc8-f8fd4531a690 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:57:25 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-93f95a38-91d8-4e8f-acc8-f8fd4531a690 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:57:25 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-93f95a38-91d8-4e8f-acc8-f8fd4531a690 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:57:25 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-93f95a38-91d8-4e8f-acc8-f8fd4531a690 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:57:25 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-93f95a38-91d8-4e8f-acc8-f8fd4531a690 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:57:25 user devstack@n-api.service[61319]: DEBUG nova.policy [None req-93f95a38-91d8-4e8f-acc8-f8fd4531a690 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95956d2e4ea84534b6d5628eb8dd184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc12d15daf34c5e9d26a6cc53795efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61319) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:57:25 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-93f95a38-91d8-4e8f-acc8-f8fd4531a690 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] 10.0.0.210 "GET /compute/v2.1/servers/595d41a4-9a01-4aa2-96a1-c2c763475184" status: 200 len: 1494 microversion: 2.1 time: 0.248960 Apr 21 10:57:25 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 116/348] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:57:25 2023] GET /compute/v2.1/servers/595d41a4-9a01-4aa2-96a1-c2c763475184 => generated 1494 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:57:42 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell0:SELECT=2 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:57:42 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_api:SELECT=8 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:57:42 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell1:SELECT=4 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:57:42 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-a7a730ee-ee59-4b71-86f2-a3e1e176f705 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:57:42 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-a7a730ee-ee59-4b71-86f2-a3e1e176f705 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] [instance: c70df604-601e-4451-828d-20c649b6052a] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:57:42 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-a7a730ee-ee59-4b71-86f2-a3e1e176f705 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:57:42 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-a7a730ee-ee59-4b71-86f2-a3e1e176f705 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:57:42 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-a7a730ee-ee59-4b71-86f2-a3e1e176f705 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:57:42 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-a7a730ee-ee59-4b71-86f2-a3e1e176f705 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:57:42 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-a7a730ee-ee59-4b71-86f2-a3e1e176f705 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:57:42 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-a7a730ee-ee59-4b71-86f2-a3e1e176f705 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:57:42 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-a7a730ee-ee59-4b71-86f2-a3e1e176f705 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c70df604-601e-4451-828d-20c649b6052a/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.168005 Apr 21 10:57:42 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 117/349] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 21 10:57:42 2023] GET /compute/v2.1/servers/c70df604-601e-4451-828d-20c649b6052a/os-interface => generated 282 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:57:43 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell0:SELECT=2 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:57:43 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell0:SELECT=6 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:57:43 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:57:43 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell1:SELECT=6 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:57:43 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-9c1d3f7c-3373-4959-9dac-c2ab3df5be09 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:57:43 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-9c1d3f7c-3373-4959-9dac-c2ab3df5be09 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] [instance: c70df604-601e-4451-828d-20c649b6052a] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:57:43 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [req-226980fa-d787-49f6-84e8-cfb64cc6030d req-9f7d12ee-6219-4974-ba1a-6fd05dbb95b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c70df604-601e-4451-828d-20c649b6052a", "tag": "5751ca80-5041-4999-b832-b427fb0af8a2"}]} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:57:43 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:57:43 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell1:SELECT=10 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:57:43 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-9c1d3f7c-3373-4959-9dac-c2ab3df5be09 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:57:43 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-9c1d3f7c-3373-4959-9dac-c2ab3df5be09 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:57:43 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-9c1d3f7c-3373-4959-9dac-c2ab3df5be09 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:57:43 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-9c1d3f7c-3373-4959-9dac-c2ab3df5be09 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:57:43 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-9c1d3f7c-3373-4959-9dac-c2ab3df5be09 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:57:43 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-9c1d3f7c-3373-4959-9dac-c2ab3df5be09 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:57:43 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-226980fa-d787-49f6-84e8-cfb64cc6030d req-9f7d12ee-6219-4974-ba1a-6fd05dbb95b4 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:57:43 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-226980fa-d787-49f6-84e8-cfb64cc6030d req-9f7d12ee-6219-4974-ba1a-6fd05dbb95b4 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:57:43 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-226980fa-d787-49f6-84e8-cfb64cc6030d req-9f7d12ee-6219-4974-ba1a-6fd05dbb95b4 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:57:43 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-226980fa-d787-49f6-84e8-cfb64cc6030d req-9f7d12ee-6219-4974-ba1a-6fd05dbb95b4 service nova] Creating event network-changed:5751ca80-5041-4999-b832-b427fb0af8a2 for instance c70df604-601e-4451-828d-20c649b6052a on user Apr 21 10:57:43 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [req-226980fa-d787-49f6-84e8-cfb64cc6030d req-9f7d12ee-6219-4974-ba1a-6fd05dbb95b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097377 Apr 21 10:57:43 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 117/350] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:57:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:57:43 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-9c1d3f7c-3373-4959-9dac-c2ab3df5be09 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c70df604-601e-4451-828d-20c649b6052a/ips" status: 200 len: 107 microversion: 2.1 time: 0.040160 Apr 21 10:57:43 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 117/351] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 21 10:57:43 2023] GET /compute/v2.1/servers/c70df604-601e-4451-828d-20c649b6052a/ips => generated 107 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:57:44 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-6b6e9085-05a2-4e48-9507-4cdca1d4b200 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:57:44 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-6b6e9085-05a2-4e48-9507-4cdca1d4b200 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] [instance: c70df604-601e-4451-828d-20c649b6052a] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:57:44 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-6b6e9085-05a2-4e48-9507-4cdca1d4b200 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:57:44 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-6b6e9085-05a2-4e48-9507-4cdca1d4b200 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:57:44 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-6b6e9085-05a2-4e48-9507-4cdca1d4b200 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:57:44 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-6b6e9085-05a2-4e48-9507-4cdca1d4b200 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:57:44 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-6b6e9085-05a2-4e48-9507-4cdca1d4b200 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:57:44 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-6b6e9085-05a2-4e48-9507-4cdca1d4b200 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:57:44 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-6b6e9085-05a2-4e48-9507-4cdca1d4b200 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] [instance: c70df604-601e-4451-828d-20c649b6052a] Going to try to terminate instance {{(pid=61320) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 10:57:44 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-6b6e9085-05a2-4e48-9507-4cdca1d4b200 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c70df604-601e-4451-828d-20c649b6052a" status: 204 len: 0 microversion: 2.1 time: 0.113955 Apr 21 10:57:44 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 118/352] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 10:57:44 2023] DELETE /compute/v2.1/servers/c70df604-601e-4451-828d-20c649b6052a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 10:57:44 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-67f1b455-9ed1-4dd1-a463-197d427acaba tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:57:44 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-67f1b455-9ed1-4dd1-a463-197d427acaba tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] [instance: c70df604-601e-4451-828d-20c649b6052a] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:57:44 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-67f1b455-9ed1-4dd1-a463-197d427acaba tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:57:44 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-67f1b455-9ed1-4dd1-a463-197d427acaba tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:57:44 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-67f1b455-9ed1-4dd1-a463-197d427acaba tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:57:44 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-67f1b455-9ed1-4dd1-a463-197d427acaba tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:57:44 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-67f1b455-9ed1-4dd1-a463-197d427acaba tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:57:44 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-67f1b455-9ed1-4dd1-a463-197d427acaba tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:57:45 user devstack@n-api.service[61318]: DEBUG nova.policy [None req-67f1b455-9ed1-4dd1-a463-197d427acaba tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fc66871488428e9842404d885bcfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bc6b0c20204c8287b3523814007856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61318) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:57:45 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-67f1b455-9ed1-4dd1-a463-197d427acaba tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c70df604-601e-4451-828d-20c649b6052a" status: 200 len: 1667 microversion: 2.1 time: 0.356577 Apr 21 10:57:45 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 118/353] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:57:44 2023] GET /compute/v2.1/servers/c70df604-601e-4451-828d-20c649b6052a => generated 1667 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:57:45 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-71370ddf-2cc0-462a-90cb-44bba6f9b095 req-d61f3e69-6b45-4315-ae7e-6cb685354721 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c70df604-601e-4451-828d-20c649b6052a", "name": "network-vif-unplugged", "status": "completed", "tag": "5751ca80-5041-4999-b832-b427fb0af8a2"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:57:45 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-71370ddf-2cc0-462a-90cb-44bba6f9b095 req-d61f3e69-6b45-4315-ae7e-6cb685354721 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:57:45 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-71370ddf-2cc0-462a-90cb-44bba6f9b095 req-d61f3e69-6b45-4315-ae7e-6cb685354721 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:57:45 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-71370ddf-2cc0-462a-90cb-44bba6f9b095 req-d61f3e69-6b45-4315-ae7e-6cb685354721 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:57:45 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-71370ddf-2cc0-462a-90cb-44bba6f9b095 req-d61f3e69-6b45-4315-ae7e-6cb685354721 service nova] Creating event network-vif-unplugged:5751ca80-5041-4999-b832-b427fb0af8a2 for instance c70df604-601e-4451-828d-20c649b6052a on user Apr 21 10:57:45 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-71370ddf-2cc0-462a-90cb-44bba6f9b095 req-d61f3e69-6b45-4315-ae7e-6cb685354721 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044610 Apr 21 10:57:45 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 118/354] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:57:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:57:46 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [req-1ccf935a-9a5e-4b90-a9d7-0144934648ae req-b1ed3832-30c0-4115-914d-1184d4bf4d51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c70df604-601e-4451-828d-20c649b6052a", "name": "network-vif-deleted", "tag": "5751ca80-5041-4999-b832-b427fb0af8a2"}]} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:57:46 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-1ccf935a-9a5e-4b90-a9d7-0144934648ae req-b1ed3832-30c0-4115-914d-1184d4bf4d51 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:57:46 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-1ccf935a-9a5e-4b90-a9d7-0144934648ae req-b1ed3832-30c0-4115-914d-1184d4bf4d51 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:57:46 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-1ccf935a-9a5e-4b90-a9d7-0144934648ae req-b1ed3832-30c0-4115-914d-1184d4bf4d51 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:57:46 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-1ccf935a-9a5e-4b90-a9d7-0144934648ae req-b1ed3832-30c0-4115-914d-1184d4bf4d51 service nova] Creating event network-vif-deleted:5751ca80-5041-4999-b832-b427fb0af8a2 for instance c70df604-601e-4451-828d-20c649b6052a on user Apr 21 10:57:46 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [req-1ccf935a-9a5e-4b90-a9d7-0144934648ae req-b1ed3832-30c0-4115-914d-1184d4bf4d51 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028943 Apr 21 10:57:46 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 119/355] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:57:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:57:47 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [req-a2db9593-d669-4c0a-8a41-f4e65845b4d1 req-207ba456-9b57-4b73-bd20-26078c87d73c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c70df604-601e-4451-828d-20c649b6052a", "name": "network-vif-plugged", "status": "completed", "tag": "5751ca80-5041-4999-b832-b427fb0af8a2"}]} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:57:47 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-a2db9593-d669-4c0a-8a41-f4e65845b4d1 req-207ba456-9b57-4b73-bd20-26078c87d73c service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:57:47 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-a2db9593-d669-4c0a-8a41-f4e65845b4d1 req-207ba456-9b57-4b73-bd20-26078c87d73c service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:57:47 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-a2db9593-d669-4c0a-8a41-f4e65845b4d1 req-207ba456-9b57-4b73-bd20-26078c87d73c service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:57:47 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-a2db9593-d669-4c0a-8a41-f4e65845b4d1 req-207ba456-9b57-4b73-bd20-26078c87d73c service nova] Creating event network-vif-plugged:5751ca80-5041-4999-b832-b427fb0af8a2 for instance c70df604-601e-4451-828d-20c649b6052a on user Apr 21 10:57:47 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [req-a2db9593-d669-4c0a-8a41-f4e65845b4d1 req-207ba456-9b57-4b73-bd20-26078c87d73c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027821 Apr 21 10:57:47 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 119/356] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:57:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 10:58:00 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-138e2af1-4c0f-4893-8246-63f39b849614 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:58:00 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-138e2af1-4c0f-4893-8246-63f39b849614 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] [instance: d1fca309-1d26-4a34-b932-716064b86b00] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:58:00 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell1:SELECT=6 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:58:00 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_api:SELECT=4 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:58:00 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-138e2af1-4c0f-4893-8246-63f39b849614 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:58:00 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-138e2af1-4c0f-4893-8246-63f39b849614 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:58:00 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-138e2af1-4c0f-4893-8246-63f39b849614 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:58:00 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-138e2af1-4c0f-4893-8246-63f39b849614 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:58:00 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-138e2af1-4c0f-4893-8246-63f39b849614 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:58:00 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-138e2af1-4c0f-4893-8246-63f39b849614 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:58:01 user devstack@n-api.service[61319]: DEBUG nova.policy [None req-138e2af1-4c0f-4893-8246-63f39b849614 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f73ac02062c4411bde0c97f6a719926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a611b8a8d54522929c37807054b2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61319) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:58:01 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-138e2af1-4c0f-4893-8246-63f39b849614 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d1fca309-1d26-4a34-b932-716064b86b00" status: 200 len: 1501 microversion: 2.1 time: 0.230556 Apr 21 10:58:01 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 119/357] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:58:00 2023] GET /compute/v2.1/servers/d1fca309-1d26-4a34-b932-716064b86b00 => generated 1501 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:58:25 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:58:25 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:58:25 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-b560d37a-d6cc-4113-b53a-2db250bcd42d tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1462598035", "imageRef": "3b29a01a-1fc0-4d0d-89fb-23d22b2de02e", "flavorRef": "42", "networks": [{"uuid": "3e633eed-7c28-4111-849c-3ab0f46c0c5c"}]}} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:58:25 user devstack@n-api.service[61320]: DEBUG nova.network.neutron [None req-b560d37a-d6cc-4113-b53a-2db250bcd42d tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] validate_networks() for [('3e633eed-7c28-4111-849c-3ab0f46c0c5c', None, None, None, None, None)] {{(pid=61320) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 10:58:26 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-b560d37a-d6cc-4113-b53a-2db250bcd42d tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Flavor limits 0:0:0 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 10:58:26 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-b560d37a-d6cc-4113-b53a-2db250bcd42d tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Image limits 0:0:0 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 10:58:26 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-b560d37a-d6cc-4113-b53a-2db250bcd42d tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Flavor pref 0:0:0 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 10:58:26 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-b560d37a-d6cc-4113-b53a-2db250bcd42d tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Image pref 0:0:0 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 10:58:26 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-b560d37a-d6cc-4113-b53a-2db250bcd42d tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 10:58:26 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-b560d37a-d6cc-4113-b53a-2db250bcd42d tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:58:26 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-b560d37a-d6cc-4113-b53a-2db250bcd42d tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:58:26 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-b560d37a-d6cc-4113-b53a-2db250bcd42d tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:58:26 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-b560d37a-d6cc-4113-b53a-2db250bcd42d tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:58:26 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-b560d37a-d6cc-4113-b53a-2db250bcd42d tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:58:26 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-b560d37a-d6cc-4113-b53a-2db250bcd42d tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:58:26 user devstack@n-api.service[61320]: DEBUG nova.quota [None req-b560d37a-d6cc-4113-b53a-2db250bcd42d tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Getting quotas for project acc12d15daf34c5e9d26a6cc53795efe. Resources: {'cores', 'instances', 'ram'} {{(pid=61320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 10:58:26 user devstack@n-api.service[61320]: DEBUG nova.quota [None req-b560d37a-d6cc-4113-b53a-2db250bcd42d tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Getting quotas for user 95956d2e4ea84534b6d5628eb8dd184d and project acc12d15daf34c5e9d26a6cc53795efe. Resources: {'cores', 'instances', 'ram'} {{(pid=61320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 10:58:26 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-b560d37a-d6cc-4113-b53a-2db250bcd42d tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Going to run 1 instances... {{(pid=61320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 10:58:26 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-b560d37a-d6cc-4113-b53a-2db250bcd42d tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] [instance: 32a0063e-076e-4585-981e-fe853499aee3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3b29a01a-1fc0-4d0d-89fb-23d22b2de02e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 10:58:26 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-b560d37a-d6cc-4113-b53a-2db250bcd42d tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.595658 Apr 21 10:58:26 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 120/358] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 10:58:25 2023] POST /compute/v2.1/servers => generated 378 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 10:58:26 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_api:SELECT=6 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:58:26 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell1:SELECT=10 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:58:26 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-47b9bfdd-82b0-4744-847f-b84443819aa1 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:58:26 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-47b9bfdd-82b0-4744-847f-b84443819aa1 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] [instance: 32a0063e-076e-4585-981e-fe853499aee3] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:58:26 user devstack@n-api.service[61318]: DEBUG nova.policy [None req-47b9bfdd-82b0-4744-847f-b84443819aa1 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95956d2e4ea84534b6d5628eb8dd184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc12d15daf34c5e9d26a6cc53795efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61318) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:58:26 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-47b9bfdd-82b0-4744-847f-b84443819aa1 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32a0063e-076e-4585-981e-fe853499aee3" status: 200 len: 1211 microversion: 2.1 time: 0.109649 Apr 21 10:58:26 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 120/359] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:58:26 2023] GET /compute/v2.1/servers/32a0063e-076e-4585-981e-fe853499aee3 => generated 1211 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:58:28 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-d795d514-3df8-490b-be28-fc4953178de6 req-b1519a56-7814-4d39-b176-cd279bfd43ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32a0063e-076e-4585-981e-fe853499aee3", "tag": "3e412892-1f09-4bcc-8126-bf7d69b8b2d2"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:58:28 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_api:SELECT=2 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:58:28 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell1:SELECT=6 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:58:28 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-d795d514-3df8-490b-be28-fc4953178de6 req-b1519a56-7814-4d39-b176-cd279bfd43ce service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:58:28 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-d795d514-3df8-490b-be28-fc4953178de6 req-b1519a56-7814-4d39-b176-cd279bfd43ce service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:58:28 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-d795d514-3df8-490b-be28-fc4953178de6 req-b1519a56-7814-4d39-b176-cd279bfd43ce service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:58:28 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-d795d514-3df8-490b-be28-fc4953178de6 req-b1519a56-7814-4d39-b176-cd279bfd43ce service nova] Creating event network-changed:3e412892-1f09-4bcc-8126-bf7d69b8b2d2 for instance 32a0063e-076e-4585-981e-fe853499aee3 on user Apr 21 10:58:28 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-d795d514-3df8-490b-be28-fc4953178de6 req-b1519a56-7814-4d39-b176-cd279bfd43ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035859 Apr 21 10:58:28 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 120/360] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:58:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:58:31 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [req-23d06e58-bc79-4b2f-8542-c5dc4deda75e req-f544c38f-d7e5-4567-90cf-6be29af8cb7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32a0063e-076e-4585-981e-fe853499aee3", "name": "network-vif-plugged", "status": "completed", "tag": "3e412892-1f09-4bcc-8126-bf7d69b8b2d2"}]} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:58:31 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-23d06e58-bc79-4b2f-8542-c5dc4deda75e req-f544c38f-d7e5-4567-90cf-6be29af8cb7b service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:58:31 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-23d06e58-bc79-4b2f-8542-c5dc4deda75e req-f544c38f-d7e5-4567-90cf-6be29af8cb7b service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:58:31 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-23d06e58-bc79-4b2f-8542-c5dc4deda75e req-f544c38f-d7e5-4567-90cf-6be29af8cb7b service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:58:31 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-23d06e58-bc79-4b2f-8542-c5dc4deda75e req-f544c38f-d7e5-4567-90cf-6be29af8cb7b service nova] Creating event network-vif-plugged:3e412892-1f09-4bcc-8126-bf7d69b8b2d2 for instance 32a0063e-076e-4585-981e-fe853499aee3 on user Apr 21 10:58:31 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [req-23d06e58-bc79-4b2f-8542-c5dc4deda75e req-f544c38f-d7e5-4567-90cf-6be29af8cb7b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100933 Apr 21 10:58:31 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 121/361] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:58:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:58:33 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [req-ee468e2e-4741-4e78-b850-ba6865e3b88a req-0ea32abc-1c77-4fb3-b017-910307a902e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32a0063e-076e-4585-981e-fe853499aee3", "name": "network-vif-plugged", "status": "completed", "tag": "3e412892-1f09-4bcc-8126-bf7d69b8b2d2"}]} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:58:33 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-ee468e2e-4741-4e78-b850-ba6865e3b88a req-0ea32abc-1c77-4fb3-b017-910307a902e5 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:58:33 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-ee468e2e-4741-4e78-b850-ba6865e3b88a req-0ea32abc-1c77-4fb3-b017-910307a902e5 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:58:33 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-ee468e2e-4741-4e78-b850-ba6865e3b88a req-0ea32abc-1c77-4fb3-b017-910307a902e5 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:58:33 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-ee468e2e-4741-4e78-b850-ba6865e3b88a req-0ea32abc-1c77-4fb3-b017-910307a902e5 service nova] Creating event network-vif-plugged:3e412892-1f09-4bcc-8126-bf7d69b8b2d2 for instance 32a0063e-076e-4585-981e-fe853499aee3 on user Apr 21 10:58:33 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [req-ee468e2e-4741-4e78-b850-ba6865e3b88a req-0ea32abc-1c77-4fb3-b017-910307a902e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028932 Apr 21 10:58:33 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 121/362] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:58:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:58:35 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-67bda14c-e121-488e-add4-de934ec47d0e tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:58:35 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-67bda14c-e121-488e-add4-de934ec47d0e tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] [instance: c70df604-601e-4451-828d-20c649b6052a] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:58:35 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-67bda14c-e121-488e-add4-de934ec47d0e tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:58:35 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-67bda14c-e121-488e-add4-de934ec47d0e tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:58:35 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-67bda14c-e121-488e-add4-de934ec47d0e tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:58:35 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-67bda14c-e121-488e-add4-de934ec47d0e tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:58:35 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-67bda14c-e121-488e-add4-de934ec47d0e tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:58:35 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-67bda14c-e121-488e-add4-de934ec47d0e tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:58:35 user devstack@n-api.service[61319]: INFO nova.api.openstack.wsgi [None req-67bda14c-e121-488e-add4-de934ec47d0e tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] HTTP exception thrown: Instance c70df604-601e-4451-828d-20c649b6052a could not be found. Apr 21 10:58:35 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-67bda14c-e121-488e-add4-de934ec47d0e tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Request method failure captured: Apr 21 10:58:35 user devstack@n-api.service[61319]: request: GET /compute/v2.1/servers/c70df604-601e-4451-828d-20c649b6052a HTTP/1.1 Apr 21 10:58:35 user devstack@n-api.service[61319]: Accept: application/json Apr 21 10:58:35 user devstack@n-api.service[61319]: Accept-Encoding: identity Apr 21 10:58:35 user devstack@n-api.service[61319]: Connection: close Apr 21 10:58:35 user devstack@n-api.service[61319]: Content-Length: 0 Apr 21 10:58:35 user devstack@n-api.service[61319]: Content-Type: application/json Apr 21 10:58:35 user devstack@n-api.service[61319]: Host: 10.0.0.210 Apr 21 10:58:35 user devstack@n-api.service[61319]: Openstack-System-Scope: None Apr 21 10:58:35 user devstack@n-api.service[61319]: User-Agent: python-urllib3/1.26.15 Apr 21 10:58:35 user devstack@n-api.service[61319]: X-Auth-Token: gAAAAABkQmsO4Ti6hs69z_6Ogvs4ejj7r0BZKsyfzT9wT_akUX9UJiysHbmUPTFlIxRZV4GzaKcEHtXLtDCyrbqof8A_RuWS8jMqwQkpCNmO8LpbZakx3A5g2MVGEzhF0EvvdFwMh7oY0TESImzQadQsU3RwS-vJMRw092Oq4oo7uZmU7xd_izU Apr 21 10:58:35 user devstack@n-api.service[61319]: X-Domain-Id: None Apr 21 10:58:35 user devstack@n-api.service[61319]: X-Domain-Name: None Apr 21 10:58:35 user devstack@n-api.service[61319]: X-Identity-Status: Confirmed Apr 21 10:58:35 user devstack@n-api.service[61319]: X-Is-Admin-Project: True Apr 21 10:58:35 user devstack@n-api.service[61319]: X-Project-Domain-Id: default Apr 21 10:58:35 user devstack@n-api.service[61319]: X-Project-Domain-Name: Default Apr 21 10:58:35 user devstack@n-api.service[61319]: X-Project-Id: 14bc6b0c20204c8287b3523814007856 Apr 21 10:58:35 user devstack@n-api.service[61319]: X-Project-Name: tempest-AttachVolumeNegativeTest-159654333 Apr 21 10:58:35 user devstack@n-api.service[61319]: X-Role: reader,member Apr 21 10:58:35 user devstack@n-api.service[61319]: X-Roles: reader,member Apr 21 10:58:35 user devstack@n-api.service[61319]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/14bc6b0c20204c8287b3523814007856"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/14bc6b0c20204c8287b3523814007856"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/14bc6b0c20204c8287b3523814007856"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 10:58:35 user devstack@n-api.service[61319]: X-Tenant: tempest-AttachVolumeNegativeTest-159654333 Apr 21 10:58:35 user devstack@n-api.service[61319]: X-Tenant-Id: 14bc6b0c20204c8287b3523814007856 Apr 21 10:58:35 user devstack@n-api.service[61319]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-159654333 Apr 21 10:58:35 user devstack@n-api.service[61319]: X-User: tempest-AttachVolumeNegativeTest-159654333-project-member Apr 21 10:58:35 user devstack@n-api.service[61319]: X-User-Domain-Id: default Apr 21 10:58:35 user devstack@n-api.service[61319]: X-User-Domain-Name: Default Apr 21 10:58:35 user devstack@n-api.service[61319]: X-User-Id: d7fc66871488428e9842404d885bcfe3 Apr 21 10:58:35 user devstack@n-api.service[61319]: X-User-Name: tempest-AttachVolumeNegativeTest-159654333-project-member Apr 21 10:58:35 user devstack@n-api.service[61319]: method: > Apr 21 10:58:35 user devstack@n-api.service[61319]: exception: Instance c70df604-601e-4451-828d-20c649b6052a could not be found. Apr 21 10:58:35 user devstack@n-api.service[61319]: action_args: {'id': 'c70df604-601e-4451-828d-20c649b6052a'} Apr 21 10:58:35 user devstack@n-api.service[61319]: {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 10:58:35 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:58:35 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 10:58:35 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 10:58:35 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 10:58:35 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 10:58:35 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 10:58:35 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 10:58:35 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 10:58:35 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 10:58:35 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c70df604-601e-4451-828d-20c649b6052a could not be found. Apr 21 10:58:35 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:58:35 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:58:35 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:58:35 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:58:35 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 10:58:35 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 10:58:35 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 10:58:35 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 10:58:35 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 10:58:35 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 10:58:35 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 10:58:35 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 10:58:35 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 10:58:35 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 10:58:35 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 10:58:35 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 10:58:35 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c70df604-601e-4451-828d-20c649b6052a could not be found. Apr 21 10:58:35 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:58:35 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 10:58:35 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:58:35 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 10:58:35 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 10:58:35 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 10:58:35 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 10:58:35 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 10:58:35 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c70df604-601e-4451-828d-20c649b6052a could not be found. Apr 21 10:58:35 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 10:58:35 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-67bda14c-e121-488e-add4-de934ec47d0e tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Returning 404 to user: Instance c70df604-601e-4451-828d-20c649b6052a could not be found. {{(pid=61319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 10:58:35 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-67bda14c-e121-488e-add4-de934ec47d0e tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c70df604-601e-4451-828d-20c649b6052a" status: 404 len: 111 microversion: 2.1 time: 0.181640 Apr 21 10:58:35 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 121/363] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:58:35 2023] GET /compute/v2.1/servers/c70df604-601e-4451-828d-20c649b6052a => generated 111 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 10:58:35 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-535e9a7d-50a6-4f7e-a9c5-71e1cc71792f tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Calling method '.version_select at 0x7f91a5dd3e20>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:58:35 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-535e9a7d-50a6-4f7e-a9c5-71e1cc71792f tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-610711731" status: 202 len: 0 microversion: 2.1 time: 0.027068 Apr 21 10:58:35 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 122/364] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 21 10:58:35 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-610711731 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 10:58:36 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell0:SELECT=2 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:58:36 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-dbe452bc-3f36-49f1-b9ea-626da4162bed tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Action: 'create', calling method: .version_select at 0x7f91a5d52b00>, body: {"keypair": {"name": "tempest-keypair-2123760870", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFO8Apx3ELF1FQJTJmhq4XG7YL/DAo8z97ik4gGkKvut8Sus+PkfBnxQbqnCnfruRlDoOqDGvT630ViBsjv9qzGHLWN6zYB2m0AN9jyGLG1T5nwr0xbvXMEYFBE9kKO5cg=="}} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:58:36 user devstack@n-api.service[61318]: DEBUG nova.quota [None req-dbe452bc-3f36-49f1-b9ea-626da4162bed tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Getting quotas for project 14bc6b0c20204c8287b3523814007856. Resources: {'key_pairs'} {{(pid=61318) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 10:58:36 user devstack@n-api.service[61318]: DEBUG nova.quota [None req-dbe452bc-3f36-49f1-b9ea-626da4162bed tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Getting quotas for user d7fc66871488428e9842404d885bcfe3 and project 14bc6b0c20204c8287b3523814007856. Resources: {'key_pairs'} {{(pid=61318) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 10:58:36 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-dbe452bc-3f36-49f1-b9ea-626da4162bed tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047266 Apr 21 10:58:36 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 122/365] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 21 10:58:36 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:58:38 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-e2892ad4-7d81-49cf-a3f6-51b8793953f9 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-117564941", "imageRef": "3b29a01a-1fc0-4d0d-89fb-23d22b2de02e", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "e0ccd2d9-69df-40e0-be8e-8328039f1bd0"}], "security_groups": [{"name": "tempest-securitygroup--1943628473"}], "key_name": "tempest-keypair-2123760870", "user_data": "}} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:58:38 user devstack@n-api.service[61319]: DEBUG nova.network.neutron [None req-e2892ad4-7d81-49cf-a3f6-51b8793953f9 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] validate_networks() for [('e0ccd2d9-69df-40e0-be8e-8328039f1bd0', None, None, None, None, None)] {{(pid=61319) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 10:58:39 user devstack@n-api.service[61319]: DEBUG nova.virt.hardware [None req-e2892ad4-7d81-49cf-a3f6-51b8793953f9 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Flavor limits 0:0:0 {{(pid=61319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 10:58:39 user devstack@n-api.service[61319]: DEBUG nova.virt.hardware [None req-e2892ad4-7d81-49cf-a3f6-51b8793953f9 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Image limits 0:0:0 {{(pid=61319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 10:58:39 user devstack@n-api.service[61319]: DEBUG nova.virt.hardware [None req-e2892ad4-7d81-49cf-a3f6-51b8793953f9 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Flavor pref 0:0:0 {{(pid=61319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 10:58:39 user devstack@n-api.service[61319]: DEBUG nova.virt.hardware [None req-e2892ad4-7d81-49cf-a3f6-51b8793953f9 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Image pref 0:0:0 {{(pid=61319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 10:58:39 user devstack@n-api.service[61319]: DEBUG nova.virt.hardware [None req-e2892ad4-7d81-49cf-a3f6-51b8793953f9 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 10:58:39 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-e2892ad4-7d81-49cf-a3f6-51b8793953f9 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:58:39 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-e2892ad4-7d81-49cf-a3f6-51b8793953f9 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:58:39 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-e2892ad4-7d81-49cf-a3f6-51b8793953f9 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:58:39 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-e2892ad4-7d81-49cf-a3f6-51b8793953f9 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:58:39 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-e2892ad4-7d81-49cf-a3f6-51b8793953f9 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:58:39 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-e2892ad4-7d81-49cf-a3f6-51b8793953f9 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:58:39 user devstack@n-api.service[61319]: DEBUG nova.quota [None req-e2892ad4-7d81-49cf-a3f6-51b8793953f9 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Getting quotas for project 14bc6b0c20204c8287b3523814007856. Resources: {'cores', 'instances', 'ram'} {{(pid=61319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 10:58:39 user devstack@n-api.service[61319]: DEBUG nova.quota [None req-e2892ad4-7d81-49cf-a3f6-51b8793953f9 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Getting quotas for user d7fc66871488428e9842404d885bcfe3 and project 14bc6b0c20204c8287b3523814007856. Resources: {'cores', 'instances', 'ram'} {{(pid=61319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 10:58:39 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-e2892ad4-7d81-49cf-a3f6-51b8793953f9 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Going to run 1 instances... {{(pid=61319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 10:58:39 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-e2892ad4-7d81-49cf-a3f6-51b8793953f9 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] [instance: 332727a2-b516-40e2-9db1-460563e6ebd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3b29a01a-1fc0-4d0d-89fb-23d22b2de02e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 10:58:39 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-e2892ad4-7d81-49cf-a3f6-51b8793953f9 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.699587 Apr 21 10:58:39 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 122/366] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 10:58:38 2023] POST /compute/v2.1/servers => generated 400 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 10:58:39 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell0:SELECT=2 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:58:39 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell0:SELECT=6 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:58:39 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-f9b6353c-b153-4950-968e-b60f652978d3 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:58:39 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-f9b6353c-b153-4950-968e-b60f652978d3 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] [instance: 332727a2-b516-40e2-9db1-460563e6ebd1] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:58:39 user devstack@n-api.service[61320]: DEBUG nova.policy [None req-f9b6353c-b153-4950-968e-b60f652978d3 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fc66871488428e9842404d885bcfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bc6b0c20204c8287b3523814007856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61320) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:58:39 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-f9b6353c-b153-4950-968e-b60f652978d3 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] 10.0.0.210 "GET /compute/v2.1/servers/332727a2-b516-40e2-9db1-460563e6ebd1" status: 200 len: 1235 microversion: 2.1 time: 0.081613 Apr 21 10:58:39 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 123/367] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:58:39 2023] GET /compute/v2.1/servers/332727a2-b516-40e2-9db1-460563e6ebd1 => generated 1235 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:58:41 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [req-d8f97fd1-c0b4-41b6-97a0-4aee05d30310 req-cde82b48-6515-464b-9293-59ec66840044 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "332727a2-b516-40e2-9db1-460563e6ebd1", "tag": "7d9b3006-2edc-475f-8387-86fc52c807f0"}]} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:58:41 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-d8f97fd1-c0b4-41b6-97a0-4aee05d30310 req-cde82b48-6515-464b-9293-59ec66840044 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:58:41 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-d8f97fd1-c0b4-41b6-97a0-4aee05d30310 req-cde82b48-6515-464b-9293-59ec66840044 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:58:41 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-d8f97fd1-c0b4-41b6-97a0-4aee05d30310 req-cde82b48-6515-464b-9293-59ec66840044 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:58:41 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-d8f97fd1-c0b4-41b6-97a0-4aee05d30310 req-cde82b48-6515-464b-9293-59ec66840044 service nova] Creating event network-changed:7d9b3006-2edc-475f-8387-86fc52c807f0 for instance 332727a2-b516-40e2-9db1-460563e6ebd1 on user Apr 21 10:58:41 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [req-d8f97fd1-c0b4-41b6-97a0-4aee05d30310 req-cde82b48-6515-464b-9293-59ec66840044 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043252 Apr 21 10:58:41 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 123/368] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:58:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 10:58:43 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-03378451-870f-4180-82d9-adb2f4c87dd8 req-6d3ba26a-2407-47b6-9834-18a8ea1de05d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "332727a2-b516-40e2-9db1-460563e6ebd1", "name": "network-vif-plugged", "status": "completed", "tag": "7d9b3006-2edc-475f-8387-86fc52c807f0"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:58:43 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-03378451-870f-4180-82d9-adb2f4c87dd8 req-6d3ba26a-2407-47b6-9834-18a8ea1de05d service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:58:43 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-03378451-870f-4180-82d9-adb2f4c87dd8 req-6d3ba26a-2407-47b6-9834-18a8ea1de05d service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:58:43 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-03378451-870f-4180-82d9-adb2f4c87dd8 req-6d3ba26a-2407-47b6-9834-18a8ea1de05d service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:58:43 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-03378451-870f-4180-82d9-adb2f4c87dd8 req-6d3ba26a-2407-47b6-9834-18a8ea1de05d service nova] Creating event network-vif-plugged:7d9b3006-2edc-475f-8387-86fc52c807f0 for instance 332727a2-b516-40e2-9db1-460563e6ebd1 on user Apr 21 10:58:43 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-03378451-870f-4180-82d9-adb2f4c87dd8 req-6d3ba26a-2407-47b6-9834-18a8ea1de05d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038626 Apr 21 10:58:43 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 123/369] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:58:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:58:45 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [req-70de06cb-5aa3-4dad-8aa7-77c89c567042 req-a12ce27d-2e48-4f2e-a13e-db86828c8971 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "332727a2-b516-40e2-9db1-460563e6ebd1", "name": "network-vif-plugged", "status": "completed", "tag": "7d9b3006-2edc-475f-8387-86fc52c807f0"}]} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:58:45 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell1:SELECT=4 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:58:45 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-70de06cb-5aa3-4dad-8aa7-77c89c567042 req-a12ce27d-2e48-4f2e-a13e-db86828c8971 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:58:45 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-70de06cb-5aa3-4dad-8aa7-77c89c567042 req-a12ce27d-2e48-4f2e-a13e-db86828c8971 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:58:45 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-70de06cb-5aa3-4dad-8aa7-77c89c567042 req-a12ce27d-2e48-4f2e-a13e-db86828c8971 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:58:45 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-70de06cb-5aa3-4dad-8aa7-77c89c567042 req-a12ce27d-2e48-4f2e-a13e-db86828c8971 service nova] Creating event network-vif-plugged:7d9b3006-2edc-475f-8387-86fc52c807f0 for instance 332727a2-b516-40e2-9db1-460563e6ebd1 on user Apr 21 10:58:45 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [req-70de06cb-5aa3-4dad-8aa7-77c89c567042 req-a12ce27d-2e48-4f2e-a13e-db86828c8971 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036441 Apr 21 10:58:45 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 124/370] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:58:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:59:01 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell0:SELECT=4 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:59:01 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:59:01 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell1:SELECT=4 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:59:01 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-5cd8c589-962a-4387-8b2a-c20c34fc95b0 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:59:01 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-5cd8c589-962a-4387-8b2a-c20c34fc95b0 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] [instance: d1fca309-1d26-4a34-b932-716064b86b00] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:59:01 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-5cd8c589-962a-4387-8b2a-c20c34fc95b0 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:59:01 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-5cd8c589-962a-4387-8b2a-c20c34fc95b0 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:59:01 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-5cd8c589-962a-4387-8b2a-c20c34fc95b0 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:59:01 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-5cd8c589-962a-4387-8b2a-c20c34fc95b0 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:59:01 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-5cd8c589-962a-4387-8b2a-c20c34fc95b0 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:59:01 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-5cd8c589-962a-4387-8b2a-c20c34fc95b0 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:59:01 user devstack@n-api.service[61318]: DEBUG nova.objects.instance [None req-5cd8c589-962a-4387-8b2a-c20c34fc95b0 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lazy-loading 'flavor' on Instance uuid d1fca309-1d26-4a34-b932-716064b86b00 {{(pid=61318) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 21 10:59:01 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-5cd8c589-962a-4387-8b2a-c20c34fc95b0 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d1fca309-1d26-4a34-b932-716064b86b00/action" status: 200 len: 32 microversion: 2.1 time: 0.147190 Apr 21 10:59:01 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 124/371] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 21 10:59:01 2023] POST /compute/v2.1/servers/d1fca309-1d26-4a34-b932-716064b86b00/action => generated 32 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 21 10:59:01 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell0:SELECT=2 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:59:01 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell0:SELECT=6 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:59:01 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:59:01 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell1:SELECT=8 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:59:01 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-0b591f47-27d0-4016-bce8-f0b25d91cd12 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:59:01 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-0b591f47-27d0-4016-bce8-f0b25d91cd12 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] [instance: d1fca309-1d26-4a34-b932-716064b86b00] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:59:01 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-0b591f47-27d0-4016-bce8-f0b25d91cd12 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:59:01 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-0b591f47-27d0-4016-bce8-f0b25d91cd12 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:59:01 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-0b591f47-27d0-4016-bce8-f0b25d91cd12 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:59:01 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-0b591f47-27d0-4016-bce8-f0b25d91cd12 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:59:01 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-0b591f47-27d0-4016-bce8-f0b25d91cd12 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:59:01 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-0b591f47-27d0-4016-bce8-f0b25d91cd12 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:59:01 user devstack@n-api.service[61319]: DEBUG nova.policy [None req-0b591f47-27d0-4016-bce8-f0b25d91cd12 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f73ac02062c4411bde0c97f6a719926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a611b8a8d54522929c37807054b2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61319) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:59:01 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-0b591f47-27d0-4016-bce8-f0b25d91cd12 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d1fca309-1d26-4a34-b932-716064b86b00" status: 200 len: 1507 microversion: 2.1 time: 0.377647 Apr 21 10:59:01 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 124/372] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:59:01 2023] GET /compute/v2.1/servers/d1fca309-1d26-4a34-b932-716064b86b00 => generated 1507 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:59:02 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [req-9dd6c270-b87f-4dee-9ae9-cdac22e93f0b req-d88ceb91-05bf-400f-b30d-4ebf697683c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1fca309-1d26-4a34-b932-716064b86b00", "name": "network-vif-unplugged", "status": "completed", "tag": "8abc9260-fa02-4915-a056-63262b57e3be"}]} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:59:02 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell0:SELECT=2 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:59:02 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:59:02 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell1:SELECT=2 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:59:02 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-9dd6c270-b87f-4dee-9ae9-cdac22e93f0b req-d88ceb91-05bf-400f-b30d-4ebf697683c8 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:59:02 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-9dd6c270-b87f-4dee-9ae9-cdac22e93f0b req-d88ceb91-05bf-400f-b30d-4ebf697683c8 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:59:02 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-9dd6c270-b87f-4dee-9ae9-cdac22e93f0b req-d88ceb91-05bf-400f-b30d-4ebf697683c8 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:59:02 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-9dd6c270-b87f-4dee-9ae9-cdac22e93f0b req-d88ceb91-05bf-400f-b30d-4ebf697683c8 service nova] Creating event network-vif-unplugged:8abc9260-fa02-4915-a056-63262b57e3be for instance d1fca309-1d26-4a34-b932-716064b86b00 on user Apr 21 10:59:02 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [req-9dd6c270-b87f-4dee-9ae9-cdac22e93f0b req-d88ceb91-05bf-400f-b30d-4ebf697683c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049024 Apr 21 10:59:02 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 125/373] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:59:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:59:04 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [req-b555fade-9d8a-45df-b707-b6db6c4a6499 req-f4dd6db5-3b10-4baf-a11a-4c01c55333d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1fca309-1d26-4a34-b932-716064b86b00", "name": "network-vif-plugged", "status": "completed", "tag": "8abc9260-fa02-4915-a056-63262b57e3be"}]} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:59:04 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-b555fade-9d8a-45df-b707-b6db6c4a6499 req-f4dd6db5-3b10-4baf-a11a-4c01c55333d2 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:59:04 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-b555fade-9d8a-45df-b707-b6db6c4a6499 req-f4dd6db5-3b10-4baf-a11a-4c01c55333d2 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:59:04 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-b555fade-9d8a-45df-b707-b6db6c4a6499 req-f4dd6db5-3b10-4baf-a11a-4c01c55333d2 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:59:04 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-b555fade-9d8a-45df-b707-b6db6c4a6499 req-f4dd6db5-3b10-4baf-a11a-4c01c55333d2 service nova] Creating event network-vif-plugged:8abc9260-fa02-4915-a056-63262b57e3be for instance d1fca309-1d26-4a34-b932-716064b86b00 on user Apr 21 10:59:04 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [req-b555fade-9d8a-45df-b707-b6db6c4a6499 req-f4dd6db5-3b10-4baf-a11a-4c01c55333d2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034507 Apr 21 10:59:04 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 125/374] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:59:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:59:06 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-e19bb618-d622-4dd3-bd5b-cfd9269c4444 req-4153f707-0a43-444a-8fcd-782428194cbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1fca309-1d26-4a34-b932-716064b86b00", "name": "network-vif-plugged", "status": "completed", "tag": "8abc9260-fa02-4915-a056-63262b57e3be"}, {"server_uuid": "d1fca309-1d26-4a34-b932-716064b86b00", "name": "network-vif-plugged", "status": "completed", "tag": "8abc9260-fa02-4915-a056-63262b57e3be"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 10:59:06 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-e19bb618-d622-4dd3-bd5b-cfd9269c4444 req-4153f707-0a43-444a-8fcd-782428194cbb service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:59:06 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-e19bb618-d622-4dd3-bd5b-cfd9269c4444 req-4153f707-0a43-444a-8fcd-782428194cbb service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:59:06 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-e19bb618-d622-4dd3-bd5b-cfd9269c4444 req-4153f707-0a43-444a-8fcd-782428194cbb service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:59:06 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-e19bb618-d622-4dd3-bd5b-cfd9269c4444 req-4153f707-0a43-444a-8fcd-782428194cbb service nova] Creating event network-vif-plugged:8abc9260-fa02-4915-a056-63262b57e3be for instance d1fca309-1d26-4a34-b932-716064b86b00 on user Apr 21 10:59:06 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-e19bb618-d622-4dd3-bd5b-cfd9269c4444 req-4153f707-0a43-444a-8fcd-782428194cbb service nova] Creating event network-vif-plugged:8abc9260-fa02-4915-a056-63262b57e3be for instance d1fca309-1d26-4a34-b932-716064b86b00 on user Apr 21 10:59:06 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-e19bb618-d622-4dd3-bd5b-cfd9269c4444 req-4153f707-0a43-444a-8fcd-782428194cbb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030576 Apr 21 10:59:06 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 125/375] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 10:59:06 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 10:59:16 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell1:SELECT=2 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:59:16 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_api:SELECT=2 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:59:16 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-1d43f6b7-6277-4013-9413-fe5c3a8f6b17 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:59:16 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-1d43f6b7-6277-4013-9413-fe5c3a8f6b17 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] [instance: 32a0063e-076e-4585-981e-fe853499aee3] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:59:16 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-1d43f6b7-6277-4013-9413-fe5c3a8f6b17 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:59:16 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-1d43f6b7-6277-4013-9413-fe5c3a8f6b17 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:59:16 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-1d43f6b7-6277-4013-9413-fe5c3a8f6b17 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:59:16 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-1d43f6b7-6277-4013-9413-fe5c3a8f6b17 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:59:16 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-1d43f6b7-6277-4013-9413-fe5c3a8f6b17 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:59:16 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-1d43f6b7-6277-4013-9413-fe5c3a8f6b17 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:59:16 user devstack@n-api.service[61320]: DEBUG nova.policy [None req-1d43f6b7-6277-4013-9413-fe5c3a8f6b17 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95956d2e4ea84534b6d5628eb8dd184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc12d15daf34c5e9d26a6cc53795efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61320) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:59:16 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-1d43f6b7-6277-4013-9413-fe5c3a8f6b17 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32a0063e-076e-4585-981e-fe853499aee3" status: 200 len: 1494 microversion: 2.1 time: 0.206790 Apr 21 10:59:16 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 126/376] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:59:16 2023] GET /compute/v2.1/servers/32a0063e-076e-4585-981e-fe853499aee3 => generated 1494 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:59:29 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_api:SELECT=4 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:59:29 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:59:29 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-fa3c505e-68cd-416c-a740-27cf3674b47a tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:59:29 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-fa3c505e-68cd-416c-a740-27cf3674b47a tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] [instance: 332727a2-b516-40e2-9db1-460563e6ebd1] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:59:29 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-fa3c505e-68cd-416c-a740-27cf3674b47a tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:59:29 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-fa3c505e-68cd-416c-a740-27cf3674b47a tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:59:29 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-fa3c505e-68cd-416c-a740-27cf3674b47a tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:59:29 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-fa3c505e-68cd-416c-a740-27cf3674b47a tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:59:29 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-fa3c505e-68cd-416c-a740-27cf3674b47a tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:59:29 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-fa3c505e-68cd-416c-a740-27cf3674b47a tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:59:29 user devstack@n-api.service[61318]: DEBUG nova.policy [None req-fa3c505e-68cd-416c-a740-27cf3674b47a tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fc66871488428e9842404d885bcfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bc6b0c20204c8287b3523814007856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61318) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:59:29 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-fa3c505e-68cd-416c-a740-27cf3674b47a tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] 10.0.0.210 "GET /compute/v2.1/servers/332727a2-b516-40e2-9db1-460563e6ebd1" status: 200 len: 1545 microversion: 2.1 time: 0.225118 Apr 21 10:59:29 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 126/377] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:59:29 2023] GET /compute/v2.1/servers/332727a2-b516-40e2-9db1-460563e6ebd1 => generated 1545 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 10:59:51 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_api:SELECT=4 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:59:51 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell1:SELECT=8 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 10:59:51 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-3a5576e5-8e5d-4e4c-8e38-424b2d136941 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 10:59:51 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-3a5576e5-8e5d-4e4c-8e38-424b2d136941 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] [instance: d1fca309-1d26-4a34-b932-716064b86b00] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 10:59:51 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-3a5576e5-8e5d-4e4c-8e38-424b2d136941 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:59:51 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-3a5576e5-8e5d-4e4c-8e38-424b2d136941 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:59:51 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-3a5576e5-8e5d-4e4c-8e38-424b2d136941 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:59:51 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-3a5576e5-8e5d-4e4c-8e38-424b2d136941 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 10:59:51 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-3a5576e5-8e5d-4e4c-8e38-424b2d136941 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 10:59:51 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-3a5576e5-8e5d-4e4c-8e38-424b2d136941 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 10:59:51 user devstack@n-api.service[61319]: DEBUG nova.policy [None req-3a5576e5-8e5d-4e4c-8e38-424b2d136941 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f73ac02062c4411bde0c97f6a719926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a611b8a8d54522929c37807054b2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61319) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 10:59:51 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-3a5576e5-8e5d-4e4c-8e38-424b2d136941 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d1fca309-1d26-4a34-b932-716064b86b00" status: 200 len: 1487 microversion: 2.1 time: 0.228322 Apr 21 10:59:51 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 126/378] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 10:59:51 2023] GET /compute/v2.1/servers/d1fca309-1d26-4a34-b932-716064b86b00 => generated 1487 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 11:00:16 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_api:SELECT=2 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:00:16 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell1:SELECT=6 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:00:16 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-8a3a11d9-83b1-4471-be02-6c2c73e4ee8b tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:00:16 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-8a3a11d9-83b1-4471-be02-6c2c73e4ee8b tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] [instance: 32a0063e-076e-4585-981e-fe853499aee3] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:00:16 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-8a3a11d9-83b1-4471-be02-6c2c73e4ee8b tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:00:16 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-8a3a11d9-83b1-4471-be02-6c2c73e4ee8b tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:00:16 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-8a3a11d9-83b1-4471-be02-6c2c73e4ee8b tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:00:16 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-8a3a11d9-83b1-4471-be02-6c2c73e4ee8b tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:00:16 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-8a3a11d9-83b1-4471-be02-6c2c73e4ee8b tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:00:16 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-8a3a11d9-83b1-4471-be02-6c2c73e4ee8b tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:00:16 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-8a3a11d9-83b1-4471-be02-6c2c73e4ee8b tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] [instance: 32a0063e-076e-4585-981e-fe853499aee3] Going to try to terminate instance {{(pid=61320) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 11:00:16 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-8a3a11d9-83b1-4471-be02-6c2c73e4ee8b tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/32a0063e-076e-4585-981e-fe853499aee3" status: 204 len: 0 microversion: 2.1 time: 0.114722 Apr 21 11:00:16 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 127/379] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 11:00:16 2023] DELETE /compute/v2.1/servers/32a0063e-076e-4585-981e-fe853499aee3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 11:00:16 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-6c7b8090-88dd-4bc2-9f9f-75f6665e06a3 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:00:16 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-6c7b8090-88dd-4bc2-9f9f-75f6665e06a3 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] [instance: 32a0063e-076e-4585-981e-fe853499aee3] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:00:16 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_api:SELECT=2 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:00:16 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell1:SELECT=6 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:00:16 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-6c7b8090-88dd-4bc2-9f9f-75f6665e06a3 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:00:16 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-6c7b8090-88dd-4bc2-9f9f-75f6665e06a3 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:00:16 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-6c7b8090-88dd-4bc2-9f9f-75f6665e06a3 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:00:16 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-6c7b8090-88dd-4bc2-9f9f-75f6665e06a3 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:00:16 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-6c7b8090-88dd-4bc2-9f9f-75f6665e06a3 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:00:16 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-6c7b8090-88dd-4bc2-9f9f-75f6665e06a3 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:00:17 user devstack@n-api.service[61318]: DEBUG nova.policy [None req-6c7b8090-88dd-4bc2-9f9f-75f6665e06a3 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95956d2e4ea84534b6d5628eb8dd184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc12d15daf34c5e9d26a6cc53795efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61318) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 11:00:17 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-6c7b8090-88dd-4bc2-9f9f-75f6665e06a3 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32a0063e-076e-4585-981e-fe853499aee3" status: 200 len: 1500 microversion: 2.1 time: 0.401164 Apr 21 11:00:17 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 127/380] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 11:00:16 2023] GET /compute/v2.1/servers/32a0063e-076e-4585-981e-fe853499aee3 => generated 1500 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 11:00:17 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-4601ea9c-5f9e-4dc3-b786-7ebd490a4559 req-9a101b5e-76a6-440f-a43e-deed0cd4e2c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32a0063e-076e-4585-981e-fe853499aee3", "name": "network-vif-unplugged", "status": "completed", "tag": "3e412892-1f09-4bcc-8126-bf7d69b8b2d2"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 11:00:17 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_api:SELECT=2 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:00:17 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell1:SELECT=6 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:00:17 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-4601ea9c-5f9e-4dc3-b786-7ebd490a4559 req-9a101b5e-76a6-440f-a43e-deed0cd4e2c1 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:00:17 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-4601ea9c-5f9e-4dc3-b786-7ebd490a4559 req-9a101b5e-76a6-440f-a43e-deed0cd4e2c1 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:00:17 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-4601ea9c-5f9e-4dc3-b786-7ebd490a4559 req-9a101b5e-76a6-440f-a43e-deed0cd4e2c1 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:00:17 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-4601ea9c-5f9e-4dc3-b786-7ebd490a4559 req-9a101b5e-76a6-440f-a43e-deed0cd4e2c1 service nova] Creating event network-vif-unplugged:3e412892-1f09-4bcc-8126-bf7d69b8b2d2 for instance 32a0063e-076e-4585-981e-fe853499aee3 on user Apr 21 11:00:17 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-4601ea9c-5f9e-4dc3-b786-7ebd490a4559 req-9a101b5e-76a6-440f-a43e-deed0cd4e2c1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030802 Apr 21 11:00:17 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 127/381] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 11:00:17 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 11:00:17 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [req-4472d241-f50e-4391-9dd1-87509089f3c6 req-8f82a658-cedf-48a1-bb31-94f37b7ec1ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32a0063e-076e-4585-981e-fe853499aee3", "name": "network-vif-deleted", "tag": "3e412892-1f09-4bcc-8126-bf7d69b8b2d2"}]} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 11:00:17 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-4472d241-f50e-4391-9dd1-87509089f3c6 req-8f82a658-cedf-48a1-bb31-94f37b7ec1ad service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:00:17 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-4472d241-f50e-4391-9dd1-87509089f3c6 req-8f82a658-cedf-48a1-bb31-94f37b7ec1ad service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:00:17 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-4472d241-f50e-4391-9dd1-87509089f3c6 req-8f82a658-cedf-48a1-bb31-94f37b7ec1ad service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:00:17 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-4472d241-f50e-4391-9dd1-87509089f3c6 req-8f82a658-cedf-48a1-bb31-94f37b7ec1ad service nova] Creating event network-vif-deleted:3e412892-1f09-4bcc-8126-bf7d69b8b2d2 for instance 32a0063e-076e-4585-981e-fe853499aee3 on user Apr 21 11:00:17 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [req-4472d241-f50e-4391-9dd1-87509089f3c6 req-8f82a658-cedf-48a1-bb31-94f37b7ec1ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029908 Apr 21 11:00:17 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 128/382] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 11:00:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 11:00:19 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [req-17289ae5-5beb-425a-8254-d2455cf0f57b req-10e42a90-2276-4ad7-af57-a0454b7bffde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32a0063e-076e-4585-981e-fe853499aee3", "name": "network-vif-plugged", "status": "completed", "tag": "3e412892-1f09-4bcc-8126-bf7d69b8b2d2"}]} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 11:00:19 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-17289ae5-5beb-425a-8254-d2455cf0f57b req-10e42a90-2276-4ad7-af57-a0454b7bffde service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:00:19 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-17289ae5-5beb-425a-8254-d2455cf0f57b req-10e42a90-2276-4ad7-af57-a0454b7bffde service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:00:19 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-17289ae5-5beb-425a-8254-d2455cf0f57b req-10e42a90-2276-4ad7-af57-a0454b7bffde service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:00:19 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-17289ae5-5beb-425a-8254-d2455cf0f57b req-10e42a90-2276-4ad7-af57-a0454b7bffde service nova] Creating event network-vif-plugged:3e412892-1f09-4bcc-8126-bf7d69b8b2d2 for instance 32a0063e-076e-4585-981e-fe853499aee3 on user Apr 21 11:00:19 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [req-17289ae5-5beb-425a-8254-d2455cf0f57b req-10e42a90-2276-4ad7-af57-a0454b7bffde service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028840 Apr 21 11:00:19 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 128/383] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 11:00:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 11:00:29 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell1:SELECT=2 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:00:29 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-e71e6329-ecf9-43e9-b018-b809dd7068ce tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:00:29 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-e71e6329-ecf9-43e9-b018-b809dd7068ce tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] [instance: 332727a2-b516-40e2-9db1-460563e6ebd1] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:00:29 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-e71e6329-ecf9-43e9-b018-b809dd7068ce tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:00:29 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-e71e6329-ecf9-43e9-b018-b809dd7068ce tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:00:29 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-e71e6329-ecf9-43e9-b018-b809dd7068ce tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:00:29 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-e71e6329-ecf9-43e9-b018-b809dd7068ce tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:00:29 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-e71e6329-ecf9-43e9-b018-b809dd7068ce tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:00:29 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-e71e6329-ecf9-43e9-b018-b809dd7068ce tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:00:29 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-e71e6329-ecf9-43e9-b018-b809dd7068ce tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] 10.0.0.210 "GET /compute/v2.1/servers/332727a2-b516-40e2-9db1-460563e6ebd1/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.165249 Apr 21 11:00:29 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 128/384] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 21 11:00:29 2023] GET /compute/v2.1/servers/332727a2-b516-40e2-9db1-460563e6ebd1/os-interface => generated 283 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 11:00:30 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:00:30 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:00:30 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [req-d85b3460-5850-4cd6-9ad2-81b3643eac57 req-eb6df3bf-7dd7-4465-aba5-bba26fb16d45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "332727a2-b516-40e2-9db1-460563e6ebd1", "tag": "7d9b3006-2edc-475f-8387-86fc52c807f0"}]} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 11:00:30 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-d85b3460-5850-4cd6-9ad2-81b3643eac57 req-eb6df3bf-7dd7-4465-aba5-bba26fb16d45 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:00:30 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-d85b3460-5850-4cd6-9ad2-81b3643eac57 req-eb6df3bf-7dd7-4465-aba5-bba26fb16d45 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:00:30 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-d85b3460-5850-4cd6-9ad2-81b3643eac57 req-eb6df3bf-7dd7-4465-aba5-bba26fb16d45 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:00:30 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-d85b3460-5850-4cd6-9ad2-81b3643eac57 req-eb6df3bf-7dd7-4465-aba5-bba26fb16d45 service nova] Creating event network-changed:7d9b3006-2edc-475f-8387-86fc52c807f0 for instance 332727a2-b516-40e2-9db1-460563e6ebd1 on user Apr 21 11:00:30 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [req-d85b3460-5850-4cd6-9ad2-81b3643eac57 req-eb6df3bf-7dd7-4465-aba5-bba26fb16d45 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039049 Apr 21 11:00:30 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 129/385] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 11:00:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 11:00:30 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_api:SELECT=4 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:00:30 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell1:SELECT=8 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:00:30 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-c5bff378-2b1b-4619-b5a7-9c58bf2f0023 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:00:30 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-c5bff378-2b1b-4619-b5a7-9c58bf2f0023 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] [instance: 332727a2-b516-40e2-9db1-460563e6ebd1] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:00:30 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-c5bff378-2b1b-4619-b5a7-9c58bf2f0023 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:00:30 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-c5bff378-2b1b-4619-b5a7-9c58bf2f0023 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:00:30 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-c5bff378-2b1b-4619-b5a7-9c58bf2f0023 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:00:30 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-c5bff378-2b1b-4619-b5a7-9c58bf2f0023 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:00:30 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-c5bff378-2b1b-4619-b5a7-9c58bf2f0023 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:00:30 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-c5bff378-2b1b-4619-b5a7-9c58bf2f0023 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:00:30 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-c5bff378-2b1b-4619-b5a7-9c58bf2f0023 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] 10.0.0.210 "GET /compute/v2.1/servers/332727a2-b516-40e2-9db1-460563e6ebd1/ips" status: 200 len: 108 microversion: 2.1 time: 0.039836 Apr 21 11:00:30 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 129/386] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 21 11:00:30 2023] GET /compute/v2.1/servers/332727a2-b516-40e2-9db1-460563e6ebd1/ips => generated 108 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 11:00:31 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-393ef6db-7039-4d03-bceb-45c239a8f810 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:00:31 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-393ef6db-7039-4d03-bceb-45c239a8f810 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] [instance: 332727a2-b516-40e2-9db1-460563e6ebd1] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:00:31 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-393ef6db-7039-4d03-bceb-45c239a8f810 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:00:31 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-393ef6db-7039-4d03-bceb-45c239a8f810 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:00:31 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-393ef6db-7039-4d03-bceb-45c239a8f810 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:00:31 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-393ef6db-7039-4d03-bceb-45c239a8f810 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:00:31 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-393ef6db-7039-4d03-bceb-45c239a8f810 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:00:31 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-393ef6db-7039-4d03-bceb-45c239a8f810 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:00:31 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-393ef6db-7039-4d03-bceb-45c239a8f810 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] [instance: 332727a2-b516-40e2-9db1-460563e6ebd1] Going to try to terminate instance {{(pid=61319) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 11:00:32 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-393ef6db-7039-4d03-bceb-45c239a8f810 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/332727a2-b516-40e2-9db1-460563e6ebd1" status: 204 len: 0 microversion: 2.1 time: 0.119144 Apr 21 11:00:32 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 129/387] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 11:00:31 2023] DELETE /compute/v2.1/servers/332727a2-b516-40e2-9db1-460563e6ebd1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 11:00:32 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-d9f218c0-d7aa-4072-90ab-13ab00ea7ca6 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:00:32 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-d9f218c0-d7aa-4072-90ab-13ab00ea7ca6 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] [instance: 332727a2-b516-40e2-9db1-460563e6ebd1] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:00:32 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-d9f218c0-d7aa-4072-90ab-13ab00ea7ca6 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:00:32 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-d9f218c0-d7aa-4072-90ab-13ab00ea7ca6 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:00:32 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-d9f218c0-d7aa-4072-90ab-13ab00ea7ca6 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:00:32 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-d9f218c0-d7aa-4072-90ab-13ab00ea7ca6 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:00:32 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-d9f218c0-d7aa-4072-90ab-13ab00ea7ca6 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:00:32 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-d9f218c0-d7aa-4072-90ab-13ab00ea7ca6 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:00:32 user devstack@n-api.service[61320]: DEBUG nova.policy [None req-d9f218c0-d7aa-4072-90ab-13ab00ea7ca6 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fc66871488428e9842404d885bcfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bc6b0c20204c8287b3523814007856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61320) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 11:00:32 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-d9f218c0-d7aa-4072-90ab-13ab00ea7ca6 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] 10.0.0.210 "GET /compute/v2.1/servers/332727a2-b516-40e2-9db1-460563e6ebd1" status: 200 len: 1670 microversion: 2.1 time: 0.196874 Apr 21 11:00:32 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 130/388] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 11:00:32 2023] GET /compute/v2.1/servers/332727a2-b516-40e2-9db1-460563e6ebd1 => generated 1670 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 11:00:32 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [req-3a3ebdbb-b63f-4f45-abbb-d986f4fa97b1 req-8e402c1d-fc9e-42b6-884b-179cb76f95c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "332727a2-b516-40e2-9db1-460563e6ebd1", "name": "network-vif-unplugged", "status": "completed", "tag": "7d9b3006-2edc-475f-8387-86fc52c807f0"}]} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 11:00:32 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-3a3ebdbb-b63f-4f45-abbb-d986f4fa97b1 req-8e402c1d-fc9e-42b6-884b-179cb76f95c6 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:00:32 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-3a3ebdbb-b63f-4f45-abbb-d986f4fa97b1 req-8e402c1d-fc9e-42b6-884b-179cb76f95c6 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:00:32 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-3a3ebdbb-b63f-4f45-abbb-d986f4fa97b1 req-8e402c1d-fc9e-42b6-884b-179cb76f95c6 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:00:32 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-3a3ebdbb-b63f-4f45-abbb-d986f4fa97b1 req-8e402c1d-fc9e-42b6-884b-179cb76f95c6 service nova] Creating event network-vif-unplugged:7d9b3006-2edc-475f-8387-86fc52c807f0 for instance 332727a2-b516-40e2-9db1-460563e6ebd1 on user Apr 21 11:00:32 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [req-3a3ebdbb-b63f-4f45-abbb-d986f4fa97b1 req-8e402c1d-fc9e-42b6-884b-179cb76f95c6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115730 Apr 21 11:00:32 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 130/389] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 11:00:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 11:00:33 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-15ca6521-27e9-4bb0-b5c0-a58e15c10836 req-6a12c94c-1f35-40b4-a0d1-f62bd8e4a865 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "332727a2-b516-40e2-9db1-460563e6ebd1", "name": "network-vif-deleted", "tag": "7d9b3006-2edc-475f-8387-86fc52c807f0"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 11:00:33 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-15ca6521-27e9-4bb0-b5c0-a58e15c10836 req-6a12c94c-1f35-40b4-a0d1-f62bd8e4a865 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:00:33 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-15ca6521-27e9-4bb0-b5c0-a58e15c10836 req-6a12c94c-1f35-40b4-a0d1-f62bd8e4a865 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:00:33 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-15ca6521-27e9-4bb0-b5c0-a58e15c10836 req-6a12c94c-1f35-40b4-a0d1-f62bd8e4a865 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:00:33 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-15ca6521-27e9-4bb0-b5c0-a58e15c10836 req-6a12c94c-1f35-40b4-a0d1-f62bd8e4a865 service nova] Creating event network-vif-deleted:7d9b3006-2edc-475f-8387-86fc52c807f0 for instance 332727a2-b516-40e2-9db1-460563e6ebd1 on user Apr 21 11:00:33 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-15ca6521-27e9-4bb0-b5c0-a58e15c10836 req-6a12c94c-1f35-40b4-a0d1-f62bd8e4a865 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030272 Apr 21 11:00:33 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 130/390] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 11:00:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 11:00:34 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [req-dd6639f3-fdf6-4f89-95bb-c88a6a7ae02b req-4daec593-8ca5-4f70-a544-5f76cb953918 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "332727a2-b516-40e2-9db1-460563e6ebd1", "name": "network-vif-plugged", "status": "completed", "tag": "7d9b3006-2edc-475f-8387-86fc52c807f0"}]} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 11:00:34 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-dd6639f3-fdf6-4f89-95bb-c88a6a7ae02b req-4daec593-8ca5-4f70-a544-5f76cb953918 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:00:34 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-dd6639f3-fdf6-4f89-95bb-c88a6a7ae02b req-4daec593-8ca5-4f70-a544-5f76cb953918 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:00:34 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-dd6639f3-fdf6-4f89-95bb-c88a6a7ae02b req-4daec593-8ca5-4f70-a544-5f76cb953918 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:00:34 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-dd6639f3-fdf6-4f89-95bb-c88a6a7ae02b req-4daec593-8ca5-4f70-a544-5f76cb953918 service nova] Creating event network-vif-plugged:7d9b3006-2edc-475f-8387-86fc52c807f0 for instance 332727a2-b516-40e2-9db1-460563e6ebd1 on user Apr 21 11:00:34 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [req-dd6639f3-fdf6-4f89-95bb-c88a6a7ae02b req-4daec593-8ca5-4f70-a544-5f76cb953918 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030607 Apr 21 11:00:34 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 131/391] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 11:00:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 11:00:51 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_api:SELECT=4 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:00:51 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell1:SELECT=6 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:00:51 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-28604dae-09af-4b03-8ad6-576c2c079cc7 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:00:51 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-28604dae-09af-4b03-8ad6-576c2c079cc7 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] [instance: 476dbf2e-b02a-47bc-a8c6-6d0d66d5d433] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:00:51 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-28604dae-09af-4b03-8ad6-576c2c079cc7 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:00:51 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-28604dae-09af-4b03-8ad6-576c2c079cc7 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:00:51 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-28604dae-09af-4b03-8ad6-576c2c079cc7 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:00:51 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-28604dae-09af-4b03-8ad6-576c2c079cc7 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:00:51 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-28604dae-09af-4b03-8ad6-576c2c079cc7 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:00:51 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-28604dae-09af-4b03-8ad6-576c2c079cc7 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:00:52 user devstack@n-api.service[61318]: DEBUG nova.policy [None req-28604dae-09af-4b03-8ad6-576c2c079cc7 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f73ac02062c4411bde0c97f6a719926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a611b8a8d54522929c37807054b2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61318) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 11:00:52 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-28604dae-09af-4b03-8ad6-576c2c079cc7 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] 10.0.0.210 "GET /compute/v2.1/servers/476dbf2e-b02a-47bc-a8c6-6d0d66d5d433" status: 200 len: 1505 microversion: 2.1 time: 0.232871 Apr 21 11:00:52 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 131/392] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 11:00:51 2023] GET /compute/v2.1/servers/476dbf2e-b02a-47bc-a8c6-6d0d66d5d433 => generated 1505 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 11:01:07 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:01:07 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:01:07 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-f93481c9-3ece-4d93-8f04-6156a4a9691d tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:01:07 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-f93481c9-3ece-4d93-8f04-6156a4a9691d tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] [instance: 32a0063e-076e-4585-981e-fe853499aee3] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:01:07 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-f93481c9-3ece-4d93-8f04-6156a4a9691d tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:01:07 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-f93481c9-3ece-4d93-8f04-6156a4a9691d tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:01:07 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-f93481c9-3ece-4d93-8f04-6156a4a9691d tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:01:07 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-f93481c9-3ece-4d93-8f04-6156a4a9691d tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:01:07 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-f93481c9-3ece-4d93-8f04-6156a4a9691d tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:01:07 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-f93481c9-3ece-4d93-8f04-6156a4a9691d tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:01:07 user devstack@n-api.service[61319]: INFO nova.api.openstack.wsgi [None req-f93481c9-3ece-4d93-8f04-6156a4a9691d tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] HTTP exception thrown: Instance 32a0063e-076e-4585-981e-fe853499aee3 could not be found. Apr 21 11:01:07 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-f93481c9-3ece-4d93-8f04-6156a4a9691d tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Request method failure captured: Apr 21 11:01:07 user devstack@n-api.service[61319]: request: GET /compute/v2.1/servers/32a0063e-076e-4585-981e-fe853499aee3 HTTP/1.1 Apr 21 11:01:07 user devstack@n-api.service[61319]: Accept: application/json Apr 21 11:01:07 user devstack@n-api.service[61319]: Accept-Encoding: identity Apr 21 11:01:07 user devstack@n-api.service[61319]: Connection: close Apr 21 11:01:07 user devstack@n-api.service[61319]: Content-Length: 0 Apr 21 11:01:07 user devstack@n-api.service[61319]: Content-Type: application/json Apr 21 11:01:07 user devstack@n-api.service[61319]: Host: 10.0.0.210 Apr 21 11:01:07 user devstack@n-api.service[61319]: Openstack-System-Scope: None Apr 21 11:01:07 user devstack@n-api.service[61319]: User-Agent: python-urllib3/1.26.15 Apr 21 11:01:07 user devstack@n-api.service[61319]: X-Auth-Token: gAAAAABkQmvi6BLDwVzQA0j1G6jfQrVSbK2Z2JlBL4mzr6ps4f3qI_xdtkI9q9uVoLZL-2YfUdE_HchhZz_wV_pY5xRJTk9UErKs-UekJh41x0ouxWtyNIOZx8lJrvJqo5DFdLgkV5WuingyCKv1R2lzVPsOpsxtQ_-Qx0IlCULMmQnzNxxmWdo Apr 21 11:01:07 user devstack@n-api.service[61319]: X-Domain-Id: None Apr 21 11:01:07 user devstack@n-api.service[61319]: X-Domain-Name: None Apr 21 11:01:07 user devstack@n-api.service[61319]: X-Identity-Status: Confirmed Apr 21 11:01:07 user devstack@n-api.service[61319]: X-Is-Admin-Project: True Apr 21 11:01:07 user devstack@n-api.service[61319]: X-Project-Domain-Id: default Apr 21 11:01:07 user devstack@n-api.service[61319]: X-Project-Domain-Name: Default Apr 21 11:01:07 user devstack@n-api.service[61319]: X-Project-Id: acc12d15daf34c5e9d26a6cc53795efe Apr 21 11:01:07 user devstack@n-api.service[61319]: X-Project-Name: tempest-ServersNegativeTestJSON-1265836442 Apr 21 11:01:07 user devstack@n-api.service[61319]: X-Role: reader,member Apr 21 11:01:07 user devstack@n-api.service[61319]: X-Roles: reader,member Apr 21 11:01:07 user devstack@n-api.service[61319]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/acc12d15daf34c5e9d26a6cc53795efe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/acc12d15daf34c5e9d26a6cc53795efe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/acc12d15daf34c5e9d26a6cc53795efe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 11:01:07 user devstack@n-api.service[61319]: X-Tenant: tempest-ServersNegativeTestJSON-1265836442 Apr 21 11:01:07 user devstack@n-api.service[61319]: X-Tenant-Id: acc12d15daf34c5e9d26a6cc53795efe Apr 21 11:01:07 user devstack@n-api.service[61319]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1265836442 Apr 21 11:01:07 user devstack@n-api.service[61319]: X-User: tempest-ServersNegativeTestJSON-1265836442-project-member Apr 21 11:01:07 user devstack@n-api.service[61319]: X-User-Domain-Id: default Apr 21 11:01:07 user devstack@n-api.service[61319]: X-User-Domain-Name: Default Apr 21 11:01:07 user devstack@n-api.service[61319]: X-User-Id: 95956d2e4ea84534b6d5628eb8dd184d Apr 21 11:01:07 user devstack@n-api.service[61319]: X-User-Name: tempest-ServersNegativeTestJSON-1265836442-project-member Apr 21 11:01:07 user devstack@n-api.service[61319]: method: > Apr 21 11:01:07 user devstack@n-api.service[61319]: exception: Instance 32a0063e-076e-4585-981e-fe853499aee3 could not be found. Apr 21 11:01:07 user devstack@n-api.service[61319]: action_args: {'id': '32a0063e-076e-4585-981e-fe853499aee3'} Apr 21 11:01:07 user devstack@n-api.service[61319]: {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 11:01:07 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:01:07 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 11:01:07 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 11:01:07 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 11:01:07 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 11:01:07 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 11:01:07 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 11:01:07 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 11:01:07 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 11:01:07 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32a0063e-076e-4585-981e-fe853499aee3 could not be found. Apr 21 11:01:07 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 11:01:07 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 11:01:07 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 11:01:07 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:01:07 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 11:01:07 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 11:01:07 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 11:01:07 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 11:01:07 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 11:01:07 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 11:01:07 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 11:01:07 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 11:01:07 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 11:01:07 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 11:01:07 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 11:01:07 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 11:01:07 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32a0063e-076e-4585-981e-fe853499aee3 could not be found. Apr 21 11:01:07 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 11:01:07 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 11:01:07 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 11:01:07 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:01:07 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 11:01:07 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 11:01:07 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 11:01:07 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 11:01:07 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32a0063e-076e-4585-981e-fe853499aee3 could not be found. Apr 21 11:01:07 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 11:01:07 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-f93481c9-3ece-4d93-8f04-6156a4a9691d tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Returning 404 to user: Instance 32a0063e-076e-4585-981e-fe853499aee3 could not be found. {{(pid=61319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 11:01:07 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-f93481c9-3ece-4d93-8f04-6156a4a9691d tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32a0063e-076e-4585-981e-fe853499aee3" status: 404 len: 111 microversion: 2.1 time: 0.043293 Apr 21 11:01:07 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 131/393] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 11:01:07 2023] GET /compute/v2.1/servers/32a0063e-076e-4585-981e-fe853499aee3 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 11:01:07 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_api:SELECT=6 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:01:07 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell1:SELECT=10 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:01:07 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-0672205a-c1ea-474b-a190-96e1e57386f1 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:01:07 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-0672205a-c1ea-474b-a190-96e1e57386f1 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] [instance: 595d41a4-9a01-4aa2-96a1-c2c763475184] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:01:07 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-0672205a-c1ea-474b-a190-96e1e57386f1 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:01:07 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-0672205a-c1ea-474b-a190-96e1e57386f1 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:01:07 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-0672205a-c1ea-474b-a190-96e1e57386f1 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:01:07 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-0672205a-c1ea-474b-a190-96e1e57386f1 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:01:07 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-0672205a-c1ea-474b-a190-96e1e57386f1 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:01:07 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-0672205a-c1ea-474b-a190-96e1e57386f1 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:01:07 user devstack@n-api.service[61320]: DEBUG nova.policy [None req-0672205a-c1ea-474b-a190-96e1e57386f1 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95956d2e4ea84534b6d5628eb8dd184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc12d15daf34c5e9d26a6cc53795efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61320) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 11:01:07 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-0672205a-c1ea-474b-a190-96e1e57386f1 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] 10.0.0.210 "GET /compute/v2.1/servers/595d41a4-9a01-4aa2-96a1-c2c763475184" status: 200 len: 1494 microversion: 2.1 time: 0.278878 Apr 21 11:01:07 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 132/394] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 11:01:07 2023] GET /compute/v2.1/servers/595d41a4-9a01-4aa2-96a1-c2c763475184 => generated 1494 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 11:01:22 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-019ff036-36a2-4716-b462-d6f2a8ca146e tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:01:22 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-019ff036-36a2-4716-b462-d6f2a8ca146e tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] [instance: 332727a2-b516-40e2-9db1-460563e6ebd1] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:01:22 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_api:SELECT=2 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:01:22 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell1:SELECT=6 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:01:22 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-019ff036-36a2-4716-b462-d6f2a8ca146e tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:01:22 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-019ff036-36a2-4716-b462-d6f2a8ca146e tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:01:22 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-019ff036-36a2-4716-b462-d6f2a8ca146e tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:01:22 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-019ff036-36a2-4716-b462-d6f2a8ca146e tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:01:22 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-019ff036-36a2-4716-b462-d6f2a8ca146e tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:01:22 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-019ff036-36a2-4716-b462-d6f2a8ca146e tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:01:22 user devstack@n-api.service[61318]: INFO nova.api.openstack.wsgi [None req-019ff036-36a2-4716-b462-d6f2a8ca146e tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] HTTP exception thrown: Instance 332727a2-b516-40e2-9db1-460563e6ebd1 could not be found. Apr 21 11:01:22 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-019ff036-36a2-4716-b462-d6f2a8ca146e tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Request method failure captured: Apr 21 11:01:22 user devstack@n-api.service[61318]: request: GET /compute/v2.1/servers/332727a2-b516-40e2-9db1-460563e6ebd1 HTTP/1.1 Apr 21 11:01:22 user devstack@n-api.service[61318]: Accept: application/json Apr 21 11:01:22 user devstack@n-api.service[61318]: Accept-Encoding: identity Apr 21 11:01:22 user devstack@n-api.service[61318]: Connection: close Apr 21 11:01:22 user devstack@n-api.service[61318]: Content-Length: 0 Apr 21 11:01:22 user devstack@n-api.service[61318]: Content-Type: application/json Apr 21 11:01:22 user devstack@n-api.service[61318]: Host: 10.0.0.210 Apr 21 11:01:22 user devstack@n-api.service[61318]: Openstack-System-Scope: None Apr 21 11:01:22 user devstack@n-api.service[61318]: User-Agent: python-urllib3/1.26.15 Apr 21 11:01:22 user devstack@n-api.service[61318]: X-Auth-Token: gAAAAABkQmsO4Ti6hs69z_6Ogvs4ejj7r0BZKsyfzT9wT_akUX9UJiysHbmUPTFlIxRZV4GzaKcEHtXLtDCyrbqof8A_RuWS8jMqwQkpCNmO8LpbZakx3A5g2MVGEzhF0EvvdFwMh7oY0TESImzQadQsU3RwS-vJMRw092Oq4oo7uZmU7xd_izU Apr 21 11:01:22 user devstack@n-api.service[61318]: X-Domain-Id: None Apr 21 11:01:22 user devstack@n-api.service[61318]: X-Domain-Name: None Apr 21 11:01:22 user devstack@n-api.service[61318]: X-Identity-Status: Confirmed Apr 21 11:01:22 user devstack@n-api.service[61318]: X-Is-Admin-Project: True Apr 21 11:01:22 user devstack@n-api.service[61318]: X-Project-Domain-Id: default Apr 21 11:01:22 user devstack@n-api.service[61318]: X-Project-Domain-Name: Default Apr 21 11:01:22 user devstack@n-api.service[61318]: X-Project-Id: 14bc6b0c20204c8287b3523814007856 Apr 21 11:01:22 user devstack@n-api.service[61318]: X-Project-Name: tempest-AttachVolumeNegativeTest-159654333 Apr 21 11:01:22 user devstack@n-api.service[61318]: X-Role: reader,member Apr 21 11:01:22 user devstack@n-api.service[61318]: X-Roles: reader,member Apr 21 11:01:22 user devstack@n-api.service[61318]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/14bc6b0c20204c8287b3523814007856"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/14bc6b0c20204c8287b3523814007856"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/14bc6b0c20204c8287b3523814007856"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 11:01:22 user devstack@n-api.service[61318]: X-Tenant: tempest-AttachVolumeNegativeTest-159654333 Apr 21 11:01:22 user devstack@n-api.service[61318]: X-Tenant-Id: 14bc6b0c20204c8287b3523814007856 Apr 21 11:01:22 user devstack@n-api.service[61318]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-159654333 Apr 21 11:01:22 user devstack@n-api.service[61318]: X-User: tempest-AttachVolumeNegativeTest-159654333-project-member Apr 21 11:01:22 user devstack@n-api.service[61318]: X-User-Domain-Id: default Apr 21 11:01:22 user devstack@n-api.service[61318]: X-User-Domain-Name: Default Apr 21 11:01:22 user devstack@n-api.service[61318]: X-User-Id: d7fc66871488428e9842404d885bcfe3 Apr 21 11:01:22 user devstack@n-api.service[61318]: X-User-Name: tempest-AttachVolumeNegativeTest-159654333-project-member Apr 21 11:01:22 user devstack@n-api.service[61318]: method: > Apr 21 11:01:22 user devstack@n-api.service[61318]: exception: Instance 332727a2-b516-40e2-9db1-460563e6ebd1 could not be found. Apr 21 11:01:22 user devstack@n-api.service[61318]: action_args: {'id': '332727a2-b516-40e2-9db1-460563e6ebd1'} Apr 21 11:01:22 user devstack@n-api.service[61318]: {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 11:01:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:01:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 11:01:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 11:01:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 11:01:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 11:01:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 11:01:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 11:01:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 11:01:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 11:01:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 332727a2-b516-40e2-9db1-460563e6ebd1 could not be found. Apr 21 11:01:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 11:01:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 11:01:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 11:01:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:01:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 11:01:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 11:01:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 11:01:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 11:01:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 11:01:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 11:01:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 11:01:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 11:01:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 11:01:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 11:01:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 11:01:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 11:01:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 332727a2-b516-40e2-9db1-460563e6ebd1 could not be found. Apr 21 11:01:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 11:01:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 11:01:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 11:01:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:01:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 11:01:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 11:01:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 11:01:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 11:01:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 332727a2-b516-40e2-9db1-460563e6ebd1 could not be found. Apr 21 11:01:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 11:01:22 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-019ff036-36a2-4716-b462-d6f2a8ca146e tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Returning 404 to user: Instance 332727a2-b516-40e2-9db1-460563e6ebd1 could not be found. {{(pid=61318) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 11:01:22 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-019ff036-36a2-4716-b462-d6f2a8ca146e tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] 10.0.0.210 "GET /compute/v2.1/servers/332727a2-b516-40e2-9db1-460563e6ebd1" status: 404 len: 111 microversion: 2.1 time: 0.030822 Apr 21 11:01:22 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 132/395] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 11:01:22 2023] GET /compute/v2.1/servers/332727a2-b516-40e2-9db1-460563e6ebd1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 11:01:22 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-4c54dcce-80a3-4594-89ca-65a4b1e1c10f tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Calling method '.version_select at 0x7f91a5ec7400>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:01:22 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_api:SELECT=2 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:01:22 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-4c54dcce-80a3-4594-89ca-65a4b1e1c10f tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2123760870" status: 202 len: 0 microversion: 2.1 time: 0.028756 Apr 21 11:01:22 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 132/396] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 21 11:01:22 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2123760870 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 11:01:23 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-e4cd2e63-713b-45e4-9924-4718ba7f9a88 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:01:23 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-e4cd2e63-713b-45e4-9924-4718ba7f9a88 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] [instance: 332727a2-b516-40e2-9db1-460563e6ebd1] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:01:23 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_api:SELECT=2 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:01:23 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell1:SELECT=6 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:01:23 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-e4cd2e63-713b-45e4-9924-4718ba7f9a88 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:01:23 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-e4cd2e63-713b-45e4-9924-4718ba7f9a88 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:01:23 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-e4cd2e63-713b-45e4-9924-4718ba7f9a88 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:01:23 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-e4cd2e63-713b-45e4-9924-4718ba7f9a88 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:01:23 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-e4cd2e63-713b-45e4-9924-4718ba7f9a88 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:01:23 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-e4cd2e63-713b-45e4-9924-4718ba7f9a88 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:01:23 user devstack@n-api.service[61320]: INFO nova.api.openstack.wsgi [None req-e4cd2e63-713b-45e4-9924-4718ba7f9a88 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] HTTP exception thrown: Instance 332727a2-b516-40e2-9db1-460563e6ebd1 could not be found. Apr 21 11:01:23 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-e4cd2e63-713b-45e4-9924-4718ba7f9a88 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Request method failure captured: Apr 21 11:01:23 user devstack@n-api.service[61320]: request: DELETE /compute/v2.1/servers/332727a2-b516-40e2-9db1-460563e6ebd1 HTTP/1.1 Apr 21 11:01:23 user devstack@n-api.service[61320]: Accept: application/json Apr 21 11:01:23 user devstack@n-api.service[61320]: Accept-Encoding: identity Apr 21 11:01:23 user devstack@n-api.service[61320]: Connection: close Apr 21 11:01:23 user devstack@n-api.service[61320]: Content-Length: 0 Apr 21 11:01:23 user devstack@n-api.service[61320]: Content-Type: application/json Apr 21 11:01:23 user devstack@n-api.service[61320]: Host: 10.0.0.210 Apr 21 11:01:23 user devstack@n-api.service[61320]: Openstack-System-Scope: None Apr 21 11:01:23 user devstack@n-api.service[61320]: User-Agent: python-urllib3/1.26.15 Apr 21 11:01:23 user devstack@n-api.service[61320]: X-Auth-Token: gAAAAABkQmsO4Ti6hs69z_6Ogvs4ejj7r0BZKsyfzT9wT_akUX9UJiysHbmUPTFlIxRZV4GzaKcEHtXLtDCyrbqof8A_RuWS8jMqwQkpCNmO8LpbZakx3A5g2MVGEzhF0EvvdFwMh7oY0TESImzQadQsU3RwS-vJMRw092Oq4oo7uZmU7xd_izU Apr 21 11:01:23 user devstack@n-api.service[61320]: X-Domain-Id: None Apr 21 11:01:23 user devstack@n-api.service[61320]: X-Domain-Name: None Apr 21 11:01:23 user devstack@n-api.service[61320]: X-Identity-Status: Confirmed Apr 21 11:01:23 user devstack@n-api.service[61320]: X-Is-Admin-Project: True Apr 21 11:01:23 user devstack@n-api.service[61320]: X-Project-Domain-Id: default Apr 21 11:01:23 user devstack@n-api.service[61320]: X-Project-Domain-Name: Default Apr 21 11:01:23 user devstack@n-api.service[61320]: X-Project-Id: 14bc6b0c20204c8287b3523814007856 Apr 21 11:01:23 user devstack@n-api.service[61320]: X-Project-Name: tempest-AttachVolumeNegativeTest-159654333 Apr 21 11:01:23 user devstack@n-api.service[61320]: X-Role: reader,member Apr 21 11:01:23 user devstack@n-api.service[61320]: X-Roles: reader,member Apr 21 11:01:23 user devstack@n-api.service[61320]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/14bc6b0c20204c8287b3523814007856"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/14bc6b0c20204c8287b3523814007856"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/14bc6b0c20204c8287b3523814007856"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 11:01:23 user devstack@n-api.service[61320]: X-Tenant: tempest-AttachVolumeNegativeTest-159654333 Apr 21 11:01:23 user devstack@n-api.service[61320]: X-Tenant-Id: 14bc6b0c20204c8287b3523814007856 Apr 21 11:01:23 user devstack@n-api.service[61320]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-159654333 Apr 21 11:01:23 user devstack@n-api.service[61320]: X-User: tempest-AttachVolumeNegativeTest-159654333-project-member Apr 21 11:01:23 user devstack@n-api.service[61320]: X-User-Domain-Id: default Apr 21 11:01:23 user devstack@n-api.service[61320]: X-User-Domain-Name: Default Apr 21 11:01:23 user devstack@n-api.service[61320]: X-User-Id: d7fc66871488428e9842404d885bcfe3 Apr 21 11:01:23 user devstack@n-api.service[61320]: X-User-Name: tempest-AttachVolumeNegativeTest-159654333-project-member Apr 21 11:01:23 user devstack@n-api.service[61320]: method: > Apr 21 11:01:23 user devstack@n-api.service[61320]: exception: Instance 332727a2-b516-40e2-9db1-460563e6ebd1 could not be found. Apr 21 11:01:23 user devstack@n-api.service[61320]: action_args: {'id': '332727a2-b516-40e2-9db1-460563e6ebd1'} Apr 21 11:01:23 user devstack@n-api.service[61320]: {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 332727a2-b516-40e2-9db1-460563e6ebd1 could not be found. Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 332727a2-b516-40e2-9db1-460563e6ebd1 could not be found. Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 332727a2-b516-40e2-9db1-460563e6ebd1 could not be found. Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 11:01:23 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-e4cd2e63-713b-45e4-9924-4718ba7f9a88 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Returning 404 to user: Instance 332727a2-b516-40e2-9db1-460563e6ebd1 could not be found. {{(pid=61320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 11:01:23 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-e4cd2e63-713b-45e4-9924-4718ba7f9a88 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/332727a2-b516-40e2-9db1-460563e6ebd1" status: 404 len: 111 microversion: 2.1 time: 0.032504 Apr 21 11:01:23 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 133/397] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 11:01:23 2023] DELETE /compute/v2.1/servers/332727a2-b516-40e2-9db1-460563e6ebd1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 11:01:23 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-bbe77bd2-b788-4269-ae18-8195f9f52bf1 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:01:23 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-bbe77bd2-b788-4269-ae18-8195f9f52bf1 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] [instance: 332727a2-b516-40e2-9db1-460563e6ebd1] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:01:23 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-bbe77bd2-b788-4269-ae18-8195f9f52bf1 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:01:23 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-bbe77bd2-b788-4269-ae18-8195f9f52bf1 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:01:23 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-bbe77bd2-b788-4269-ae18-8195f9f52bf1 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:01:23 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-bbe77bd2-b788-4269-ae18-8195f9f52bf1 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:01:23 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-bbe77bd2-b788-4269-ae18-8195f9f52bf1 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:01:23 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-bbe77bd2-b788-4269-ae18-8195f9f52bf1 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:01:23 user devstack@n-api.service[61318]: INFO nova.api.openstack.wsgi [None req-bbe77bd2-b788-4269-ae18-8195f9f52bf1 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] HTTP exception thrown: Instance 332727a2-b516-40e2-9db1-460563e6ebd1 could not be found. Apr 21 11:01:23 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-bbe77bd2-b788-4269-ae18-8195f9f52bf1 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Request method failure captured: Apr 21 11:01:23 user devstack@n-api.service[61318]: request: GET /compute/v2.1/servers/332727a2-b516-40e2-9db1-460563e6ebd1 HTTP/1.1 Apr 21 11:01:23 user devstack@n-api.service[61318]: Accept: application/json Apr 21 11:01:23 user devstack@n-api.service[61318]: Accept-Encoding: identity Apr 21 11:01:23 user devstack@n-api.service[61318]: Connection: close Apr 21 11:01:23 user devstack@n-api.service[61318]: Content-Length: 0 Apr 21 11:01:23 user devstack@n-api.service[61318]: Content-Type: application/json Apr 21 11:01:23 user devstack@n-api.service[61318]: Host: 10.0.0.210 Apr 21 11:01:23 user devstack@n-api.service[61318]: Openstack-System-Scope: None Apr 21 11:01:23 user devstack@n-api.service[61318]: User-Agent: python-urllib3/1.26.15 Apr 21 11:01:23 user devstack@n-api.service[61318]: X-Auth-Token: gAAAAABkQmsO4Ti6hs69z_6Ogvs4ejj7r0BZKsyfzT9wT_akUX9UJiysHbmUPTFlIxRZV4GzaKcEHtXLtDCyrbqof8A_RuWS8jMqwQkpCNmO8LpbZakx3A5g2MVGEzhF0EvvdFwMh7oY0TESImzQadQsU3RwS-vJMRw092Oq4oo7uZmU7xd_izU Apr 21 11:01:23 user devstack@n-api.service[61318]: X-Domain-Id: None Apr 21 11:01:23 user devstack@n-api.service[61318]: X-Domain-Name: None Apr 21 11:01:23 user devstack@n-api.service[61318]: X-Identity-Status: Confirmed Apr 21 11:01:23 user devstack@n-api.service[61318]: X-Is-Admin-Project: True Apr 21 11:01:23 user devstack@n-api.service[61318]: X-Project-Domain-Id: default Apr 21 11:01:23 user devstack@n-api.service[61318]: X-Project-Domain-Name: Default Apr 21 11:01:23 user devstack@n-api.service[61318]: X-Project-Id: 14bc6b0c20204c8287b3523814007856 Apr 21 11:01:23 user devstack@n-api.service[61318]: X-Project-Name: tempest-AttachVolumeNegativeTest-159654333 Apr 21 11:01:23 user devstack@n-api.service[61318]: X-Role: reader,member Apr 21 11:01:23 user devstack@n-api.service[61318]: X-Roles: reader,member Apr 21 11:01:23 user devstack@n-api.service[61318]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/14bc6b0c20204c8287b3523814007856"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/14bc6b0c20204c8287b3523814007856"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/14bc6b0c20204c8287b3523814007856"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 11:01:23 user devstack@n-api.service[61318]: X-Tenant: tempest-AttachVolumeNegativeTest-159654333 Apr 21 11:01:23 user devstack@n-api.service[61318]: X-Tenant-Id: 14bc6b0c20204c8287b3523814007856 Apr 21 11:01:23 user devstack@n-api.service[61318]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-159654333 Apr 21 11:01:23 user devstack@n-api.service[61318]: X-User: tempest-AttachVolumeNegativeTest-159654333-project-member Apr 21 11:01:23 user devstack@n-api.service[61318]: X-User-Domain-Id: default Apr 21 11:01:23 user devstack@n-api.service[61318]: X-User-Domain-Name: Default Apr 21 11:01:23 user devstack@n-api.service[61318]: X-User-Id: d7fc66871488428e9842404d885bcfe3 Apr 21 11:01:23 user devstack@n-api.service[61318]: X-User-Name: tempest-AttachVolumeNegativeTest-159654333-project-member Apr 21 11:01:23 user devstack@n-api.service[61318]: method: > Apr 21 11:01:23 user devstack@n-api.service[61318]: exception: Instance 332727a2-b516-40e2-9db1-460563e6ebd1 could not be found. Apr 21 11:01:23 user devstack@n-api.service[61318]: action_args: {'id': '332727a2-b516-40e2-9db1-460563e6ebd1'} Apr 21 11:01:23 user devstack@n-api.service[61318]: {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 332727a2-b516-40e2-9db1-460563e6ebd1 could not be found. Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 332727a2-b516-40e2-9db1-460563e6ebd1 could not be found. Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 332727a2-b516-40e2-9db1-460563e6ebd1 could not be found. Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 11:01:23 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-bbe77bd2-b788-4269-ae18-8195f9f52bf1 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Returning 404 to user: Instance 332727a2-b516-40e2-9db1-460563e6ebd1 could not be found. {{(pid=61318) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 11:01:23 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-bbe77bd2-b788-4269-ae18-8195f9f52bf1 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] 10.0.0.210 "GET /compute/v2.1/servers/332727a2-b516-40e2-9db1-460563e6ebd1" status: 404 len: 111 microversion: 2.1 time: 0.026414 Apr 21 11:01:23 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 133/398] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 11:01:23 2023] GET /compute/v2.1/servers/332727a2-b516-40e2-9db1-460563e6ebd1 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 11:01:23 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-b1043b5f-0f28-491c-b437-449d8e4ce26a tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:01:23 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-b1043b5f-0f28-491c-b437-449d8e4ce26a tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] [instance: c70df604-601e-4451-828d-20c649b6052a] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:01:23 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-b1043b5f-0f28-491c-b437-449d8e4ce26a tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:01:23 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-b1043b5f-0f28-491c-b437-449d8e4ce26a tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:01:23 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-b1043b5f-0f28-491c-b437-449d8e4ce26a tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:01:23 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-b1043b5f-0f28-491c-b437-449d8e4ce26a tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:01:23 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-b1043b5f-0f28-491c-b437-449d8e4ce26a tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:01:23 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-b1043b5f-0f28-491c-b437-449d8e4ce26a tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:01:23 user devstack@n-api.service[61319]: INFO nova.api.openstack.wsgi [None req-b1043b5f-0f28-491c-b437-449d8e4ce26a tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] HTTP exception thrown: Instance c70df604-601e-4451-828d-20c649b6052a could not be found. Apr 21 11:01:23 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-b1043b5f-0f28-491c-b437-449d8e4ce26a tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Request method failure captured: Apr 21 11:01:23 user devstack@n-api.service[61319]: request: DELETE /compute/v2.1/servers/c70df604-601e-4451-828d-20c649b6052a HTTP/1.1 Apr 21 11:01:23 user devstack@n-api.service[61319]: Accept: application/json Apr 21 11:01:23 user devstack@n-api.service[61319]: Accept-Encoding: identity Apr 21 11:01:23 user devstack@n-api.service[61319]: Connection: close Apr 21 11:01:23 user devstack@n-api.service[61319]: Content-Length: 0 Apr 21 11:01:23 user devstack@n-api.service[61319]: Content-Type: application/json Apr 21 11:01:23 user devstack@n-api.service[61319]: Host: 10.0.0.210 Apr 21 11:01:23 user devstack@n-api.service[61319]: Openstack-System-Scope: None Apr 21 11:01:23 user devstack@n-api.service[61319]: User-Agent: python-urllib3/1.26.15 Apr 21 11:01:23 user devstack@n-api.service[61319]: X-Auth-Token: gAAAAABkQmsO4Ti6hs69z_6Ogvs4ejj7r0BZKsyfzT9wT_akUX9UJiysHbmUPTFlIxRZV4GzaKcEHtXLtDCyrbqof8A_RuWS8jMqwQkpCNmO8LpbZakx3A5g2MVGEzhF0EvvdFwMh7oY0TESImzQadQsU3RwS-vJMRw092Oq4oo7uZmU7xd_izU Apr 21 11:01:23 user devstack@n-api.service[61319]: X-Domain-Id: None Apr 21 11:01:23 user devstack@n-api.service[61319]: X-Domain-Name: None Apr 21 11:01:23 user devstack@n-api.service[61319]: X-Identity-Status: Confirmed Apr 21 11:01:23 user devstack@n-api.service[61319]: X-Is-Admin-Project: True Apr 21 11:01:23 user devstack@n-api.service[61319]: X-Project-Domain-Id: default Apr 21 11:01:23 user devstack@n-api.service[61319]: X-Project-Domain-Name: Default Apr 21 11:01:23 user devstack@n-api.service[61319]: X-Project-Id: 14bc6b0c20204c8287b3523814007856 Apr 21 11:01:23 user devstack@n-api.service[61319]: X-Project-Name: tempest-AttachVolumeNegativeTest-159654333 Apr 21 11:01:23 user devstack@n-api.service[61319]: X-Role: reader,member Apr 21 11:01:23 user devstack@n-api.service[61319]: X-Roles: reader,member Apr 21 11:01:23 user devstack@n-api.service[61319]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/14bc6b0c20204c8287b3523814007856"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/14bc6b0c20204c8287b3523814007856"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/14bc6b0c20204c8287b3523814007856"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 11:01:23 user devstack@n-api.service[61319]: X-Tenant: tempest-AttachVolumeNegativeTest-159654333 Apr 21 11:01:23 user devstack@n-api.service[61319]: X-Tenant-Id: 14bc6b0c20204c8287b3523814007856 Apr 21 11:01:23 user devstack@n-api.service[61319]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-159654333 Apr 21 11:01:23 user devstack@n-api.service[61319]: X-User: tempest-AttachVolumeNegativeTest-159654333-project-member Apr 21 11:01:23 user devstack@n-api.service[61319]: X-User-Domain-Id: default Apr 21 11:01:23 user devstack@n-api.service[61319]: X-User-Domain-Name: Default Apr 21 11:01:23 user devstack@n-api.service[61319]: X-User-Id: d7fc66871488428e9842404d885bcfe3 Apr 21 11:01:23 user devstack@n-api.service[61319]: X-User-Name: tempest-AttachVolumeNegativeTest-159654333-project-member Apr 21 11:01:23 user devstack@n-api.service[61319]: method: > Apr 21 11:01:23 user devstack@n-api.service[61319]: exception: Instance c70df604-601e-4451-828d-20c649b6052a could not be found. Apr 21 11:01:23 user devstack@n-api.service[61319]: action_args: {'id': 'c70df604-601e-4451-828d-20c649b6052a'} Apr 21 11:01:23 user devstack@n-api.service[61319]: {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c70df604-601e-4451-828d-20c649b6052a could not be found. Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c70df604-601e-4451-828d-20c649b6052a could not be found. Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c70df604-601e-4451-828d-20c649b6052a could not be found. Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 11:01:23 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-b1043b5f-0f28-491c-b437-449d8e4ce26a tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Returning 404 to user: Instance c70df604-601e-4451-828d-20c649b6052a could not be found. {{(pid=61319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 11:01:23 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-b1043b5f-0f28-491c-b437-449d8e4ce26a tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c70df604-601e-4451-828d-20c649b6052a" status: 404 len: 111 microversion: 2.1 time: 0.028706 Apr 21 11:01:23 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 133/399] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 11:01:23 2023] DELETE /compute/v2.1/servers/c70df604-601e-4451-828d-20c649b6052a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 11:01:23 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-55a8a9be-1dbd-4527-b3b0-68bcc73cf821 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:01:23 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-55a8a9be-1dbd-4527-b3b0-68bcc73cf821 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] [instance: c70df604-601e-4451-828d-20c649b6052a] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:01:23 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-55a8a9be-1dbd-4527-b3b0-68bcc73cf821 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:01:23 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-55a8a9be-1dbd-4527-b3b0-68bcc73cf821 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:01:23 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-55a8a9be-1dbd-4527-b3b0-68bcc73cf821 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:01:23 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-55a8a9be-1dbd-4527-b3b0-68bcc73cf821 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:01:23 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-55a8a9be-1dbd-4527-b3b0-68bcc73cf821 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:01:23 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-55a8a9be-1dbd-4527-b3b0-68bcc73cf821 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:01:23 user devstack@n-api.service[61320]: INFO nova.api.openstack.wsgi [None req-55a8a9be-1dbd-4527-b3b0-68bcc73cf821 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] HTTP exception thrown: Instance c70df604-601e-4451-828d-20c649b6052a could not be found. Apr 21 11:01:23 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-55a8a9be-1dbd-4527-b3b0-68bcc73cf821 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Request method failure captured: Apr 21 11:01:23 user devstack@n-api.service[61320]: request: GET /compute/v2.1/servers/c70df604-601e-4451-828d-20c649b6052a HTTP/1.1 Apr 21 11:01:23 user devstack@n-api.service[61320]: Accept: application/json Apr 21 11:01:23 user devstack@n-api.service[61320]: Accept-Encoding: identity Apr 21 11:01:23 user devstack@n-api.service[61320]: Connection: close Apr 21 11:01:23 user devstack@n-api.service[61320]: Content-Length: 0 Apr 21 11:01:23 user devstack@n-api.service[61320]: Content-Type: application/json Apr 21 11:01:23 user devstack@n-api.service[61320]: Host: 10.0.0.210 Apr 21 11:01:23 user devstack@n-api.service[61320]: Openstack-System-Scope: None Apr 21 11:01:23 user devstack@n-api.service[61320]: User-Agent: python-urllib3/1.26.15 Apr 21 11:01:23 user devstack@n-api.service[61320]: X-Auth-Token: gAAAAABkQmsO4Ti6hs69z_6Ogvs4ejj7r0BZKsyfzT9wT_akUX9UJiysHbmUPTFlIxRZV4GzaKcEHtXLtDCyrbqof8A_RuWS8jMqwQkpCNmO8LpbZakx3A5g2MVGEzhF0EvvdFwMh7oY0TESImzQadQsU3RwS-vJMRw092Oq4oo7uZmU7xd_izU Apr 21 11:01:23 user devstack@n-api.service[61320]: X-Domain-Id: None Apr 21 11:01:23 user devstack@n-api.service[61320]: X-Domain-Name: None Apr 21 11:01:23 user devstack@n-api.service[61320]: X-Identity-Status: Confirmed Apr 21 11:01:23 user devstack@n-api.service[61320]: X-Is-Admin-Project: True Apr 21 11:01:23 user devstack@n-api.service[61320]: X-Project-Domain-Id: default Apr 21 11:01:23 user devstack@n-api.service[61320]: X-Project-Domain-Name: Default Apr 21 11:01:23 user devstack@n-api.service[61320]: X-Project-Id: 14bc6b0c20204c8287b3523814007856 Apr 21 11:01:23 user devstack@n-api.service[61320]: X-Project-Name: tempest-AttachVolumeNegativeTest-159654333 Apr 21 11:01:23 user devstack@n-api.service[61320]: X-Role: reader,member Apr 21 11:01:23 user devstack@n-api.service[61320]: X-Roles: reader,member Apr 21 11:01:23 user devstack@n-api.service[61320]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/14bc6b0c20204c8287b3523814007856"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/14bc6b0c20204c8287b3523814007856"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/14bc6b0c20204c8287b3523814007856"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 11:01:23 user devstack@n-api.service[61320]: X-Tenant: tempest-AttachVolumeNegativeTest-159654333 Apr 21 11:01:23 user devstack@n-api.service[61320]: X-Tenant-Id: 14bc6b0c20204c8287b3523814007856 Apr 21 11:01:23 user devstack@n-api.service[61320]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-159654333 Apr 21 11:01:23 user devstack@n-api.service[61320]: X-User: tempest-AttachVolumeNegativeTest-159654333-project-member Apr 21 11:01:23 user devstack@n-api.service[61320]: X-User-Domain-Id: default Apr 21 11:01:23 user devstack@n-api.service[61320]: X-User-Domain-Name: Default Apr 21 11:01:23 user devstack@n-api.service[61320]: X-User-Id: d7fc66871488428e9842404d885bcfe3 Apr 21 11:01:23 user devstack@n-api.service[61320]: X-User-Name: tempest-AttachVolumeNegativeTest-159654333-project-member Apr 21 11:01:23 user devstack@n-api.service[61320]: method: > Apr 21 11:01:23 user devstack@n-api.service[61320]: exception: Instance c70df604-601e-4451-828d-20c649b6052a could not be found. Apr 21 11:01:23 user devstack@n-api.service[61320]: action_args: {'id': 'c70df604-601e-4451-828d-20c649b6052a'} Apr 21 11:01:23 user devstack@n-api.service[61320]: {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c70df604-601e-4451-828d-20c649b6052a could not be found. Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c70df604-601e-4451-828d-20c649b6052a could not be found. Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c70df604-601e-4451-828d-20c649b6052a could not be found. Apr 21 11:01:23 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 11:01:23 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-55a8a9be-1dbd-4527-b3b0-68bcc73cf821 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Returning 404 to user: Instance c70df604-601e-4451-828d-20c649b6052a could not be found. {{(pid=61320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 11:01:23 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-55a8a9be-1dbd-4527-b3b0-68bcc73cf821 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c70df604-601e-4451-828d-20c649b6052a" status: 404 len: 111 microversion: 2.1 time: 0.029764 Apr 21 11:01:23 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 134/400] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 11:01:23 2023] GET /compute/v2.1/servers/c70df604-601e-4451-828d-20c649b6052a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 11:01:23 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-706dd926-bc5c-43fe-836d-623af095ae0d tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:01:23 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-706dd926-bc5c-43fe-836d-623af095ae0d tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] [instance: d28e1e38-3ed5-468e-b672-8b94a909820c] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:01:23 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-706dd926-bc5c-43fe-836d-623af095ae0d tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:01:23 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-706dd926-bc5c-43fe-836d-623af095ae0d tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:01:23 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-706dd926-bc5c-43fe-836d-623af095ae0d tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:01:23 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-706dd926-bc5c-43fe-836d-623af095ae0d tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:01:23 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-706dd926-bc5c-43fe-836d-623af095ae0d tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:01:23 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-706dd926-bc5c-43fe-836d-623af095ae0d tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:01:23 user devstack@n-api.service[61318]: INFO nova.api.openstack.wsgi [None req-706dd926-bc5c-43fe-836d-623af095ae0d tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] HTTP exception thrown: Instance d28e1e38-3ed5-468e-b672-8b94a909820c could not be found. Apr 21 11:01:23 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-706dd926-bc5c-43fe-836d-623af095ae0d tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Request method failure captured: Apr 21 11:01:23 user devstack@n-api.service[61318]: request: DELETE /compute/v2.1/servers/d28e1e38-3ed5-468e-b672-8b94a909820c HTTP/1.1 Apr 21 11:01:23 user devstack@n-api.service[61318]: Accept: application/json Apr 21 11:01:23 user devstack@n-api.service[61318]: Accept-Encoding: identity Apr 21 11:01:23 user devstack@n-api.service[61318]: Connection: close Apr 21 11:01:23 user devstack@n-api.service[61318]: Content-Length: 0 Apr 21 11:01:23 user devstack@n-api.service[61318]: Content-Type: application/json Apr 21 11:01:23 user devstack@n-api.service[61318]: Host: 10.0.0.210 Apr 21 11:01:23 user devstack@n-api.service[61318]: Openstack-System-Scope: None Apr 21 11:01:23 user devstack@n-api.service[61318]: User-Agent: python-urllib3/1.26.15 Apr 21 11:01:23 user devstack@n-api.service[61318]: X-Auth-Token: gAAAAABkQmsO4Ti6hs69z_6Ogvs4ejj7r0BZKsyfzT9wT_akUX9UJiysHbmUPTFlIxRZV4GzaKcEHtXLtDCyrbqof8A_RuWS8jMqwQkpCNmO8LpbZakx3A5g2MVGEzhF0EvvdFwMh7oY0TESImzQadQsU3RwS-vJMRw092Oq4oo7uZmU7xd_izU Apr 21 11:01:23 user devstack@n-api.service[61318]: X-Domain-Id: None Apr 21 11:01:23 user devstack@n-api.service[61318]: X-Domain-Name: None Apr 21 11:01:23 user devstack@n-api.service[61318]: X-Identity-Status: Confirmed Apr 21 11:01:23 user devstack@n-api.service[61318]: X-Is-Admin-Project: True Apr 21 11:01:23 user devstack@n-api.service[61318]: X-Project-Domain-Id: default Apr 21 11:01:23 user devstack@n-api.service[61318]: X-Project-Domain-Name: Default Apr 21 11:01:23 user devstack@n-api.service[61318]: X-Project-Id: 14bc6b0c20204c8287b3523814007856 Apr 21 11:01:23 user devstack@n-api.service[61318]: X-Project-Name: tempest-AttachVolumeNegativeTest-159654333 Apr 21 11:01:23 user devstack@n-api.service[61318]: X-Role: reader,member Apr 21 11:01:23 user devstack@n-api.service[61318]: X-Roles: reader,member Apr 21 11:01:23 user devstack@n-api.service[61318]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/14bc6b0c20204c8287b3523814007856"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/14bc6b0c20204c8287b3523814007856"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/14bc6b0c20204c8287b3523814007856"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 11:01:23 user devstack@n-api.service[61318]: X-Tenant: tempest-AttachVolumeNegativeTest-159654333 Apr 21 11:01:23 user devstack@n-api.service[61318]: X-Tenant-Id: 14bc6b0c20204c8287b3523814007856 Apr 21 11:01:23 user devstack@n-api.service[61318]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-159654333 Apr 21 11:01:23 user devstack@n-api.service[61318]: X-User: tempest-AttachVolumeNegativeTest-159654333-project-member Apr 21 11:01:23 user devstack@n-api.service[61318]: X-User-Domain-Id: default Apr 21 11:01:23 user devstack@n-api.service[61318]: X-User-Domain-Name: Default Apr 21 11:01:23 user devstack@n-api.service[61318]: X-User-Id: d7fc66871488428e9842404d885bcfe3 Apr 21 11:01:23 user devstack@n-api.service[61318]: X-User-Name: tempest-AttachVolumeNegativeTest-159654333-project-member Apr 21 11:01:23 user devstack@n-api.service[61318]: method: > Apr 21 11:01:23 user devstack@n-api.service[61318]: exception: Instance d28e1e38-3ed5-468e-b672-8b94a909820c could not be found. Apr 21 11:01:23 user devstack@n-api.service[61318]: action_args: {'id': 'd28e1e38-3ed5-468e-b672-8b94a909820c'} Apr 21 11:01:23 user devstack@n-api.service[61318]: {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d28e1e38-3ed5-468e-b672-8b94a909820c could not be found. Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d28e1e38-3ed5-468e-b672-8b94a909820c could not be found. Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d28e1e38-3ed5-468e-b672-8b94a909820c could not be found. Apr 21 11:01:23 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 11:01:23 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-706dd926-bc5c-43fe-836d-623af095ae0d tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Returning 404 to user: Instance d28e1e38-3ed5-468e-b672-8b94a909820c could not be found. {{(pid=61318) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 11:01:23 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-706dd926-bc5c-43fe-836d-623af095ae0d tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d28e1e38-3ed5-468e-b672-8b94a909820c" status: 404 len: 111 microversion: 2.1 time: 0.035369 Apr 21 11:01:23 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 134/401] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 11:01:23 2023] DELETE /compute/v2.1/servers/d28e1e38-3ed5-468e-b672-8b94a909820c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 11:01:23 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-c98efc67-a1fa-4130-82d1-bc8908c4c418 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:01:23 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-c98efc67-a1fa-4130-82d1-bc8908c4c418 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] [instance: d28e1e38-3ed5-468e-b672-8b94a909820c] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:01:23 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-c98efc67-a1fa-4130-82d1-bc8908c4c418 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:01:23 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-c98efc67-a1fa-4130-82d1-bc8908c4c418 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:01:23 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-c98efc67-a1fa-4130-82d1-bc8908c4c418 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:01:23 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-c98efc67-a1fa-4130-82d1-bc8908c4c418 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:01:23 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-c98efc67-a1fa-4130-82d1-bc8908c4c418 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:01:23 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-c98efc67-a1fa-4130-82d1-bc8908c4c418 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:01:23 user devstack@n-api.service[61319]: INFO nova.api.openstack.wsgi [None req-c98efc67-a1fa-4130-82d1-bc8908c4c418 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] HTTP exception thrown: Instance d28e1e38-3ed5-468e-b672-8b94a909820c could not be found. Apr 21 11:01:23 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-c98efc67-a1fa-4130-82d1-bc8908c4c418 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Request method failure captured: Apr 21 11:01:23 user devstack@n-api.service[61319]: request: GET /compute/v2.1/servers/d28e1e38-3ed5-468e-b672-8b94a909820c HTTP/1.1 Apr 21 11:01:23 user devstack@n-api.service[61319]: Accept: application/json Apr 21 11:01:23 user devstack@n-api.service[61319]: Accept-Encoding: identity Apr 21 11:01:23 user devstack@n-api.service[61319]: Connection: close Apr 21 11:01:23 user devstack@n-api.service[61319]: Content-Length: 0 Apr 21 11:01:23 user devstack@n-api.service[61319]: Content-Type: application/json Apr 21 11:01:23 user devstack@n-api.service[61319]: Host: 10.0.0.210 Apr 21 11:01:23 user devstack@n-api.service[61319]: Openstack-System-Scope: None Apr 21 11:01:23 user devstack@n-api.service[61319]: User-Agent: python-urllib3/1.26.15 Apr 21 11:01:23 user devstack@n-api.service[61319]: X-Auth-Token: gAAAAABkQmsO4Ti6hs69z_6Ogvs4ejj7r0BZKsyfzT9wT_akUX9UJiysHbmUPTFlIxRZV4GzaKcEHtXLtDCyrbqof8A_RuWS8jMqwQkpCNmO8LpbZakx3A5g2MVGEzhF0EvvdFwMh7oY0TESImzQadQsU3RwS-vJMRw092Oq4oo7uZmU7xd_izU Apr 21 11:01:23 user devstack@n-api.service[61319]: X-Domain-Id: None Apr 21 11:01:23 user devstack@n-api.service[61319]: X-Domain-Name: None Apr 21 11:01:23 user devstack@n-api.service[61319]: X-Identity-Status: Confirmed Apr 21 11:01:23 user devstack@n-api.service[61319]: X-Is-Admin-Project: True Apr 21 11:01:23 user devstack@n-api.service[61319]: X-Project-Domain-Id: default Apr 21 11:01:23 user devstack@n-api.service[61319]: X-Project-Domain-Name: Default Apr 21 11:01:23 user devstack@n-api.service[61319]: X-Project-Id: 14bc6b0c20204c8287b3523814007856 Apr 21 11:01:23 user devstack@n-api.service[61319]: X-Project-Name: tempest-AttachVolumeNegativeTest-159654333 Apr 21 11:01:23 user devstack@n-api.service[61319]: X-Role: reader,member Apr 21 11:01:23 user devstack@n-api.service[61319]: X-Roles: reader,member Apr 21 11:01:23 user devstack@n-api.service[61319]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/14bc6b0c20204c8287b3523814007856"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/14bc6b0c20204c8287b3523814007856"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/14bc6b0c20204c8287b3523814007856"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 11:01:23 user devstack@n-api.service[61319]: X-Tenant: tempest-AttachVolumeNegativeTest-159654333 Apr 21 11:01:23 user devstack@n-api.service[61319]: X-Tenant-Id: 14bc6b0c20204c8287b3523814007856 Apr 21 11:01:23 user devstack@n-api.service[61319]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-159654333 Apr 21 11:01:23 user devstack@n-api.service[61319]: X-User: tempest-AttachVolumeNegativeTest-159654333-project-member Apr 21 11:01:23 user devstack@n-api.service[61319]: X-User-Domain-Id: default Apr 21 11:01:23 user devstack@n-api.service[61319]: X-User-Domain-Name: Default Apr 21 11:01:23 user devstack@n-api.service[61319]: X-User-Id: d7fc66871488428e9842404d885bcfe3 Apr 21 11:01:23 user devstack@n-api.service[61319]: X-User-Name: tempest-AttachVolumeNegativeTest-159654333-project-member Apr 21 11:01:23 user devstack@n-api.service[61319]: method: > Apr 21 11:01:23 user devstack@n-api.service[61319]: exception: Instance d28e1e38-3ed5-468e-b672-8b94a909820c could not be found. Apr 21 11:01:23 user devstack@n-api.service[61319]: action_args: {'id': 'd28e1e38-3ed5-468e-b672-8b94a909820c'} Apr 21 11:01:23 user devstack@n-api.service[61319]: {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d28e1e38-3ed5-468e-b672-8b94a909820c could not be found. Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d28e1e38-3ed5-468e-b672-8b94a909820c could not be found. Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d28e1e38-3ed5-468e-b672-8b94a909820c could not be found. Apr 21 11:01:23 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 11:01:23 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-c98efc67-a1fa-4130-82d1-bc8908c4c418 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] Returning 404 to user: Instance d28e1e38-3ed5-468e-b672-8b94a909820c could not be found. {{(pid=61319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 11:01:23 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-c98efc67-a1fa-4130-82d1-bc8908c4c418 tempest-AttachVolumeNegativeTest-159654333 tempest-AttachVolumeNegativeTest-159654333-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d28e1e38-3ed5-468e-b672-8b94a909820c" status: 404 len: 111 microversion: 2.1 time: 0.026481 Apr 21 11:01:23 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 134/402] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 11:01:23 2023] GET /compute/v2.1/servers/d28e1e38-3ed5-468e-b672-8b94a909820c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 11:01:55 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-e01d5701-a573-4c29-ac36-49a717a2c77f tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:01:55 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-e01d5701-a573-4c29-ac36-49a717a2c77f tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] [instance: d1fca309-1d26-4a34-b932-716064b86b00] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:01:55 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_api:SELECT=4 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:01:55 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell1:SELECT=4 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:01:55 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-e01d5701-a573-4c29-ac36-49a717a2c77f tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:01:55 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-e01d5701-a573-4c29-ac36-49a717a2c77f tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:01:55 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-e01d5701-a573-4c29-ac36-49a717a2c77f tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:01:55 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-e01d5701-a573-4c29-ac36-49a717a2c77f tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:01:55 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-e01d5701-a573-4c29-ac36-49a717a2c77f tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:01:55 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-e01d5701-a573-4c29-ac36-49a717a2c77f tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:01:55 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-e01d5701-a573-4c29-ac36-49a717a2c77f tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] [instance: d1fca309-1d26-4a34-b932-716064b86b00] Going to try to terminate instance {{(pid=61320) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 11:01:55 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-e01d5701-a573-4c29-ac36-49a717a2c77f tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d1fca309-1d26-4a34-b932-716064b86b00" status: 204 len: 0 microversion: 2.1 time: 0.129745 Apr 21 11:01:55 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 135/403] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 11:01:55 2023] DELETE /compute/v2.1/servers/d1fca309-1d26-4a34-b932-716064b86b00 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 11:01:55 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-61827845-7e5c-4693-bcae-8c8f3dc24139 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:01:55 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-61827845-7e5c-4693-bcae-8c8f3dc24139 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] [instance: d1fca309-1d26-4a34-b932-716064b86b00] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:01:55 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_api:SELECT=6 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:01:55 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell1:SELECT=6 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:01:55 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-61827845-7e5c-4693-bcae-8c8f3dc24139 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:01:55 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-61827845-7e5c-4693-bcae-8c8f3dc24139 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:01:55 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-61827845-7e5c-4693-bcae-8c8f3dc24139 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:01:55 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-61827845-7e5c-4693-bcae-8c8f3dc24139 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:01:55 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-61827845-7e5c-4693-bcae-8c8f3dc24139 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:01:55 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-61827845-7e5c-4693-bcae-8c8f3dc24139 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:01:55 user devstack@n-api.service[61318]: DEBUG nova.policy [None req-61827845-7e5c-4693-bcae-8c8f3dc24139 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f73ac02062c4411bde0c97f6a719926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a611b8a8d54522929c37807054b2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61318) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 11:01:55 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-61827845-7e5c-4693-bcae-8c8f3dc24139 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d1fca309-1d26-4a34-b932-716064b86b00" status: 200 len: 1493 microversion: 2.1 time: 0.378424 Apr 21 11:01:55 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 135/404] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 11:01:55 2023] GET /compute/v2.1/servers/d1fca309-1d26-4a34-b932-716064b86b00 => generated 1493 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 11:01:55 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-b831a792-1a2f-40ec-abcc-30aea9a56e5a req-52e80f05-e9c5-4634-86d8-6c252833fb14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1fca309-1d26-4a34-b932-716064b86b00", "name": "network-vif-unplugged", "status": "completed", "tag": "8abc9260-fa02-4915-a056-63262b57e3be"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 11:01:55 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:01:55 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell1:SELECT=6 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:01:55 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-b831a792-1a2f-40ec-abcc-30aea9a56e5a req-52e80f05-e9c5-4634-86d8-6c252833fb14 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:01:55 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-b831a792-1a2f-40ec-abcc-30aea9a56e5a req-52e80f05-e9c5-4634-86d8-6c252833fb14 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:01:55 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-b831a792-1a2f-40ec-abcc-30aea9a56e5a req-52e80f05-e9c5-4634-86d8-6c252833fb14 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:01:55 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-b831a792-1a2f-40ec-abcc-30aea9a56e5a req-52e80f05-e9c5-4634-86d8-6c252833fb14 service nova] Creating event network-vif-unplugged:8abc9260-fa02-4915-a056-63262b57e3be for instance d1fca309-1d26-4a34-b932-716064b86b00 on user Apr 21 11:01:55 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-b831a792-1a2f-40ec-abcc-30aea9a56e5a req-52e80f05-e9c5-4634-86d8-6c252833fb14 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045806 Apr 21 11:01:55 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 135/405] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 11:01:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 11:01:56 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [req-69d30f2e-4407-49c6-9884-0f8c434eccdd req-b72b0d30-d477-4e92-b45d-0c910f220401 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1fca309-1d26-4a34-b932-716064b86b00", "name": "network-vif-deleted", "tag": "8abc9260-fa02-4915-a056-63262b57e3be"}]} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 11:01:56 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-69d30f2e-4407-49c6-9884-0f8c434eccdd req-b72b0d30-d477-4e92-b45d-0c910f220401 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:01:56 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-69d30f2e-4407-49c6-9884-0f8c434eccdd req-b72b0d30-d477-4e92-b45d-0c910f220401 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:01:56 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-69d30f2e-4407-49c6-9884-0f8c434eccdd req-b72b0d30-d477-4e92-b45d-0c910f220401 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:01:56 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-69d30f2e-4407-49c6-9884-0f8c434eccdd req-b72b0d30-d477-4e92-b45d-0c910f220401 service nova] Creating event network-vif-deleted:8abc9260-fa02-4915-a056-63262b57e3be for instance d1fca309-1d26-4a34-b932-716064b86b00 on user Apr 21 11:01:56 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [req-69d30f2e-4407-49c6-9884-0f8c434eccdd req-b72b0d30-d477-4e92-b45d-0c910f220401 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033853 Apr 21 11:01:56 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 136/406] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 11:01:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 11:01:57 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [req-be21e5bd-efb4-4b96-ac77-17ac6e317609 req-b7df87e7-e500-4080-a418-4b228711bae1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1fca309-1d26-4a34-b932-716064b86b00", "name": "network-vif-plugged", "status": "completed", "tag": "8abc9260-fa02-4915-a056-63262b57e3be"}]} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 11:01:57 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-be21e5bd-efb4-4b96-ac77-17ac6e317609 req-b7df87e7-e500-4080-a418-4b228711bae1 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:01:57 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-be21e5bd-efb4-4b96-ac77-17ac6e317609 req-b7df87e7-e500-4080-a418-4b228711bae1 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:01:57 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-be21e5bd-efb4-4b96-ac77-17ac6e317609 req-b7df87e7-e500-4080-a418-4b228711bae1 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:01:57 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-be21e5bd-efb4-4b96-ac77-17ac6e317609 req-b7df87e7-e500-4080-a418-4b228711bae1 service nova] Creating event network-vif-plugged:8abc9260-fa02-4915-a056-63262b57e3be for instance d1fca309-1d26-4a34-b932-716064b86b00 on user Apr 21 11:01:57 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [req-be21e5bd-efb4-4b96-ac77-17ac6e317609 req-b7df87e7-e500-4080-a418-4b228711bae1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030602 Apr 21 11:01:57 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 136/407] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 11:01:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 11:02:09 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell1:SELECT=2 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:02:09 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_api:SELECT=2 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:02:09 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-99c60cb6-5633-4de6-a0e1-1ea80fe8728e tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:02:09 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-99c60cb6-5633-4de6-a0e1-1ea80fe8728e tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] [instance: 595d41a4-9a01-4aa2-96a1-c2c763475184] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:02:09 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-99c60cb6-5633-4de6-a0e1-1ea80fe8728e tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:02:09 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-99c60cb6-5633-4de6-a0e1-1ea80fe8728e tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:02:09 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-99c60cb6-5633-4de6-a0e1-1ea80fe8728e tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:02:09 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-99c60cb6-5633-4de6-a0e1-1ea80fe8728e tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:02:09 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-99c60cb6-5633-4de6-a0e1-1ea80fe8728e tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:02:09 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-99c60cb6-5633-4de6-a0e1-1ea80fe8728e tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:02:09 user devstack@n-api.service[61319]: DEBUG nova.policy [None req-99c60cb6-5633-4de6-a0e1-1ea80fe8728e tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95956d2e4ea84534b6d5628eb8dd184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc12d15daf34c5e9d26a6cc53795efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61319) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 11:02:09 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-99c60cb6-5633-4de6-a0e1-1ea80fe8728e tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] 10.0.0.210 "GET /compute/v2.1/servers/595d41a4-9a01-4aa2-96a1-c2c763475184" status: 200 len: 1494 microversion: 2.1 time: 0.478525 Apr 21 11:02:09 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 136/408] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 11:02:09 2023] GET /compute/v2.1/servers/595d41a4-9a01-4aa2-96a1-c2c763475184 => generated 1494 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 11:02:45 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:02:45 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:02:45 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-1e17663d-f42e-456f-9f10-055e1aceb301 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:02:45 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-1e17663d-f42e-456f-9f10-055e1aceb301 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] [instance: d1fca309-1d26-4a34-b932-716064b86b00] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:02:45 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-1e17663d-f42e-456f-9f10-055e1aceb301 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:02:45 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-1e17663d-f42e-456f-9f10-055e1aceb301 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:02:45 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-1e17663d-f42e-456f-9f10-055e1aceb301 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:02:45 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-1e17663d-f42e-456f-9f10-055e1aceb301 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:02:45 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-1e17663d-f42e-456f-9f10-055e1aceb301 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:02:45 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-1e17663d-f42e-456f-9f10-055e1aceb301 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:02:45 user devstack@n-api.service[61320]: INFO nova.api.openstack.wsgi [None req-1e17663d-f42e-456f-9f10-055e1aceb301 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] HTTP exception thrown: Instance d1fca309-1d26-4a34-b932-716064b86b00 could not be found. Apr 21 11:02:45 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-1e17663d-f42e-456f-9f10-055e1aceb301 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Request method failure captured: Apr 21 11:02:45 user devstack@n-api.service[61320]: request: GET /compute/v2.1/servers/d1fca309-1d26-4a34-b932-716064b86b00 HTTP/1.1 Apr 21 11:02:45 user devstack@n-api.service[61320]: Accept: application/json Apr 21 11:02:45 user devstack@n-api.service[61320]: Accept-Encoding: identity Apr 21 11:02:45 user devstack@n-api.service[61320]: Connection: close Apr 21 11:02:45 user devstack@n-api.service[61320]: Content-Length: 0 Apr 21 11:02:45 user devstack@n-api.service[61320]: Content-Type: application/json Apr 21 11:02:45 user devstack@n-api.service[61320]: Host: 10.0.0.210 Apr 21 11:02:45 user devstack@n-api.service[61320]: Openstack-System-Scope: None Apr 21 11:02:45 user devstack@n-api.service[61320]: User-Agent: python-urllib3/1.26.15 Apr 21 11:02:45 user devstack@n-api.service[61320]: X-Auth-Token: gAAAAABkQmwEW6K0A__3oMwts29ZtL9alK7r9yUV9_QzNgQac4dLp8ddo9PNUqE6bx0WkGQfLgl5VwDt-xBBjo3nlwR_8Zw9QWxTbLtKH4dqipBGjvHPEd7lKUqpAoOotEhUWvCP2rKWXTEb0ba_OwMixRWwlkSA-3VChQlfsOpLBIWkQUrPmgM Apr 21 11:02:45 user devstack@n-api.service[61320]: X-Domain-Id: None Apr 21 11:02:45 user devstack@n-api.service[61320]: X-Domain-Name: None Apr 21 11:02:45 user devstack@n-api.service[61320]: X-Identity-Status: Confirmed Apr 21 11:02:45 user devstack@n-api.service[61320]: X-Is-Admin-Project: True Apr 21 11:02:45 user devstack@n-api.service[61320]: X-Project-Domain-Id: default Apr 21 11:02:45 user devstack@n-api.service[61320]: X-Project-Domain-Name: Default Apr 21 11:02:45 user devstack@n-api.service[61320]: X-Project-Id: c0a611b8a8d54522929c37807054b2f6 Apr 21 11:02:45 user devstack@n-api.service[61320]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1656706265 Apr 21 11:02:45 user devstack@n-api.service[61320]: X-Role: reader,member Apr 21 11:02:45 user devstack@n-api.service[61320]: X-Roles: reader,member Apr 21 11:02:45 user devstack@n-api.service[61320]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c0a611b8a8d54522929c37807054b2f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c0a611b8a8d54522929c37807054b2f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c0a611b8a8d54522929c37807054b2f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 11:02:45 user devstack@n-api.service[61320]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1656706265 Apr 21 11:02:45 user devstack@n-api.service[61320]: X-Tenant-Id: c0a611b8a8d54522929c37807054b2f6 Apr 21 11:02:45 user devstack@n-api.service[61320]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1656706265 Apr 21 11:02:45 user devstack@n-api.service[61320]: X-User: tempest-ServerRescueNegativeTestJSON-1656706265-project-member Apr 21 11:02:45 user devstack@n-api.service[61320]: X-User-Domain-Id: default Apr 21 11:02:45 user devstack@n-api.service[61320]: X-User-Domain-Name: Default Apr 21 11:02:45 user devstack@n-api.service[61320]: X-User-Id: 0f73ac02062c4411bde0c97f6a719926 Apr 21 11:02:45 user devstack@n-api.service[61320]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1656706265-project-member Apr 21 11:02:45 user devstack@n-api.service[61320]: method: > Apr 21 11:02:45 user devstack@n-api.service[61320]: exception: Instance d1fca309-1d26-4a34-b932-716064b86b00 could not be found. Apr 21 11:02:45 user devstack@n-api.service[61320]: action_args: {'id': 'd1fca309-1d26-4a34-b932-716064b86b00'} Apr 21 11:02:45 user devstack@n-api.service[61320]: {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 11:02:45 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:02:45 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 11:02:45 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 11:02:45 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 11:02:45 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 11:02:45 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 11:02:45 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 11:02:45 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 11:02:45 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 11:02:45 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1fca309-1d26-4a34-b932-716064b86b00 could not be found. Apr 21 11:02:45 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 11:02:45 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 11:02:45 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 11:02:45 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:02:45 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 11:02:45 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 11:02:45 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 11:02:45 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 11:02:45 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 11:02:45 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 11:02:45 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 11:02:45 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 11:02:45 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 11:02:45 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 11:02:45 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 11:02:45 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 11:02:45 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1fca309-1d26-4a34-b932-716064b86b00 could not be found. Apr 21 11:02:45 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 11:02:45 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 11:02:45 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 11:02:45 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:02:45 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 11:02:45 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 11:02:45 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 11:02:45 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 11:02:45 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1fca309-1d26-4a34-b932-716064b86b00 could not be found. Apr 21 11:02:45 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 11:02:45 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-1e17663d-f42e-456f-9f10-055e1aceb301 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Returning 404 to user: Instance d1fca309-1d26-4a34-b932-716064b86b00 could not be found. {{(pid=61320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 11:02:45 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-1e17663d-f42e-456f-9f10-055e1aceb301 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d1fca309-1d26-4a34-b932-716064b86b00" status: 404 len: 111 microversion: 2.1 time: 0.218820 Apr 21 11:02:45 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 137/409] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 11:02:45 2023] GET /compute/v2.1/servers/d1fca309-1d26-4a34-b932-716064b86b00 => generated 111 bytes in 221 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 11:02:45 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_api:SELECT=4 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:02:45 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell1:SELECT=8 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:02:45 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-aadd679c-5533-4a72-a66f-c77e34441ebe tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:02:45 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-aadd679c-5533-4a72-a66f-c77e34441ebe tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] [instance: 476dbf2e-b02a-47bc-a8c6-6d0d66d5d433] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:02:45 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-aadd679c-5533-4a72-a66f-c77e34441ebe tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:02:45 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-aadd679c-5533-4a72-a66f-c77e34441ebe tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:02:45 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-aadd679c-5533-4a72-a66f-c77e34441ebe tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:02:45 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-aadd679c-5533-4a72-a66f-c77e34441ebe tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:02:45 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-aadd679c-5533-4a72-a66f-c77e34441ebe tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:02:45 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-aadd679c-5533-4a72-a66f-c77e34441ebe tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:02:45 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-aadd679c-5533-4a72-a66f-c77e34441ebe tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] [instance: 476dbf2e-b02a-47bc-a8c6-6d0d66d5d433] Going to try to terminate instance {{(pid=61318) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 11:02:46 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-aadd679c-5533-4a72-a66f-c77e34441ebe tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/476dbf2e-b02a-47bc-a8c6-6d0d66d5d433" status: 204 len: 0 microversion: 2.1 time: 0.126567 Apr 21 11:02:46 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 137/410] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 11:02:45 2023] DELETE /compute/v2.1/servers/476dbf2e-b02a-47bc-a8c6-6d0d66d5d433 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 11:02:46 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-2fbf7159-0a64-4ff6-9b18-86168b80f570 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:02:46 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-2fbf7159-0a64-4ff6-9b18-86168b80f570 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] [instance: 476dbf2e-b02a-47bc-a8c6-6d0d66d5d433] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:02:46 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_api:SELECT=2 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:02:46 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell1:SELECT=6 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:02:46 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-2fbf7159-0a64-4ff6-9b18-86168b80f570 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:02:46 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-2fbf7159-0a64-4ff6-9b18-86168b80f570 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:02:46 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-2fbf7159-0a64-4ff6-9b18-86168b80f570 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:02:46 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-2fbf7159-0a64-4ff6-9b18-86168b80f570 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:02:46 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-2fbf7159-0a64-4ff6-9b18-86168b80f570 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:02:46 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-2fbf7159-0a64-4ff6-9b18-86168b80f570 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:02:46 user devstack@n-api.service[61319]: DEBUG nova.policy [None req-2fbf7159-0a64-4ff6-9b18-86168b80f570 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f73ac02062c4411bde0c97f6a719926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a611b8a8d54522929c37807054b2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61319) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 11:02:46 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-2fbf7159-0a64-4ff6-9b18-86168b80f570 tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] 10.0.0.210 "GET /compute/v2.1/servers/476dbf2e-b02a-47bc-a8c6-6d0d66d5d433" status: 200 len: 1511 microversion: 2.1 time: 0.352642 Apr 21 11:02:46 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 137/411] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 11:02:46 2023] GET /compute/v2.1/servers/476dbf2e-b02a-47bc-a8c6-6d0d66d5d433 => generated 1511 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 11:02:46 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [req-3d2399fb-7db1-46b0-ac54-a190bb72a6c4 req-dd910c27-40d1-44cc-ab4b-0a6eccbc6ba2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "476dbf2e-b02a-47bc-a8c6-6d0d66d5d433", "name": "network-vif-unplugged", "status": "completed", "tag": "fb82372c-8c1a-43e8-9eba-5f5469b8ac66"}]} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 11:02:46 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-3d2399fb-7db1-46b0-ac54-a190bb72a6c4 req-dd910c27-40d1-44cc-ab4b-0a6eccbc6ba2 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:02:46 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-3d2399fb-7db1-46b0-ac54-a190bb72a6c4 req-dd910c27-40d1-44cc-ab4b-0a6eccbc6ba2 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:02:46 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-3d2399fb-7db1-46b0-ac54-a190bb72a6c4 req-dd910c27-40d1-44cc-ab4b-0a6eccbc6ba2 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:02:46 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-3d2399fb-7db1-46b0-ac54-a190bb72a6c4 req-dd910c27-40d1-44cc-ab4b-0a6eccbc6ba2 service nova] Creating event network-vif-unplugged:fb82372c-8c1a-43e8-9eba-5f5469b8ac66 for instance 476dbf2e-b02a-47bc-a8c6-6d0d66d5d433 on user Apr 21 11:02:46 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [req-3d2399fb-7db1-46b0-ac54-a190bb72a6c4 req-dd910c27-40d1-44cc-ab4b-0a6eccbc6ba2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077569 Apr 21 11:02:46 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 138/412] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 11:02:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 11:02:48 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [req-8b14407e-2b6a-4446-ad91-7e12f60136c9 req-d65e49f9-430b-4c0d-ae82-cf615311ca7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "476dbf2e-b02a-47bc-a8c6-6d0d66d5d433", "name": "network-vif-plugged", "status": "completed", "tag": "fb82372c-8c1a-43e8-9eba-5f5469b8ac66"}, {"server_uuid": "476dbf2e-b02a-47bc-a8c6-6d0d66d5d433", "name": "network-vif-deleted", "tag": "fb82372c-8c1a-43e8-9eba-5f5469b8ac66"}]} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 11:02:48 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-8b14407e-2b6a-4446-ad91-7e12f60136c9 req-d65e49f9-430b-4c0d-ae82-cf615311ca7e service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:02:48 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-8b14407e-2b6a-4446-ad91-7e12f60136c9 req-d65e49f9-430b-4c0d-ae82-cf615311ca7e service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:02:48 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-8b14407e-2b6a-4446-ad91-7e12f60136c9 req-d65e49f9-430b-4c0d-ae82-cf615311ca7e service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:02:48 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-8b14407e-2b6a-4446-ad91-7e12f60136c9 req-d65e49f9-430b-4c0d-ae82-cf615311ca7e service nova] Creating event network-vif-plugged:fb82372c-8c1a-43e8-9eba-5f5469b8ac66 for instance 476dbf2e-b02a-47bc-a8c6-6d0d66d5d433 on user Apr 21 11:02:48 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-8b14407e-2b6a-4446-ad91-7e12f60136c9 req-d65e49f9-430b-4c0d-ae82-cf615311ca7e service nova] Creating event network-vif-deleted:fb82372c-8c1a-43e8-9eba-5f5469b8ac66 for instance 476dbf2e-b02a-47bc-a8c6-6d0d66d5d433 on user Apr 21 11:02:48 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [req-8b14407e-2b6a-4446-ad91-7e12f60136c9 req-d65e49f9-430b-4c0d-ae82-cf615311ca7e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035706 Apr 21 11:02:48 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 138/413] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 11:02:48 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 11:03:09 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-706c1592-a217-4b09-be3a-2d5d48baa0b6 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:03:09 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-706c1592-a217-4b09-be3a-2d5d48baa0b6 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] [instance: 595d41a4-9a01-4aa2-96a1-c2c763475184] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:03:09 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_api:SELECT=2 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:03:09 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell1:SELECT=6 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:03:09 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-706c1592-a217-4b09-be3a-2d5d48baa0b6 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:03:09 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-706c1592-a217-4b09-be3a-2d5d48baa0b6 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:03:09 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-706c1592-a217-4b09-be3a-2d5d48baa0b6 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:03:09 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-706c1592-a217-4b09-be3a-2d5d48baa0b6 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:03:09 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-706c1592-a217-4b09-be3a-2d5d48baa0b6 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:03:09 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-706c1592-a217-4b09-be3a-2d5d48baa0b6 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:03:09 user devstack@n-api.service[61319]: DEBUG nova.policy [None req-706c1592-a217-4b09-be3a-2d5d48baa0b6 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95956d2e4ea84534b6d5628eb8dd184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc12d15daf34c5e9d26a6cc53795efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61319) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 11:03:09 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-706c1592-a217-4b09-be3a-2d5d48baa0b6 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] 10.0.0.210 "GET /compute/v2.1/servers/595d41a4-9a01-4aa2-96a1-c2c763475184" status: 200 len: 1494 microversion: 2.1 time: 0.236498 Apr 21 11:03:09 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 138/414] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 11:03:09 2023] GET /compute/v2.1/servers/595d41a4-9a01-4aa2-96a1-c2c763475184 => generated 1494 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 11:03:36 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_api:SELECT=4 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:03:36 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell1:SELECT=4 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:03:36 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-83b0d725-e76c-47c5-8ee6-19e1fc49593f tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:03:36 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-83b0d725-e76c-47c5-8ee6-19e1fc49593f tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] [instance: 476dbf2e-b02a-47bc-a8c6-6d0d66d5d433] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:03:36 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-83b0d725-e76c-47c5-8ee6-19e1fc49593f tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:03:36 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-83b0d725-e76c-47c5-8ee6-19e1fc49593f tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:03:36 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-83b0d725-e76c-47c5-8ee6-19e1fc49593f tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:03:36 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-83b0d725-e76c-47c5-8ee6-19e1fc49593f tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:03:36 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-83b0d725-e76c-47c5-8ee6-19e1fc49593f tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:03:36 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-83b0d725-e76c-47c5-8ee6-19e1fc49593f tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:03:36 user devstack@n-api.service[61320]: INFO nova.api.openstack.wsgi [None req-83b0d725-e76c-47c5-8ee6-19e1fc49593f tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] HTTP exception thrown: Instance 476dbf2e-b02a-47bc-a8c6-6d0d66d5d433 could not be found. Apr 21 11:03:36 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-83b0d725-e76c-47c5-8ee6-19e1fc49593f tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Request method failure captured: Apr 21 11:03:36 user devstack@n-api.service[61320]: request: GET /compute/v2.1/servers/476dbf2e-b02a-47bc-a8c6-6d0d66d5d433 HTTP/1.1 Apr 21 11:03:36 user devstack@n-api.service[61320]: Accept: application/json Apr 21 11:03:36 user devstack@n-api.service[61320]: Accept-Encoding: identity Apr 21 11:03:36 user devstack@n-api.service[61320]: Connection: close Apr 21 11:03:36 user devstack@n-api.service[61320]: Content-Length: 0 Apr 21 11:03:36 user devstack@n-api.service[61320]: Content-Type: application/json Apr 21 11:03:36 user devstack@n-api.service[61320]: Host: 10.0.0.210 Apr 21 11:03:36 user devstack@n-api.service[61320]: Openstack-System-Scope: None Apr 21 11:03:36 user devstack@n-api.service[61320]: User-Agent: python-urllib3/1.26.15 Apr 21 11:03:36 user devstack@n-api.service[61320]: X-Auth-Token: gAAAAABkQmwEW6K0A__3oMwts29ZtL9alK7r9yUV9_QzNgQac4dLp8ddo9PNUqE6bx0WkGQfLgl5VwDt-xBBjo3nlwR_8Zw9QWxTbLtKH4dqipBGjvHPEd7lKUqpAoOotEhUWvCP2rKWXTEb0ba_OwMixRWwlkSA-3VChQlfsOpLBIWkQUrPmgM Apr 21 11:03:36 user devstack@n-api.service[61320]: X-Domain-Id: None Apr 21 11:03:36 user devstack@n-api.service[61320]: X-Domain-Name: None Apr 21 11:03:36 user devstack@n-api.service[61320]: X-Identity-Status: Confirmed Apr 21 11:03:36 user devstack@n-api.service[61320]: X-Is-Admin-Project: True Apr 21 11:03:36 user devstack@n-api.service[61320]: X-Project-Domain-Id: default Apr 21 11:03:36 user devstack@n-api.service[61320]: X-Project-Domain-Name: Default Apr 21 11:03:36 user devstack@n-api.service[61320]: X-Project-Id: c0a611b8a8d54522929c37807054b2f6 Apr 21 11:03:36 user devstack@n-api.service[61320]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1656706265 Apr 21 11:03:36 user devstack@n-api.service[61320]: X-Role: reader,member Apr 21 11:03:36 user devstack@n-api.service[61320]: X-Roles: reader,member Apr 21 11:03:36 user devstack@n-api.service[61320]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c0a611b8a8d54522929c37807054b2f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c0a611b8a8d54522929c37807054b2f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c0a611b8a8d54522929c37807054b2f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 11:03:36 user devstack@n-api.service[61320]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1656706265 Apr 21 11:03:36 user devstack@n-api.service[61320]: X-Tenant-Id: c0a611b8a8d54522929c37807054b2f6 Apr 21 11:03:36 user devstack@n-api.service[61320]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1656706265 Apr 21 11:03:36 user devstack@n-api.service[61320]: X-User: tempest-ServerRescueNegativeTestJSON-1656706265-project-member Apr 21 11:03:36 user devstack@n-api.service[61320]: X-User-Domain-Id: default Apr 21 11:03:36 user devstack@n-api.service[61320]: X-User-Domain-Name: Default Apr 21 11:03:36 user devstack@n-api.service[61320]: X-User-Id: 0f73ac02062c4411bde0c97f6a719926 Apr 21 11:03:36 user devstack@n-api.service[61320]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1656706265-project-member Apr 21 11:03:36 user devstack@n-api.service[61320]: method: > Apr 21 11:03:36 user devstack@n-api.service[61320]: exception: Instance 476dbf2e-b02a-47bc-a8c6-6d0d66d5d433 could not be found. Apr 21 11:03:36 user devstack@n-api.service[61320]: action_args: {'id': '476dbf2e-b02a-47bc-a8c6-6d0d66d5d433'} Apr 21 11:03:36 user devstack@n-api.service[61320]: {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 11:03:36 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:03:36 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 11:03:36 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 11:03:36 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 11:03:36 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 11:03:36 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 11:03:36 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 11:03:36 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 11:03:36 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 11:03:36 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 476dbf2e-b02a-47bc-a8c6-6d0d66d5d433 could not be found. Apr 21 11:03:36 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 11:03:36 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 11:03:36 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 11:03:36 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:03:36 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 11:03:36 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 11:03:36 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 11:03:36 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 11:03:36 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 11:03:36 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 11:03:36 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 11:03:36 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 11:03:36 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 11:03:36 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 11:03:36 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 11:03:36 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 11:03:36 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 476dbf2e-b02a-47bc-a8c6-6d0d66d5d433 could not be found. Apr 21 11:03:36 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 11:03:36 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 11:03:36 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 11:03:36 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:03:36 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 11:03:36 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 11:03:36 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 11:03:36 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 11:03:36 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 476dbf2e-b02a-47bc-a8c6-6d0d66d5d433 could not be found. Apr 21 11:03:36 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 11:03:36 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-83b0d725-e76c-47c5-8ee6-19e1fc49593f tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] Returning 404 to user: Instance 476dbf2e-b02a-47bc-a8c6-6d0d66d5d433 could not be found. {{(pid=61320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 11:03:36 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-83b0d725-e76c-47c5-8ee6-19e1fc49593f tempest-ServerRescueNegativeTestJSON-1656706265 tempest-ServerRescueNegativeTestJSON-1656706265-project-member] 10.0.0.210 "GET /compute/v2.1/servers/476dbf2e-b02a-47bc-a8c6-6d0d66d5d433" status: 404 len: 111 microversion: 2.1 time: 0.034023 Apr 21 11:03:36 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 139/415] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 11:03:36 2023] GET /compute/v2.1/servers/476dbf2e-b02a-47bc-a8c6-6d0d66d5d433 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 11:03:47 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:03:47 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:03:47 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-1652f2b6-530d-4539-a1b8-a47007b4cdd5 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Action: 'create', calling method: .version_select at 0x7f91a5d520e0>, body: {"keypair": {"name": "tempest-keypair-74686879", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZhnojnQmcZDKi08FqYsbblwCAdGeKVIOD67QqUH/+9e68mmZSA8wvYLSVOq1Y8R7Sh5PCbGPREdIuVm7tQRs5SvoKAjUvEcLyGAJtCQ4wo+oC1c20rBKxLkZu2wABQhQ=="}} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 11:03:47 user devstack@n-api.service[61318]: DEBUG nova.quota [None req-1652f2b6-530d-4539-a1b8-a47007b4cdd5 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Getting quotas for project 38ec5db9e7c744dcb2d4ae6737822da4. Resources: {'key_pairs'} {{(pid=61318) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 11:03:47 user devstack@n-api.service[61318]: DEBUG nova.quota [None req-1652f2b6-530d-4539-a1b8-a47007b4cdd5 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Getting quotas for user b3ef4e7c36ed43d9a00f7b7b9731917e and project 38ec5db9e7c744dcb2d4ae6737822da4. Resources: {'key_pairs'} {{(pid=61318) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 11:03:47 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-1652f2b6-530d-4539-a1b8-a47007b4cdd5 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.220419 Apr 21 11:03:47 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 139/416] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 21 11:03:47 2023] POST /compute/v2.1/os-keypairs => generated 399 bytes in 222 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 21 11:03:49 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-ad58db54-7980-4844-bf65-857277d3a9ab tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2066233937", "imageRef": "3b29a01a-1fc0-4d0d-89fb-23d22b2de02e", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "173a131c-e6e2-4f94-a591-9a96ff4967f2"}], "security_groups": [{"name": "tempest-securitygroup--534262058"}], "key_name": "tempest-keypair-74686879", "user_data": "}} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 11:03:49 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_api:SELECT=2 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:03:49 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell1:SELECT=6 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:03:49 user devstack@n-api.service[61319]: DEBUG nova.network.neutron [None req-ad58db54-7980-4844-bf65-857277d3a9ab tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] validate_networks() for [('173a131c-e6e2-4f94-a591-9a96ff4967f2', None, None, None, None, None)] {{(pid=61319) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 11:03:50 user devstack@n-api.service[61319]: DEBUG nova.virt.hardware [None req-ad58db54-7980-4844-bf65-857277d3a9ab tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Flavor limits 0:0:0 {{(pid=61319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 11:03:50 user devstack@n-api.service[61319]: DEBUG nova.virt.hardware [None req-ad58db54-7980-4844-bf65-857277d3a9ab tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Image limits 0:0:0 {{(pid=61319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 11:03:50 user devstack@n-api.service[61319]: DEBUG nova.virt.hardware [None req-ad58db54-7980-4844-bf65-857277d3a9ab tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Flavor pref 0:0:0 {{(pid=61319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 11:03:50 user devstack@n-api.service[61319]: DEBUG nova.virt.hardware [None req-ad58db54-7980-4844-bf65-857277d3a9ab tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Image pref 0:0:0 {{(pid=61319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 11:03:50 user devstack@n-api.service[61319]: DEBUG nova.virt.hardware [None req-ad58db54-7980-4844-bf65-857277d3a9ab tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 11:03:50 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-ad58db54-7980-4844-bf65-857277d3a9ab tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:03:50 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-ad58db54-7980-4844-bf65-857277d3a9ab tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:03:50 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-ad58db54-7980-4844-bf65-857277d3a9ab tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:03:50 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-ad58db54-7980-4844-bf65-857277d3a9ab tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:03:50 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-ad58db54-7980-4844-bf65-857277d3a9ab tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:03:50 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-ad58db54-7980-4844-bf65-857277d3a9ab tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:03:50 user devstack@n-api.service[61319]: DEBUG nova.quota [None req-ad58db54-7980-4844-bf65-857277d3a9ab tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Getting quotas for project 38ec5db9e7c744dcb2d4ae6737822da4. Resources: {'cores', 'instances', 'ram'} {{(pid=61319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 11:03:50 user devstack@n-api.service[61319]: DEBUG nova.quota [None req-ad58db54-7980-4844-bf65-857277d3a9ab tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Getting quotas for user b3ef4e7c36ed43d9a00f7b7b9731917e and project 38ec5db9e7c744dcb2d4ae6737822da4. Resources: {'cores', 'instances', 'ram'} {{(pid=61319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 11:03:50 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-ad58db54-7980-4844-bf65-857277d3a9ab tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Going to run 1 instances... {{(pid=61319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 11:03:50 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-ad58db54-7980-4844-bf65-857277d3a9ab tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] [instance: 4dc4e5a5-6f31-4466-a6bb-dae9a2a93585] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3b29a01a-1fc0-4d0d-89fb-23d22b2de02e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 11:03:50 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-ad58db54-7980-4844-bf65-857277d3a9ab tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.716967 Apr 21 11:03:50 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 139/417] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 21 11:03:49 2023] POST /compute/v2.1/servers => generated 399 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 21 11:03:50 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-8ee44576-0236-442f-b98e-2e8b956c1dd0 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:03:50 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-8ee44576-0236-442f-b98e-2e8b956c1dd0 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] [instance: 4dc4e5a5-6f31-4466-a6bb-dae9a2a93585] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:03:50 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_api:SELECT=2 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:03:50 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell1:SELECT=2 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:03:50 user devstack@n-api.service[61320]: DEBUG nova.policy [None req-8ee44576-0236-442f-b98e-2e8b956c1dd0 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ef4e7c36ed43d9a00f7b7b9731917e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38ec5db9e7c744dcb2d4ae6737822da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61320) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 11:03:50 user devstack@n-api.service[61320]: DEBUG nova.policy [None req-8ee44576-0236-442f-b98e-2e8b956c1dd0 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3ef4e7c36ed43d9a00f7b7b9731917e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38ec5db9e7c744dcb2d4ae6737822da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61320) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 11:03:50 user devstack@n-api.service[61320]: DEBUG nova.policy [None req-8ee44576-0236-442f-b98e-2e8b956c1dd0 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3ef4e7c36ed43d9a00f7b7b9731917e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38ec5db9e7c744dcb2d4ae6737822da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61320) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 11:03:50 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-8ee44576-0236-442f-b98e-2e8b956c1dd0 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4dc4e5a5-6f31-4466-a6bb-dae9a2a93585" status: 200 len: 1274 microversion: 2.20 time: 0.133778 Apr 21 11:03:50 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 140/418] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 11:03:50 2023] GET /compute/v2.1/servers/4dc4e5a5-6f31-4466-a6bb-dae9a2a93585 => generated 1274 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 11:03:53 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [req-31ec8c18-34f1-4d75-8fc1-c89aab882594 req-bbbcf7f1-d39d-43c1-83f0-b262f64ac4ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dc4e5a5-6f31-4466-a6bb-dae9a2a93585", "tag": "f838d84d-a8eb-4c45-945a-ea4621cd1928"}]} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 11:03:53 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-31ec8c18-34f1-4d75-8fc1-c89aab882594 req-bbbcf7f1-d39d-43c1-83f0-b262f64ac4ed service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:03:53 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-31ec8c18-34f1-4d75-8fc1-c89aab882594 req-bbbcf7f1-d39d-43c1-83f0-b262f64ac4ed service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:03:53 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-31ec8c18-34f1-4d75-8fc1-c89aab882594 req-bbbcf7f1-d39d-43c1-83f0-b262f64ac4ed service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:03:53 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-31ec8c18-34f1-4d75-8fc1-c89aab882594 req-bbbcf7f1-d39d-43c1-83f0-b262f64ac4ed service nova] Creating event network-changed:f838d84d-a8eb-4c45-945a-ea4621cd1928 for instance 4dc4e5a5-6f31-4466-a6bb-dae9a2a93585 on user Apr 21 11:03:53 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [req-31ec8c18-34f1-4d75-8fc1-c89aab882594 req-bbbcf7f1-d39d-43c1-83f0-b262f64ac4ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035654 Apr 21 11:03:53 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 140/419] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 11:03:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 11:03:55 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-81f4acca-749e-44fd-8af5-4bfd2725a45c req-d1355642-2710-4b2a-95d5-87d80d516f89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dc4e5a5-6f31-4466-a6bb-dae9a2a93585", "name": "network-vif-plugged", "status": "completed", "tag": "f838d84d-a8eb-4c45-945a-ea4621cd1928"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 11:03:55 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-81f4acca-749e-44fd-8af5-4bfd2725a45c req-d1355642-2710-4b2a-95d5-87d80d516f89 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:03:55 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-81f4acca-749e-44fd-8af5-4bfd2725a45c req-d1355642-2710-4b2a-95d5-87d80d516f89 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:03:55 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-81f4acca-749e-44fd-8af5-4bfd2725a45c req-d1355642-2710-4b2a-95d5-87d80d516f89 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:03:55 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-81f4acca-749e-44fd-8af5-4bfd2725a45c req-d1355642-2710-4b2a-95d5-87d80d516f89 service nova] Creating event network-vif-plugged:f838d84d-a8eb-4c45-945a-ea4621cd1928 for instance 4dc4e5a5-6f31-4466-a6bb-dae9a2a93585 on user Apr 21 11:03:55 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-81f4acca-749e-44fd-8af5-4bfd2725a45c req-d1355642-2710-4b2a-95d5-87d80d516f89 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046954 Apr 21 11:03:55 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 140/420] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 11:03:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 11:03:57 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [req-627ff99d-3fc4-4903-ba86-9e6d45311450 req-bf86a5c5-0920-4d52-a6f4-40a598625e22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dc4e5a5-6f31-4466-a6bb-dae9a2a93585", "name": "network-vif-plugged", "status": "completed", "tag": "f838d84d-a8eb-4c45-945a-ea4621cd1928"}]} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 11:03:57 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-627ff99d-3fc4-4903-ba86-9e6d45311450 req-bf86a5c5-0920-4d52-a6f4-40a598625e22 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:03:57 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-627ff99d-3fc4-4903-ba86-9e6d45311450 req-bf86a5c5-0920-4d52-a6f4-40a598625e22 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:03:57 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-627ff99d-3fc4-4903-ba86-9e6d45311450 req-bf86a5c5-0920-4d52-a6f4-40a598625e22 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:03:57 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-627ff99d-3fc4-4903-ba86-9e6d45311450 req-bf86a5c5-0920-4d52-a6f4-40a598625e22 service nova] Creating event network-vif-plugged:f838d84d-a8eb-4c45-945a-ea4621cd1928 for instance 4dc4e5a5-6f31-4466-a6bb-dae9a2a93585 on user Apr 21 11:03:57 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [req-627ff99d-3fc4-4903-ba86-9e6d45311450 req-bf86a5c5-0920-4d52-a6f4-40a598625e22 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038855 Apr 21 11:03:57 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 141/421] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 11:03:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 11:04:11 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-093a57a4-59be-4414-8f1f-602333d9b96e tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:04:11 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-093a57a4-59be-4414-8f1f-602333d9b96e tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] [instance: 595d41a4-9a01-4aa2-96a1-c2c763475184] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:04:11 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell0:SELECT=4 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:04:11 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:04:11 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell1:SELECT=2 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:04:11 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-093a57a4-59be-4414-8f1f-602333d9b96e tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:04:11 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-093a57a4-59be-4414-8f1f-602333d9b96e tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:04:11 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-093a57a4-59be-4414-8f1f-602333d9b96e tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:04:11 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-093a57a4-59be-4414-8f1f-602333d9b96e tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:04:11 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-093a57a4-59be-4414-8f1f-602333d9b96e tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:04:11 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-093a57a4-59be-4414-8f1f-602333d9b96e tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:04:11 user devstack@n-api.service[61318]: DEBUG nova.policy [None req-093a57a4-59be-4414-8f1f-602333d9b96e tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95956d2e4ea84534b6d5628eb8dd184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc12d15daf34c5e9d26a6cc53795efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61318) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 11:04:11 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-093a57a4-59be-4414-8f1f-602333d9b96e tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] 10.0.0.210 "GET /compute/v2.1/servers/595d41a4-9a01-4aa2-96a1-c2c763475184" status: 200 len: 1494 microversion: 2.1 time: 0.325992 Apr 21 11:04:11 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 141/422] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 11:04:11 2023] GET /compute/v2.1/servers/595d41a4-9a01-4aa2-96a1-c2c763475184 => generated 1494 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 11:04:40 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell0:SELECT=2 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:04:40 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell0:SELECT=6 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:04:40 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:04:40 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell1:SELECT=4 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:04:40 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-d2329e06-ff69-47f7-9832-95e109305995 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:04:40 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-d2329e06-ff69-47f7-9832-95e109305995 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] [instance: 4dc4e5a5-6f31-4466-a6bb-dae9a2a93585] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:04:40 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-d2329e06-ff69-47f7-9832-95e109305995 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:04:40 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-d2329e06-ff69-47f7-9832-95e109305995 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:04:40 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-d2329e06-ff69-47f7-9832-95e109305995 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:04:40 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-d2329e06-ff69-47f7-9832-95e109305995 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:04:40 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-d2329e06-ff69-47f7-9832-95e109305995 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:04:40 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-d2329e06-ff69-47f7-9832-95e109305995 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:04:40 user devstack@n-api.service[61319]: DEBUG nova.policy [None req-d2329e06-ff69-47f7-9832-95e109305995 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ef4e7c36ed43d9a00f7b7b9731917e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38ec5db9e7c744dcb2d4ae6737822da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61319) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 11:04:40 user devstack@n-api.service[61319]: DEBUG nova.policy [None req-d2329e06-ff69-47f7-9832-95e109305995 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3ef4e7c36ed43d9a00f7b7b9731917e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38ec5db9e7c744dcb2d4ae6737822da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61319) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 11:04:40 user devstack@n-api.service[61319]: DEBUG nova.policy [None req-d2329e06-ff69-47f7-9832-95e109305995 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3ef4e7c36ed43d9a00f7b7b9731917e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38ec5db9e7c744dcb2d4ae6737822da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61319) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 11:04:40 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-d2329e06-ff69-47f7-9832-95e109305995 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4dc4e5a5-6f31-4466-a6bb-dae9a2a93585" status: 200 len: 1585 microversion: 2.20 time: 0.236751 Apr 21 11:04:40 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 141/423] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 11:04:40 2023] GET /compute/v2.1/servers/4dc4e5a5-6f31-4466-a6bb-dae9a2a93585 => generated 1585 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 11:05:12 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell0:SELECT=2 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:05:12 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_api:SELECT=6 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:05:12 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell1:SELECT=2 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:05:12 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-43647350-f79b-4dcd-9130-0bb612d73a67 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:05:12 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-43647350-f79b-4dcd-9130-0bb612d73a67 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] [instance: 32a0063e-076e-4585-981e-fe853499aee3] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:05:12 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-43647350-f79b-4dcd-9130-0bb612d73a67 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:05:12 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-43647350-f79b-4dcd-9130-0bb612d73a67 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:05:12 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-43647350-f79b-4dcd-9130-0bb612d73a67 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:05:12 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-43647350-f79b-4dcd-9130-0bb612d73a67 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:05:12 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-43647350-f79b-4dcd-9130-0bb612d73a67 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:05:12 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-43647350-f79b-4dcd-9130-0bb612d73a67 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:05:12 user devstack@n-api.service[61320]: INFO nova.api.openstack.wsgi [None req-43647350-f79b-4dcd-9130-0bb612d73a67 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] HTTP exception thrown: Instance 32a0063e-076e-4585-981e-fe853499aee3 could not be found. Apr 21 11:05:12 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-43647350-f79b-4dcd-9130-0bb612d73a67 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Request method failure captured: Apr 21 11:05:12 user devstack@n-api.service[61320]: request: DELETE /compute/v2.1/servers/32a0063e-076e-4585-981e-fe853499aee3 HTTP/1.1 Apr 21 11:05:12 user devstack@n-api.service[61320]: Accept: application/json Apr 21 11:05:12 user devstack@n-api.service[61320]: Accept-Encoding: identity Apr 21 11:05:12 user devstack@n-api.service[61320]: Connection: close Apr 21 11:05:12 user devstack@n-api.service[61320]: Content-Length: 0 Apr 21 11:05:12 user devstack@n-api.service[61320]: Content-Type: application/json Apr 21 11:05:12 user devstack@n-api.service[61320]: Host: 10.0.0.210 Apr 21 11:05:12 user devstack@n-api.service[61320]: Openstack-System-Scope: None Apr 21 11:05:12 user devstack@n-api.service[61320]: User-Agent: python-urllib3/1.26.15 Apr 21 11:05:12 user devstack@n-api.service[61320]: X-Auth-Token: gAAAAABkQmvi6BLDwVzQA0j1G6jfQrVSbK2Z2JlBL4mzr6ps4f3qI_xdtkI9q9uVoLZL-2YfUdE_HchhZz_wV_pY5xRJTk9UErKs-UekJh41x0ouxWtyNIOZx8lJrvJqo5DFdLgkV5WuingyCKv1R2lzVPsOpsxtQ_-Qx0IlCULMmQnzNxxmWdo Apr 21 11:05:12 user devstack@n-api.service[61320]: X-Domain-Id: None Apr 21 11:05:12 user devstack@n-api.service[61320]: X-Domain-Name: None Apr 21 11:05:12 user devstack@n-api.service[61320]: X-Identity-Status: Confirmed Apr 21 11:05:12 user devstack@n-api.service[61320]: X-Is-Admin-Project: True Apr 21 11:05:12 user devstack@n-api.service[61320]: X-Project-Domain-Id: default Apr 21 11:05:12 user devstack@n-api.service[61320]: X-Project-Domain-Name: Default Apr 21 11:05:12 user devstack@n-api.service[61320]: X-Project-Id: acc12d15daf34c5e9d26a6cc53795efe Apr 21 11:05:12 user devstack@n-api.service[61320]: X-Project-Name: tempest-ServersNegativeTestJSON-1265836442 Apr 21 11:05:12 user devstack@n-api.service[61320]: X-Role: reader,member Apr 21 11:05:12 user devstack@n-api.service[61320]: X-Roles: reader,member Apr 21 11:05:12 user devstack@n-api.service[61320]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/acc12d15daf34c5e9d26a6cc53795efe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/acc12d15daf34c5e9d26a6cc53795efe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/acc12d15daf34c5e9d26a6cc53795efe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 11:05:12 user devstack@n-api.service[61320]: X-Tenant: tempest-ServersNegativeTestJSON-1265836442 Apr 21 11:05:12 user devstack@n-api.service[61320]: X-Tenant-Id: acc12d15daf34c5e9d26a6cc53795efe Apr 21 11:05:12 user devstack@n-api.service[61320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1265836442 Apr 21 11:05:12 user devstack@n-api.service[61320]: X-User: tempest-ServersNegativeTestJSON-1265836442-project-member Apr 21 11:05:12 user devstack@n-api.service[61320]: X-User-Domain-Id: default Apr 21 11:05:12 user devstack@n-api.service[61320]: X-User-Domain-Name: Default Apr 21 11:05:12 user devstack@n-api.service[61320]: X-User-Id: 95956d2e4ea84534b6d5628eb8dd184d Apr 21 11:05:12 user devstack@n-api.service[61320]: X-User-Name: tempest-ServersNegativeTestJSON-1265836442-project-member Apr 21 11:05:12 user devstack@n-api.service[61320]: method: > Apr 21 11:05:12 user devstack@n-api.service[61320]: exception: Instance 32a0063e-076e-4585-981e-fe853499aee3 could not be found. Apr 21 11:05:12 user devstack@n-api.service[61320]: action_args: {'id': '32a0063e-076e-4585-981e-fe853499aee3'} Apr 21 11:05:12 user devstack@n-api.service[61320]: {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 11:05:12 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:05:12 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 11:05:12 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 11:05:12 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 11:05:12 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 11:05:12 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 11:05:12 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 11:05:12 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 11:05:12 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 11:05:12 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32a0063e-076e-4585-981e-fe853499aee3 could not be found. Apr 21 11:05:12 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 11:05:12 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 11:05:12 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 11:05:12 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:05:12 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 11:05:12 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 11:05:12 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 11:05:12 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 11:05:12 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 11:05:12 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 11:05:12 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 21 11:05:12 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 21 11:05:12 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 21 11:05:12 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 21 11:05:12 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 11:05:12 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 11:05:12 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 11:05:12 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 11:05:12 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32a0063e-076e-4585-981e-fe853499aee3 could not be found. Apr 21 11:05:12 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 11:05:12 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 11:05:12 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 11:05:12 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:05:12 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 11:05:12 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 11:05:12 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 11:05:12 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 11:05:12 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32a0063e-076e-4585-981e-fe853499aee3 could not be found. Apr 21 11:05:12 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 11:05:12 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-43647350-f79b-4dcd-9130-0bb612d73a67 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Returning 404 to user: Instance 32a0063e-076e-4585-981e-fe853499aee3 could not be found. {{(pid=61320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 11:05:12 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-43647350-f79b-4dcd-9130-0bb612d73a67 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/32a0063e-076e-4585-981e-fe853499aee3" status: 404 len: 111 microversion: 2.1 time: 0.040225 Apr 21 11:05:12 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 142/424] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 11:05:12 2023] DELETE /compute/v2.1/servers/32a0063e-076e-4585-981e-fe853499aee3 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 11:05:12 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_api:SELECT=2 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:05:12 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell1:SELECT=6 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:05:12 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-2b7d0294-5abd-4434-a00f-e3066c814312 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:05:12 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-2b7d0294-5abd-4434-a00f-e3066c814312 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] [instance: 32a0063e-076e-4585-981e-fe853499aee3] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:05:12 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-2b7d0294-5abd-4434-a00f-e3066c814312 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:05:12 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-2b7d0294-5abd-4434-a00f-e3066c814312 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:05:12 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-2b7d0294-5abd-4434-a00f-e3066c814312 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:05:12 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-2b7d0294-5abd-4434-a00f-e3066c814312 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:05:12 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-2b7d0294-5abd-4434-a00f-e3066c814312 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:05:12 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-2b7d0294-5abd-4434-a00f-e3066c814312 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:05:12 user devstack@n-api.service[61318]: INFO nova.api.openstack.wsgi [None req-2b7d0294-5abd-4434-a00f-e3066c814312 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] HTTP exception thrown: Instance 32a0063e-076e-4585-981e-fe853499aee3 could not be found. Apr 21 11:05:12 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-2b7d0294-5abd-4434-a00f-e3066c814312 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Request method failure captured: Apr 21 11:05:12 user devstack@n-api.service[61318]: request: GET /compute/v2.1/servers/32a0063e-076e-4585-981e-fe853499aee3 HTTP/1.1 Apr 21 11:05:12 user devstack@n-api.service[61318]: Accept: application/json Apr 21 11:05:12 user devstack@n-api.service[61318]: Accept-Encoding: identity Apr 21 11:05:12 user devstack@n-api.service[61318]: Connection: close Apr 21 11:05:12 user devstack@n-api.service[61318]: Content-Length: 0 Apr 21 11:05:12 user devstack@n-api.service[61318]: Content-Type: application/json Apr 21 11:05:12 user devstack@n-api.service[61318]: Host: 10.0.0.210 Apr 21 11:05:12 user devstack@n-api.service[61318]: Openstack-System-Scope: None Apr 21 11:05:12 user devstack@n-api.service[61318]: User-Agent: python-urllib3/1.26.15 Apr 21 11:05:12 user devstack@n-api.service[61318]: X-Auth-Token: gAAAAABkQmvi6BLDwVzQA0j1G6jfQrVSbK2Z2JlBL4mzr6ps4f3qI_xdtkI9q9uVoLZL-2YfUdE_HchhZz_wV_pY5xRJTk9UErKs-UekJh41x0ouxWtyNIOZx8lJrvJqo5DFdLgkV5WuingyCKv1R2lzVPsOpsxtQ_-Qx0IlCULMmQnzNxxmWdo Apr 21 11:05:12 user devstack@n-api.service[61318]: X-Domain-Id: None Apr 21 11:05:12 user devstack@n-api.service[61318]: X-Domain-Name: None Apr 21 11:05:12 user devstack@n-api.service[61318]: X-Identity-Status: Confirmed Apr 21 11:05:12 user devstack@n-api.service[61318]: X-Is-Admin-Project: True Apr 21 11:05:12 user devstack@n-api.service[61318]: X-Project-Domain-Id: default Apr 21 11:05:12 user devstack@n-api.service[61318]: X-Project-Domain-Name: Default Apr 21 11:05:12 user devstack@n-api.service[61318]: X-Project-Id: acc12d15daf34c5e9d26a6cc53795efe Apr 21 11:05:12 user devstack@n-api.service[61318]: X-Project-Name: tempest-ServersNegativeTestJSON-1265836442 Apr 21 11:05:12 user devstack@n-api.service[61318]: X-Role: reader,member Apr 21 11:05:12 user devstack@n-api.service[61318]: X-Roles: reader,member Apr 21 11:05:12 user devstack@n-api.service[61318]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/acc12d15daf34c5e9d26a6cc53795efe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/acc12d15daf34c5e9d26a6cc53795efe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/acc12d15daf34c5e9d26a6cc53795efe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 11:05:12 user devstack@n-api.service[61318]: X-Tenant: tempest-ServersNegativeTestJSON-1265836442 Apr 21 11:05:12 user devstack@n-api.service[61318]: X-Tenant-Id: acc12d15daf34c5e9d26a6cc53795efe Apr 21 11:05:12 user devstack@n-api.service[61318]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1265836442 Apr 21 11:05:12 user devstack@n-api.service[61318]: X-User: tempest-ServersNegativeTestJSON-1265836442-project-member Apr 21 11:05:12 user devstack@n-api.service[61318]: X-User-Domain-Id: default Apr 21 11:05:12 user devstack@n-api.service[61318]: X-User-Domain-Name: Default Apr 21 11:05:12 user devstack@n-api.service[61318]: X-User-Id: 95956d2e4ea84534b6d5628eb8dd184d Apr 21 11:05:12 user devstack@n-api.service[61318]: X-User-Name: tempest-ServersNegativeTestJSON-1265836442-project-member Apr 21 11:05:12 user devstack@n-api.service[61318]: method: > Apr 21 11:05:12 user devstack@n-api.service[61318]: exception: Instance 32a0063e-076e-4585-981e-fe853499aee3 could not be found. Apr 21 11:05:12 user devstack@n-api.service[61318]: action_args: {'id': '32a0063e-076e-4585-981e-fe853499aee3'} Apr 21 11:05:12 user devstack@n-api.service[61318]: {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 11:05:12 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:05:12 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 11:05:12 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 11:05:12 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 11:05:12 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 11:05:12 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 11:05:12 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 11:05:12 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 11:05:12 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 11:05:12 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32a0063e-076e-4585-981e-fe853499aee3 could not be found. Apr 21 11:05:12 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 11:05:12 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 11:05:12 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 11:05:12 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:05:12 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 11:05:12 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 11:05:12 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 11:05:12 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 11:05:12 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 11:05:12 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 11:05:12 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 11:05:12 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 11:05:12 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 11:05:12 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 11:05:12 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 11:05:12 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 11:05:12 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32a0063e-076e-4585-981e-fe853499aee3 could not be found. Apr 21 11:05:12 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 11:05:12 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 11:05:12 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 11:05:12 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:05:12 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 11:05:12 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 11:05:12 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 11:05:12 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 11:05:12 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32a0063e-076e-4585-981e-fe853499aee3 could not be found. Apr 21 11:05:12 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 11:05:12 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-2b7d0294-5abd-4434-a00f-e3066c814312 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Returning 404 to user: Instance 32a0063e-076e-4585-981e-fe853499aee3 could not be found. {{(pid=61318) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 11:05:12 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-2b7d0294-5abd-4434-a00f-e3066c814312 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32a0063e-076e-4585-981e-fe853499aee3" status: 404 len: 111 microversion: 2.1 time: 0.110209 Apr 21 11:05:12 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 142/425] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 11:05:12 2023] GET /compute/v2.1/servers/32a0063e-076e-4585-981e-fe853499aee3 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 11:05:12 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-b672a9a9-3768-4376-bd57-dff15dc636e3 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:05:12 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-b672a9a9-3768-4376-bd57-dff15dc636e3 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] [instance: 595d41a4-9a01-4aa2-96a1-c2c763475184] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:05:12 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_api:SELECT=2 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:05:12 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell1:SELECT=6 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:05:12 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-b672a9a9-3768-4376-bd57-dff15dc636e3 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:05:12 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-b672a9a9-3768-4376-bd57-dff15dc636e3 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:05:12 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-b672a9a9-3768-4376-bd57-dff15dc636e3 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:05:12 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-b672a9a9-3768-4376-bd57-dff15dc636e3 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:05:12 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-b672a9a9-3768-4376-bd57-dff15dc636e3 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:05:12 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-b672a9a9-3768-4376-bd57-dff15dc636e3 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:05:12 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-b672a9a9-3768-4376-bd57-dff15dc636e3 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] [instance: 595d41a4-9a01-4aa2-96a1-c2c763475184] Going to try to terminate instance {{(pid=61319) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 11:05:12 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-b672a9a9-3768-4376-bd57-dff15dc636e3 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/595d41a4-9a01-4aa2-96a1-c2c763475184" status: 204 len: 0 microversion: 2.1 time: 0.113490 Apr 21 11:05:12 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 142/426] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 11:05:12 2023] DELETE /compute/v2.1/servers/595d41a4-9a01-4aa2-96a1-c2c763475184 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 11:05:12 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-5b82bddc-508d-488d-b34d-ac332899ac43 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:05:12 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-5b82bddc-508d-488d-b34d-ac332899ac43 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] [instance: 595d41a4-9a01-4aa2-96a1-c2c763475184] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:05:12 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-5b82bddc-508d-488d-b34d-ac332899ac43 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:05:12 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-5b82bddc-508d-488d-b34d-ac332899ac43 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:05:12 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-5b82bddc-508d-488d-b34d-ac332899ac43 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:05:12 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-5b82bddc-508d-488d-b34d-ac332899ac43 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:05:12 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-5b82bddc-508d-488d-b34d-ac332899ac43 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:05:12 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-5b82bddc-508d-488d-b34d-ac332899ac43 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:05:12 user devstack@n-api.service[61320]: DEBUG nova.policy [None req-5b82bddc-508d-488d-b34d-ac332899ac43 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95956d2e4ea84534b6d5628eb8dd184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc12d15daf34c5e9d26a6cc53795efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61320) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 11:05:12 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-5b82bddc-508d-488d-b34d-ac332899ac43 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] 10.0.0.210 "GET /compute/v2.1/servers/595d41a4-9a01-4aa2-96a1-c2c763475184" status: 200 len: 1500 microversion: 2.1 time: 0.240809 Apr 21 11:05:12 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 143/427] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 11:05:12 2023] GET /compute/v2.1/servers/595d41a4-9a01-4aa2-96a1-c2c763475184 => generated 1500 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 11:05:12 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [req-c540df67-89db-4cb8-8ae0-067ad3f9a26c req-6f3159b5-bf8a-4e1f-8c0e-9b80c0525b03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "595d41a4-9a01-4aa2-96a1-c2c763475184", "name": "network-vif-unplugged", "status": "completed", "tag": "eb0b0125-965b-4825-aab1-3ba81be44c2f"}]} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 11:05:12 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-c540df67-89db-4cb8-8ae0-067ad3f9a26c req-6f3159b5-bf8a-4e1f-8c0e-9b80c0525b03 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:05:12 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-c540df67-89db-4cb8-8ae0-067ad3f9a26c req-6f3159b5-bf8a-4e1f-8c0e-9b80c0525b03 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:05:12 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-c540df67-89db-4cb8-8ae0-067ad3f9a26c req-6f3159b5-bf8a-4e1f-8c0e-9b80c0525b03 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:05:12 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-c540df67-89db-4cb8-8ae0-067ad3f9a26c req-6f3159b5-bf8a-4e1f-8c0e-9b80c0525b03 service nova] Creating event network-vif-unplugged:eb0b0125-965b-4825-aab1-3ba81be44c2f for instance 595d41a4-9a01-4aa2-96a1-c2c763475184 on user Apr 21 11:05:13 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [req-c540df67-89db-4cb8-8ae0-067ad3f9a26c req-6f3159b5-bf8a-4e1f-8c0e-9b80c0525b03 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087763 Apr 21 11:05:13 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 143/428] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 11:05:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 11:05:13 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-c03cbc15-b40c-4d6c-8a21-963b7dba1e97 req-f93f9b8a-656a-473c-96ed-e1c356e93cda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "595d41a4-9a01-4aa2-96a1-c2c763475184", "name": "network-vif-deleted", "tag": "eb0b0125-965b-4825-aab1-3ba81be44c2f"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 11:05:13 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-c03cbc15-b40c-4d6c-8a21-963b7dba1e97 req-f93f9b8a-656a-473c-96ed-e1c356e93cda service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:05:13 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-c03cbc15-b40c-4d6c-8a21-963b7dba1e97 req-f93f9b8a-656a-473c-96ed-e1c356e93cda service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:05:13 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-c03cbc15-b40c-4d6c-8a21-963b7dba1e97 req-f93f9b8a-656a-473c-96ed-e1c356e93cda service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:05:13 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-c03cbc15-b40c-4d6c-8a21-963b7dba1e97 req-f93f9b8a-656a-473c-96ed-e1c356e93cda service nova] Creating event network-vif-deleted:eb0b0125-965b-4825-aab1-3ba81be44c2f for instance 595d41a4-9a01-4aa2-96a1-c2c763475184 on user Apr 21 11:05:13 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-c03cbc15-b40c-4d6c-8a21-963b7dba1e97 req-f93f9b8a-656a-473c-96ed-e1c356e93cda service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028291 Apr 21 11:05:13 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 143/429] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 11:05:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 11:05:15 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [req-45bfcab5-2e77-4508-92ef-0ef9039454a1 req-62ce40ea-a060-402a-97f2-c459ec3db614 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "595d41a4-9a01-4aa2-96a1-c2c763475184", "name": "network-vif-plugged", "status": "completed", "tag": "eb0b0125-965b-4825-aab1-3ba81be44c2f"}]} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 11:05:15 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-45bfcab5-2e77-4508-92ef-0ef9039454a1 req-62ce40ea-a060-402a-97f2-c459ec3db614 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:05:15 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-45bfcab5-2e77-4508-92ef-0ef9039454a1 req-62ce40ea-a060-402a-97f2-c459ec3db614 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:05:15 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-45bfcab5-2e77-4508-92ef-0ef9039454a1 req-62ce40ea-a060-402a-97f2-c459ec3db614 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:05:15 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-45bfcab5-2e77-4508-92ef-0ef9039454a1 req-62ce40ea-a060-402a-97f2-c459ec3db614 service nova] Creating event network-vif-plugged:eb0b0125-965b-4825-aab1-3ba81be44c2f for instance 595d41a4-9a01-4aa2-96a1-c2c763475184 on user Apr 21 11:05:15 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [req-45bfcab5-2e77-4508-92ef-0ef9039454a1 req-62ce40ea-a060-402a-97f2-c459ec3db614 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035488 Apr 21 11:05:15 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 144/430] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 11:05:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 11:05:40 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-7b360041-faf9-4987-a2ba-e984fcc6df97 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:05:40 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-7b360041-faf9-4987-a2ba-e984fcc6df97 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] [instance: 4dc4e5a5-6f31-4466-a6bb-dae9a2a93585] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:05:40 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_api:SELECT=4 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:05:40 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell1:SELECT=4 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:05:40 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-7b360041-faf9-4987-a2ba-e984fcc6df97 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:05:40 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-7b360041-faf9-4987-a2ba-e984fcc6df97 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:05:40 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-7b360041-faf9-4987-a2ba-e984fcc6df97 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:05:40 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-7b360041-faf9-4987-a2ba-e984fcc6df97 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:05:40 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-7b360041-faf9-4987-a2ba-e984fcc6df97 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:05:40 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-7b360041-faf9-4987-a2ba-e984fcc6df97 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:05:40 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-7b360041-faf9-4987-a2ba-e984fcc6df97 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4dc4e5a5-6f31-4466-a6bb-dae9a2a93585/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.192572 Apr 21 11:05:40 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 144/431] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 21 11:05:40 2023] GET /compute/v2.1/servers/4dc4e5a5-6f31-4466-a6bb-dae9a2a93585/os-interface => generated 283 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 11:05:41 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:05:41 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:05:41 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_api:SELECT=6 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:05:41 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell1:SELECT=10 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:05:41 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-dbba6f8f-5b6b-46da-9a79-6d39dab3f690 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:05:41 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-dbba6f8f-5b6b-46da-9a79-6d39dab3f690 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] [instance: 4dc4e5a5-6f31-4466-a6bb-dae9a2a93585] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:05:41 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-dbba6f8f-5b6b-46da-9a79-6d39dab3f690 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:05:41 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-dbba6f8f-5b6b-46da-9a79-6d39dab3f690 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:05:41 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-dbba6f8f-5b6b-46da-9a79-6d39dab3f690 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:05:41 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-dbba6f8f-5b6b-46da-9a79-6d39dab3f690 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:05:41 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-dbba6f8f-5b6b-46da-9a79-6d39dab3f690 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:05:41 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-dbba6f8f-5b6b-46da-9a79-6d39dab3f690 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:05:41 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-b945d0f9-85af-4984-b4d0-3ff3cc208497 req-488309d3-6a8f-40ec-91ee-730be96550fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dc4e5a5-6f31-4466-a6bb-dae9a2a93585", "tag": "f838d84d-a8eb-4c45-945a-ea4621cd1928"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 11:05:41 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-dbba6f8f-5b6b-46da-9a79-6d39dab3f690 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4dc4e5a5-6f31-4466-a6bb-dae9a2a93585/ips" status: 200 len: 110 microversion: 2.20 time: 0.043888 Apr 21 11:05:41 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 145/432] 10.0.0.210 () {64 vars in 1366 bytes} [Fri Apr 21 11:05:41 2023] GET /compute/v2.1/servers/4dc4e5a5-6f31-4466-a6bb-dae9a2a93585/ips => generated 110 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 11:05:41 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-b945d0f9-85af-4984-b4d0-3ff3cc208497 req-488309d3-6a8f-40ec-91ee-730be96550fc service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:05:41 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-b945d0f9-85af-4984-b4d0-3ff3cc208497 req-488309d3-6a8f-40ec-91ee-730be96550fc service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:05:41 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-b945d0f9-85af-4984-b4d0-3ff3cc208497 req-488309d3-6a8f-40ec-91ee-730be96550fc service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:05:41 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-b945d0f9-85af-4984-b4d0-3ff3cc208497 req-488309d3-6a8f-40ec-91ee-730be96550fc service nova] Creating event network-changed:f838d84d-a8eb-4c45-945a-ea4621cd1928 for instance 4dc4e5a5-6f31-4466-a6bb-dae9a2a93585 on user Apr 21 11:05:41 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-b945d0f9-85af-4984-b4d0-3ff3cc208497 req-488309d3-6a8f-40ec-91ee-730be96550fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128996 Apr 21 11:05:41 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 144/433] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 11:05:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 11:05:43 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-73e07410-435a-46b0-841a-f80a1ebe6717 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:05:43 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-73e07410-435a-46b0-841a-f80a1ebe6717 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] [instance: 4dc4e5a5-6f31-4466-a6bb-dae9a2a93585] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:05:43 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-73e07410-435a-46b0-841a-f80a1ebe6717 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:05:43 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-73e07410-435a-46b0-841a-f80a1ebe6717 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:05:43 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-73e07410-435a-46b0-841a-f80a1ebe6717 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:05:43 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-73e07410-435a-46b0-841a-f80a1ebe6717 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:05:43 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-73e07410-435a-46b0-841a-f80a1ebe6717 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:05:43 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-73e07410-435a-46b0-841a-f80a1ebe6717 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:05:43 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-73e07410-435a-46b0-841a-f80a1ebe6717 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] [instance: 4dc4e5a5-6f31-4466-a6bb-dae9a2a93585] Going to try to terminate instance {{(pid=61318) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 11:05:43 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-73e07410-435a-46b0-841a-f80a1ebe6717 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4dc4e5a5-6f31-4466-a6bb-dae9a2a93585" status: 204 len: 0 microversion: 2.20 time: 0.117167 Apr 21 11:05:43 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 145/434] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 21 11:05:43 2023] DELETE /compute/v2.1/servers/4dc4e5a5-6f31-4466-a6bb-dae9a2a93585 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 21 11:05:43 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-0d1b7e4d-6eae-434c-bf8e-ff15afe7fe7f tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:05:43 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-0d1b7e4d-6eae-434c-bf8e-ff15afe7fe7f tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] [instance: 4dc4e5a5-6f31-4466-a6bb-dae9a2a93585] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:05:43 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-0d1b7e4d-6eae-434c-bf8e-ff15afe7fe7f tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:05:43 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-0d1b7e4d-6eae-434c-bf8e-ff15afe7fe7f tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:05:43 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-0d1b7e4d-6eae-434c-bf8e-ff15afe7fe7f tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:05:43 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-0d1b7e4d-6eae-434c-bf8e-ff15afe7fe7f tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:05:43 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-0d1b7e4d-6eae-434c-bf8e-ff15afe7fe7f tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:05:43 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-0d1b7e4d-6eae-434c-bf8e-ff15afe7fe7f tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:05:43 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-a0858c48-0d52-46e1-a135-a530e450e671 req-7da3f055-2315-4816-8849-743205565452 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dc4e5a5-6f31-4466-a6bb-dae9a2a93585", "name": "network-vif-unplugged", "status": "completed", "tag": "f838d84d-a8eb-4c45-945a-ea4621cd1928"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 11:05:43 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-a0858c48-0d52-46e1-a135-a530e450e671 req-7da3f055-2315-4816-8849-743205565452 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:05:43 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-a0858c48-0d52-46e1-a135-a530e450e671 req-7da3f055-2315-4816-8849-743205565452 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:05:43 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-a0858c48-0d52-46e1-a135-a530e450e671 req-7da3f055-2315-4816-8849-743205565452 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:05:43 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-a0858c48-0d52-46e1-a135-a530e450e671 req-7da3f055-2315-4816-8849-743205565452 service nova] Creating event network-vif-unplugged:f838d84d-a8eb-4c45-945a-ea4621cd1928 for instance 4dc4e5a5-6f31-4466-a6bb-dae9a2a93585 on user Apr 21 11:05:43 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-a0858c48-0d52-46e1-a135-a530e450e671 req-7da3f055-2315-4816-8849-743205565452 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028406 Apr 21 11:05:43 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 145/435] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 11:05:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 11:05:44 user devstack@n-api.service[61320]: DEBUG nova.policy [None req-0d1b7e4d-6eae-434c-bf8e-ff15afe7fe7f tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ef4e7c36ed43d9a00f7b7b9731917e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38ec5db9e7c744dcb2d4ae6737822da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61320) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 11:05:44 user devstack@n-api.service[61320]: DEBUG nova.policy [None req-0d1b7e4d-6eae-434c-bf8e-ff15afe7fe7f tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3ef4e7c36ed43d9a00f7b7b9731917e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38ec5db9e7c744dcb2d4ae6737822da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61320) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 11:05:44 user devstack@n-api.service[61320]: DEBUG nova.policy [None req-0d1b7e4d-6eae-434c-bf8e-ff15afe7fe7f tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3ef4e7c36ed43d9a00f7b7b9731917e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38ec5db9e7c744dcb2d4ae6737822da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61320) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 11:05:44 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-0d1b7e4d-6eae-434c-bf8e-ff15afe7fe7f tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4dc4e5a5-6f31-4466-a6bb-dae9a2a93585" status: 200 len: 1709 microversion: 2.20 time: 1.253870 Apr 21 11:05:44 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 146/436] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 11:05:43 2023] GET /compute/v2.1/servers/4dc4e5a5-6f31-4466-a6bb-dae9a2a93585 => generated 1709 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 11:05:46 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [req-399c01a4-b8bc-41e7-b5b3-eb64f59078e9 req-22f60dd3-1e3a-49d5-b3d0-508d1a1af94f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dc4e5a5-6f31-4466-a6bb-dae9a2a93585", "name": "network-vif-plugged", "status": "completed", "tag": "f838d84d-a8eb-4c45-945a-ea4621cd1928"}, {"server_uuid": "4dc4e5a5-6f31-4466-a6bb-dae9a2a93585", "name": "network-vif-deleted", "tag": "f838d84d-a8eb-4c45-945a-ea4621cd1928"}]} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 11:05:46 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-399c01a4-b8bc-41e7-b5b3-eb64f59078e9 req-22f60dd3-1e3a-49d5-b3d0-508d1a1af94f service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:05:46 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-399c01a4-b8bc-41e7-b5b3-eb64f59078e9 req-22f60dd3-1e3a-49d5-b3d0-508d1a1af94f service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:05:46 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-399c01a4-b8bc-41e7-b5b3-eb64f59078e9 req-22f60dd3-1e3a-49d5-b3d0-508d1a1af94f service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:05:46 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-399c01a4-b8bc-41e7-b5b3-eb64f59078e9 req-22f60dd3-1e3a-49d5-b3d0-508d1a1af94f service nova] Creating event network-vif-plugged:f838d84d-a8eb-4c45-945a-ea4621cd1928 for instance 4dc4e5a5-6f31-4466-a6bb-dae9a2a93585 on user Apr 21 11:05:46 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-399c01a4-b8bc-41e7-b5b3-eb64f59078e9 req-22f60dd3-1e3a-49d5-b3d0-508d1a1af94f service nova] Creating event network-vif-deleted:f838d84d-a8eb-4c45-945a-ea4621cd1928 for instance 4dc4e5a5-6f31-4466-a6bb-dae9a2a93585 on user Apr 21 11:05:46 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [req-399c01a4-b8bc-41e7-b5b3-eb64f59078e9 req-22f60dd3-1e3a-49d5-b3d0-508d1a1af94f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.028914 Apr 21 11:05:46 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 146/437] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 11:05:46 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 11:06:02 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_api:SELECT=4 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:06:02 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell1:SELECT=4 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:06:02 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-0492ce61-1a05-49fe-81f2-855b13660ce2 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:06:02 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-0492ce61-1a05-49fe-81f2-855b13660ce2 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] [instance: 595d41a4-9a01-4aa2-96a1-c2c763475184] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:06:02 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-0492ce61-1a05-49fe-81f2-855b13660ce2 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:06:02 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-0492ce61-1a05-49fe-81f2-855b13660ce2 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:06:02 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-0492ce61-1a05-49fe-81f2-855b13660ce2 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:06:02 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-0492ce61-1a05-49fe-81f2-855b13660ce2 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:06:02 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-0492ce61-1a05-49fe-81f2-855b13660ce2 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:06:02 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-0492ce61-1a05-49fe-81f2-855b13660ce2 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:06:02 user devstack@n-api.service[61319]: INFO nova.api.openstack.wsgi [None req-0492ce61-1a05-49fe-81f2-855b13660ce2 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] HTTP exception thrown: Instance 595d41a4-9a01-4aa2-96a1-c2c763475184 could not be found. Apr 21 11:06:02 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-0492ce61-1a05-49fe-81f2-855b13660ce2 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Request method failure captured: Apr 21 11:06:02 user devstack@n-api.service[61319]: request: GET /compute/v2.1/servers/595d41a4-9a01-4aa2-96a1-c2c763475184 HTTP/1.1 Apr 21 11:06:02 user devstack@n-api.service[61319]: Accept: application/json Apr 21 11:06:02 user devstack@n-api.service[61319]: Accept-Encoding: identity Apr 21 11:06:02 user devstack@n-api.service[61319]: Connection: close Apr 21 11:06:02 user devstack@n-api.service[61319]: Content-Length: 0 Apr 21 11:06:02 user devstack@n-api.service[61319]: Content-Type: application/json Apr 21 11:06:02 user devstack@n-api.service[61319]: Host: 10.0.0.210 Apr 21 11:06:02 user devstack@n-api.service[61319]: Openstack-System-Scope: None Apr 21 11:06:02 user devstack@n-api.service[61319]: User-Agent: python-urllib3/1.26.15 Apr 21 11:06:02 user devstack@n-api.service[61319]: X-Auth-Token: gAAAAABkQmvi6BLDwVzQA0j1G6jfQrVSbK2Z2JlBL4mzr6ps4f3qI_xdtkI9q9uVoLZL-2YfUdE_HchhZz_wV_pY5xRJTk9UErKs-UekJh41x0ouxWtyNIOZx8lJrvJqo5DFdLgkV5WuingyCKv1R2lzVPsOpsxtQ_-Qx0IlCULMmQnzNxxmWdo Apr 21 11:06:02 user devstack@n-api.service[61319]: X-Domain-Id: None Apr 21 11:06:02 user devstack@n-api.service[61319]: X-Domain-Name: None Apr 21 11:06:02 user devstack@n-api.service[61319]: X-Identity-Status: Confirmed Apr 21 11:06:02 user devstack@n-api.service[61319]: X-Is-Admin-Project: True Apr 21 11:06:02 user devstack@n-api.service[61319]: X-Project-Domain-Id: default Apr 21 11:06:02 user devstack@n-api.service[61319]: X-Project-Domain-Name: Default Apr 21 11:06:02 user devstack@n-api.service[61319]: X-Project-Id: acc12d15daf34c5e9d26a6cc53795efe Apr 21 11:06:02 user devstack@n-api.service[61319]: X-Project-Name: tempest-ServersNegativeTestJSON-1265836442 Apr 21 11:06:02 user devstack@n-api.service[61319]: X-Role: reader,member Apr 21 11:06:02 user devstack@n-api.service[61319]: X-Roles: reader,member Apr 21 11:06:02 user devstack@n-api.service[61319]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/acc12d15daf34c5e9d26a6cc53795efe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/acc12d15daf34c5e9d26a6cc53795efe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/acc12d15daf34c5e9d26a6cc53795efe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 11:06:02 user devstack@n-api.service[61319]: X-Tenant: tempest-ServersNegativeTestJSON-1265836442 Apr 21 11:06:02 user devstack@n-api.service[61319]: X-Tenant-Id: acc12d15daf34c5e9d26a6cc53795efe Apr 21 11:06:02 user devstack@n-api.service[61319]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1265836442 Apr 21 11:06:02 user devstack@n-api.service[61319]: X-User: tempest-ServersNegativeTestJSON-1265836442-project-member Apr 21 11:06:02 user devstack@n-api.service[61319]: X-User-Domain-Id: default Apr 21 11:06:02 user devstack@n-api.service[61319]: X-User-Domain-Name: Default Apr 21 11:06:02 user devstack@n-api.service[61319]: X-User-Id: 95956d2e4ea84534b6d5628eb8dd184d Apr 21 11:06:02 user devstack@n-api.service[61319]: X-User-Name: tempest-ServersNegativeTestJSON-1265836442-project-member Apr 21 11:06:02 user devstack@n-api.service[61319]: method: > Apr 21 11:06:02 user devstack@n-api.service[61319]: exception: Instance 595d41a4-9a01-4aa2-96a1-c2c763475184 could not be found. Apr 21 11:06:02 user devstack@n-api.service[61319]: action_args: {'id': '595d41a4-9a01-4aa2-96a1-c2c763475184'} Apr 21 11:06:02 user devstack@n-api.service[61319]: {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 11:06:02 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:06:02 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 11:06:02 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 11:06:02 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 11:06:02 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 11:06:02 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 11:06:02 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 11:06:02 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 11:06:02 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 11:06:02 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 595d41a4-9a01-4aa2-96a1-c2c763475184 could not be found. Apr 21 11:06:02 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 11:06:02 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 11:06:02 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 11:06:02 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:06:02 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 11:06:02 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 11:06:02 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 11:06:02 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 11:06:02 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 11:06:02 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 11:06:02 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 11:06:02 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 11:06:02 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 11:06:02 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 11:06:02 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 11:06:02 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 11:06:02 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 595d41a4-9a01-4aa2-96a1-c2c763475184 could not be found. Apr 21 11:06:02 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 11:06:02 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 11:06:02 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 11:06:02 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:06:02 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 11:06:02 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 11:06:02 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 11:06:02 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 11:06:02 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 595d41a4-9a01-4aa2-96a1-c2c763475184 could not be found. Apr 21 11:06:02 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 11:06:02 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-0492ce61-1a05-49fe-81f2-855b13660ce2 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] Returning 404 to user: Instance 595d41a4-9a01-4aa2-96a1-c2c763475184 could not be found. {{(pid=61319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 11:06:02 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-0492ce61-1a05-49fe-81f2-855b13660ce2 tempest-ServersNegativeTestJSON-1265836442 tempest-ServersNegativeTestJSON-1265836442-project-member] 10.0.0.210 "GET /compute/v2.1/servers/595d41a4-9a01-4aa2-96a1-c2c763475184" status: 404 len: 111 microversion: 2.1 time: 0.030288 Apr 21 11:06:02 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 146/438] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 11:06:02 2023] GET /compute/v2.1/servers/595d41a4-9a01-4aa2-96a1-c2c763475184 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 11:06:34 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-7f5df0e7-e87d-4a30-91df-98e93ccf1c16 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:06:34 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-7f5df0e7-e87d-4a30-91df-98e93ccf1c16 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] [instance: 4dc4e5a5-6f31-4466-a6bb-dae9a2a93585] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:06:34 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_api:SELECT=4 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:06:34 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell1:SELECT=10 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:06:34 user devstack@n-api.service[61320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 11:06:34 user devstack@n-api.service[61320]: Fri Apr 21 11:06:34 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4dc4e5a5-6f31-4466-a6bb-dae9a2a93585 (ip 10.0.0.210) !!! Apr 21 11:06:34 user devstack@n-api.service[61320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 11:06:34 user devstack@n-api.service[61320]: Fri Apr 21 11:06:34 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4dc4e5a5-6f31-4466-a6bb-dae9a2a93585 (ip 10.0.0.210) !!! Apr 21 11:06:34 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-7f5df0e7-e87d-4a30-91df-98e93ccf1c16 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:06:34 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-7f5df0e7-e87d-4a30-91df-98e93ccf1c16 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:06:34 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-7f5df0e7-e87d-4a30-91df-98e93ccf1c16 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:06:34 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-7f5df0e7-e87d-4a30-91df-98e93ccf1c16 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:06:34 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-7f5df0e7-e87d-4a30-91df-98e93ccf1c16 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:06:34 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-7f5df0e7-e87d-4a30-91df-98e93ccf1c16 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:06:34 user devstack@n-api.service[61320]: INFO nova.api.openstack.wsgi [None req-7f5df0e7-e87d-4a30-91df-98e93ccf1c16 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] HTTP exception thrown: Instance 4dc4e5a5-6f31-4466-a6bb-dae9a2a93585 could not be found. Apr 21 11:06:34 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-7f5df0e7-e87d-4a30-91df-98e93ccf1c16 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Request method failure captured: Apr 21 11:06:34 user devstack@n-api.service[61320]: request: GET /compute/v2.1/servers/4dc4e5a5-6f31-4466-a6bb-dae9a2a93585 HTTP/1.1 Apr 21 11:06:34 user devstack@n-api.service[61320]: Accept: application/json Apr 21 11:06:34 user devstack@n-api.service[61320]: Accept-Encoding: identity Apr 21 11:06:34 user devstack@n-api.service[61320]: Connection: close Apr 21 11:06:34 user devstack@n-api.service[61320]: Content-Length: 0 Apr 21 11:06:34 user devstack@n-api.service[61320]: Content-Type: application/json Apr 21 11:06:34 user devstack@n-api.service[61320]: Host: 10.0.0.210 Apr 21 11:06:34 user devstack@n-api.service[61320]: Openstack-System-Scope: None Apr 21 11:06:34 user devstack@n-api.service[61320]: User-Agent: python-urllib3/1.26.15 Apr 21 11:06:34 user devstack@n-api.service[61320]: X-Auth-Token: gAAAAABkQm2TU-9xzOjf5oyHBvjSpZimUTyLGE8LvTfwFJV_0mSwWWdKJkzLytF7qIWDnt47Ld8NKe7Hc0w-GM35PAZ0qiaJYBZ71-cV47EgKzKlpXgBtQEXk1SmMH8BBegI6uxL9fAxooZHxTUolTlStuITYAXAoKBoWO5xKQj4OGOj7JR9egk Apr 21 11:06:34 user devstack@n-api.service[61320]: X-Domain-Id: None Apr 21 11:06:34 user devstack@n-api.service[61320]: X-Domain-Name: None Apr 21 11:06:34 user devstack@n-api.service[61320]: X-Identity-Status: Confirmed Apr 21 11:06:34 user devstack@n-api.service[61320]: X-Is-Admin-Project: True Apr 21 11:06:34 user devstack@n-api.service[61320]: X-Openstack-Nova-Api-Version: 2.20 Apr 21 11:06:34 user devstack@n-api.service[61320]: X-Project-Domain-Id: default Apr 21 11:06:34 user devstack@n-api.service[61320]: X-Project-Domain-Name: Default Apr 21 11:06:34 user devstack@n-api.service[61320]: X-Project-Id: 38ec5db9e7c744dcb2d4ae6737822da4 Apr 21 11:06:34 user devstack@n-api.service[61320]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1477853719 Apr 21 11:06:34 user devstack@n-api.service[61320]: X-Role: reader,member Apr 21 11:06:34 user devstack@n-api.service[61320]: X-Roles: reader,member Apr 21 11:06:34 user devstack@n-api.service[61320]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/38ec5db9e7c744dcb2d4ae6737822da4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/38ec5db9e7c744dcb2d4ae6737822da4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/38ec5db9e7c744dcb2d4ae6737822da4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 11:06:34 user devstack@n-api.service[61320]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1477853719 Apr 21 11:06:34 user devstack@n-api.service[61320]: X-Tenant-Id: 38ec5db9e7c744dcb2d4ae6737822da4 Apr 21 11:06:34 user devstack@n-api.service[61320]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1477853719 Apr 21 11:06:34 user devstack@n-api.service[61320]: X-User: tempest-AttachVolumeShelveTestJSON-1477853719-project-member Apr 21 11:06:34 user devstack@n-api.service[61320]: X-User-Domain-Id: default Apr 21 11:06:34 user devstack@n-api.service[61320]: X-User-Domain-Name: Default Apr 21 11:06:34 user devstack@n-api.service[61320]: X-User-Id: b3ef4e7c36ed43d9a00f7b7b9731917e Apr 21 11:06:34 user devstack@n-api.service[61320]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1477853719-project-member Apr 21 11:06:34 user devstack@n-api.service[61320]: method: > Apr 21 11:06:34 user devstack@n-api.service[61320]: exception: Instance 4dc4e5a5-6f31-4466-a6bb-dae9a2a93585 could not be found. Apr 21 11:06:34 user devstack@n-api.service[61320]: action_args: {'id': '4dc4e5a5-6f31-4466-a6bb-dae9a2a93585'} Apr 21 11:06:34 user devstack@n-api.service[61320]: {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 11:06:34 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:06:34 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 11:06:34 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 11:06:34 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 11:06:34 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 11:06:34 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 11:06:34 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 11:06:34 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 11:06:34 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 11:06:34 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dc4e5a5-6f31-4466-a6bb-dae9a2a93585 could not be found. Apr 21 11:06:34 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 11:06:34 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 11:06:34 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 11:06:34 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:06:34 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 11:06:34 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 11:06:34 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 11:06:34 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 11:06:34 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 11:06:34 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 11:06:34 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 11:06:34 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 11:06:34 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 11:06:34 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 11:06:34 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 11:06:34 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 11:06:34 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dc4e5a5-6f31-4466-a6bb-dae9a2a93585 could not be found. Apr 21 11:06:34 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 11:06:34 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 11:06:34 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 11:06:34 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:06:34 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 11:06:34 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 11:06:34 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 11:06:34 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 11:06:34 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dc4e5a5-6f31-4466-a6bb-dae9a2a93585 could not be found. Apr 21 11:06:34 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 11:06:34 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-7f5df0e7-e87d-4a30-91df-98e93ccf1c16 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Returning 404 to user: Instance 4dc4e5a5-6f31-4466-a6bb-dae9a2a93585 could not be found. {{(pid=61320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 11:06:34 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-7f5df0e7-e87d-4a30-91df-98e93ccf1c16 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4dc4e5a5-6f31-4466-a6bb-dae9a2a93585" status: 404 len: 111 microversion: 2.20 time: 0.068893 Apr 21 11:06:34 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 147/439] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 11:06:34 2023] GET /compute/v2.1/servers/4dc4e5a5-6f31-4466-a6bb-dae9a2a93585 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 21 11:06:34 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:06:34 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:06:34 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-4366bab5-09c0-47d0-9d1d-295373ce1004 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Calling method '.version_select at 0x7f91a5d503a0>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:06:34 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-4366bab5-09c0-47d0-9d1d-295373ce1004 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-74686879" status: 204 len: 0 microversion: 2.20 time: 0.048900 Apr 21 11:06:34 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 147/440] 10.0.0.210 () {64 vars in 1333 bytes} [Fri Apr 21 11:06:34 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-74686879 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 21 11:06:35 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-b79b8ca5-3b4c-4ebe-8615-8ee49f471a2d tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Action: 'create', calling method: .version_select at 0x7f91a5ec7b50>, body: {"keypair": {"name": "tempest-keypair-1706068318", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1UfeAU5ejPvKiIbVrSlezxGGpVC4gfHz7J9grOoCm6xuHHRWZ2v1kz4ntP7G17kSW98hRXpmZVLOyqlGHRYSA8xjvWuXXo/irIIn270UPQGiMFwjijpnxL1y5wwHMThA=="}} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 11:06:35 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_api:SELECT=2 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:06:35 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell1:SELECT=2 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:06:35 user devstack@n-api.service[61319]: DEBUG nova.quota [None req-b79b8ca5-3b4c-4ebe-8615-8ee49f471a2d tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Getting quotas for project 38ec5db9e7c744dcb2d4ae6737822da4. Resources: {'key_pairs'} {{(pid=61319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 11:06:35 user devstack@n-api.service[61319]: DEBUG nova.quota [None req-b79b8ca5-3b4c-4ebe-8615-8ee49f471a2d tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Getting quotas for user b3ef4e7c36ed43d9a00f7b7b9731917e and project 38ec5db9e7c744dcb2d4ae6737822da4. Resources: {'key_pairs'} {{(pid=61319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 11:06:35 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-b79b8ca5-3b4c-4ebe-8615-8ee49f471a2d tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.077117 Apr 21 11:06:35 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 147/441] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 21 11:06:35 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 79 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 21 11:06:37 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-8c6603c4-c6ad-45f2-95cb-d09722a0c7e6 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1268614226", "imageRef": "3b29a01a-1fc0-4d0d-89fb-23d22b2de02e", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "173a131c-e6e2-4f94-a591-9a96ff4967f2"}], "security_groups": [{"name": "tempest-securitygroup--1448745208"}], "key_name": "tempest-keypair-1706068318", "user_data": "}} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 11:06:37 user devstack@n-api.service[61320]: DEBUG nova.network.neutron [None req-8c6603c4-c6ad-45f2-95cb-d09722a0c7e6 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] validate_networks() for [('173a131c-e6e2-4f94-a591-9a96ff4967f2', None, None, None, None, None)] {{(pid=61320) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 11:06:38 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-8c6603c4-c6ad-45f2-95cb-d09722a0c7e6 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Flavor limits 0:0:0 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 11:06:38 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-8c6603c4-c6ad-45f2-95cb-d09722a0c7e6 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Image limits 0:0:0 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 11:06:38 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-8c6603c4-c6ad-45f2-95cb-d09722a0c7e6 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Flavor pref 0:0:0 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 11:06:38 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-8c6603c4-c6ad-45f2-95cb-d09722a0c7e6 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Image pref 0:0:0 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 11:06:38 user devstack@n-api.service[61320]: DEBUG nova.virt.hardware [None req-8c6603c4-c6ad-45f2-95cb-d09722a0c7e6 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 11:06:38 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-8c6603c4-c6ad-45f2-95cb-d09722a0c7e6 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:06:38 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-8c6603c4-c6ad-45f2-95cb-d09722a0c7e6 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:06:38 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-8c6603c4-c6ad-45f2-95cb-d09722a0c7e6 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:06:38 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-8c6603c4-c6ad-45f2-95cb-d09722a0c7e6 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:06:38 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-8c6603c4-c6ad-45f2-95cb-d09722a0c7e6 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:06:38 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-8c6603c4-c6ad-45f2-95cb-d09722a0c7e6 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:06:38 user devstack@n-api.service[61320]: DEBUG nova.quota [None req-8c6603c4-c6ad-45f2-95cb-d09722a0c7e6 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Getting quotas for project 38ec5db9e7c744dcb2d4ae6737822da4. Resources: {'cores', 'instances', 'ram'} {{(pid=61320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 11:06:38 user devstack@n-api.service[61320]: DEBUG nova.quota [None req-8c6603c4-c6ad-45f2-95cb-d09722a0c7e6 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Getting quotas for user b3ef4e7c36ed43d9a00f7b7b9731917e and project 38ec5db9e7c744dcb2d4ae6737822da4. Resources: {'cores', 'instances', 'ram'} {{(pid=61320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 11:06:38 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-8c6603c4-c6ad-45f2-95cb-d09722a0c7e6 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Going to run 1 instances... {{(pid=61320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 11:06:38 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-8c6603c4-c6ad-45f2-95cb-d09722a0c7e6 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] [instance: 09c483c1-f6c1-4529-afc7-b5774df793ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3b29a01a-1fc0-4d0d-89fb-23d22b2de02e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 11:06:38 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-8c6603c4-c6ad-45f2-95cb-d09722a0c7e6 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.884687 Apr 21 11:06:38 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 148/442] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 21 11:06:37 2023] POST /compute/v2.1/servers => generated 400 bytes in 886 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 21 11:06:38 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-04be2a07-a373-44be-a2cd-2905bce5a657 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:06:38 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-04be2a07-a373-44be-a2cd-2905bce5a657 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] [instance: 09c483c1-f6c1-4529-afc7-b5774df793ab] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:06:38 user devstack@n-api.service[61318]: DEBUG nova.policy [None req-04be2a07-a373-44be-a2cd-2905bce5a657 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ef4e7c36ed43d9a00f7b7b9731917e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38ec5db9e7c744dcb2d4ae6737822da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61318) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 11:06:38 user devstack@n-api.service[61318]: DEBUG nova.policy [None req-04be2a07-a373-44be-a2cd-2905bce5a657 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3ef4e7c36ed43d9a00f7b7b9731917e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38ec5db9e7c744dcb2d4ae6737822da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61318) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 11:06:38 user devstack@n-api.service[61318]: DEBUG nova.policy [None req-04be2a07-a373-44be-a2cd-2905bce5a657 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3ef4e7c36ed43d9a00f7b7b9731917e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38ec5db9e7c744dcb2d4ae6737822da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61318) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 11:06:38 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-04be2a07-a373-44be-a2cd-2905bce5a657 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] 10.0.0.210 "GET /compute/v2.1/servers/09c483c1-f6c1-4529-afc7-b5774df793ab" status: 200 len: 1276 microversion: 2.20 time: 0.064116 Apr 21 11:06:38 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 148/443] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 11:06:38 2023] GET /compute/v2.1/servers/09c483c1-f6c1-4529-afc7-b5774df793ab => generated 1276 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 11:06:40 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-6635995f-bccd-41c4-9eb1-e9a33f7a3dd5 req-967d73a5-2bde-464f-aaa4-ef59ee720f87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09c483c1-f6c1-4529-afc7-b5774df793ab", "tag": "bad0b018-583e-4271-8585-5c56eba9fd6b"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 11:06:40 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-6635995f-bccd-41c4-9eb1-e9a33f7a3dd5 req-967d73a5-2bde-464f-aaa4-ef59ee720f87 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:06:40 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-6635995f-bccd-41c4-9eb1-e9a33f7a3dd5 req-967d73a5-2bde-464f-aaa4-ef59ee720f87 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:06:40 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-6635995f-bccd-41c4-9eb1-e9a33f7a3dd5 req-967d73a5-2bde-464f-aaa4-ef59ee720f87 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:06:40 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-6635995f-bccd-41c4-9eb1-e9a33f7a3dd5 req-967d73a5-2bde-464f-aaa4-ef59ee720f87 service nova] Creating event network-changed:bad0b018-583e-4271-8585-5c56eba9fd6b for instance 09c483c1-f6c1-4529-afc7-b5774df793ab on user Apr 21 11:06:40 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-6635995f-bccd-41c4-9eb1-e9a33f7a3dd5 req-967d73a5-2bde-464f-aaa4-ef59ee720f87 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031126 Apr 21 11:06:40 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 148/444] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 11:06:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 11:06:42 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [req-eb112f1b-9a13-4645-a682-57b67b5d1e9d req-90c4ee9e-c689-4a43-a6d1-78146af44242 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09c483c1-f6c1-4529-afc7-b5774df793ab", "name": "network-vif-plugged", "status": "completed", "tag": "bad0b018-583e-4271-8585-5c56eba9fd6b"}]} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 11:06:42 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-eb112f1b-9a13-4645-a682-57b67b5d1e9d req-90c4ee9e-c689-4a43-a6d1-78146af44242 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:06:42 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-eb112f1b-9a13-4645-a682-57b67b5d1e9d req-90c4ee9e-c689-4a43-a6d1-78146af44242 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:06:42 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-eb112f1b-9a13-4645-a682-57b67b5d1e9d req-90c4ee9e-c689-4a43-a6d1-78146af44242 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:06:42 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-eb112f1b-9a13-4645-a682-57b67b5d1e9d req-90c4ee9e-c689-4a43-a6d1-78146af44242 service nova] Creating event network-vif-plugged:bad0b018-583e-4271-8585-5c56eba9fd6b for instance 09c483c1-f6c1-4529-afc7-b5774df793ab on user Apr 21 11:06:42 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [req-eb112f1b-9a13-4645-a682-57b67b5d1e9d req-90c4ee9e-c689-4a43-a6d1-78146af44242 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034170 Apr 21 11:06:42 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 149/445] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 11:06:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 11:06:44 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [req-f5dd356d-fb5b-4364-b5d7-c7ac966ded19 req-f7b72c3b-4ec5-4454-8c25-41c7c441448e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09c483c1-f6c1-4529-afc7-b5774df793ab", "name": "network-vif-plugged", "status": "completed", "tag": "bad0b018-583e-4271-8585-5c56eba9fd6b"}]} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 11:06:44 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-f5dd356d-fb5b-4364-b5d7-c7ac966ded19 req-f7b72c3b-4ec5-4454-8c25-41c7c441448e service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:06:44 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-f5dd356d-fb5b-4364-b5d7-c7ac966ded19 req-f7b72c3b-4ec5-4454-8c25-41c7c441448e service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:06:44 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-f5dd356d-fb5b-4364-b5d7-c7ac966ded19 req-f7b72c3b-4ec5-4454-8c25-41c7c441448e service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:06:44 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-f5dd356d-fb5b-4364-b5d7-c7ac966ded19 req-f7b72c3b-4ec5-4454-8c25-41c7c441448e service nova] Creating event network-vif-plugged:bad0b018-583e-4271-8585-5c56eba9fd6b for instance 09c483c1-f6c1-4529-afc7-b5774df793ab on user Apr 21 11:06:44 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [req-f5dd356d-fb5b-4364-b5d7-c7ac966ded19 req-f7b72c3b-4ec5-4454-8c25-41c7c441448e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029964 Apr 21 11:06:44 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 149/446] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 11:06:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 11:07:28 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell0:SELECT=4 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:07:28 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:07:28 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell1:SELECT=2 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:07:28 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-f6cbe7e7-52ab-48b8-8bd8-b2759c5f9107 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:07:28 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-f6cbe7e7-52ab-48b8-8bd8-b2759c5f9107 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] [instance: 09c483c1-f6c1-4529-afc7-b5774df793ab] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:07:28 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-f6cbe7e7-52ab-48b8-8bd8-b2759c5f9107 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:07:28 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-f6cbe7e7-52ab-48b8-8bd8-b2759c5f9107 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:07:28 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-f6cbe7e7-52ab-48b8-8bd8-b2759c5f9107 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:07:28 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-f6cbe7e7-52ab-48b8-8bd8-b2759c5f9107 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:07:28 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-f6cbe7e7-52ab-48b8-8bd8-b2759c5f9107 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:07:28 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-f6cbe7e7-52ab-48b8-8bd8-b2759c5f9107 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:07:28 user devstack@n-api.service[61319]: DEBUG nova.policy [None req-f6cbe7e7-52ab-48b8-8bd8-b2759c5f9107 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ef4e7c36ed43d9a00f7b7b9731917e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38ec5db9e7c744dcb2d4ae6737822da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61319) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 11:07:28 user devstack@n-api.service[61319]: DEBUG nova.policy [None req-f6cbe7e7-52ab-48b8-8bd8-b2759c5f9107 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3ef4e7c36ed43d9a00f7b7b9731917e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38ec5db9e7c744dcb2d4ae6737822da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61319) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 11:07:28 user devstack@n-api.service[61319]: DEBUG nova.policy [None req-f6cbe7e7-52ab-48b8-8bd8-b2759c5f9107 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3ef4e7c36ed43d9a00f7b7b9731917e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38ec5db9e7c744dcb2d4ae6737822da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61319) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 11:07:28 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-f6cbe7e7-52ab-48b8-8bd8-b2759c5f9107 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] 10.0.0.210 "GET /compute/v2.1/servers/09c483c1-f6c1-4529-afc7-b5774df793ab" status: 200 len: 1588 microversion: 2.20 time: 0.368558 Apr 21 11:07:28 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 149/447] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 11:07:28 2023] GET /compute/v2.1/servers/09c483c1-f6c1-4529-afc7-b5774df793ab => generated 1588 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 11:08:28 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell0:SELECT=2 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:08:28 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell0:SELECT=6 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:08:28 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:08:28 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell1:SELECT=6 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:08:28 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-6adee289-b9c0-43a2-afa2-96b5a0136fd0 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:08:28 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-6adee289-b9c0-43a2-afa2-96b5a0136fd0 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] [instance: 09c483c1-f6c1-4529-afc7-b5774df793ab] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:08:28 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-6adee289-b9c0-43a2-afa2-96b5a0136fd0 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:08:28 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-6adee289-b9c0-43a2-afa2-96b5a0136fd0 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:08:28 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-6adee289-b9c0-43a2-afa2-96b5a0136fd0 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:08:28 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-6adee289-b9c0-43a2-afa2-96b5a0136fd0 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:08:28 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-6adee289-b9c0-43a2-afa2-96b5a0136fd0 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:08:28 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-6adee289-b9c0-43a2-afa2-96b5a0136fd0 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:08:28 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-6adee289-b9c0-43a2-afa2-96b5a0136fd0 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] 10.0.0.210 "GET /compute/v2.1/servers/09c483c1-f6c1-4529-afc7-b5774df793ab/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.191732 Apr 21 11:08:28 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 150/448] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 21 11:08:28 2023] GET /compute/v2.1/servers/09c483c1-f6c1-4529-afc7-b5774df793ab/os-interface => generated 283 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 11:08:29 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell0:SELECT=2 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:08:29 user devstack@n-api.service[61318]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 11:08:29 user devstack@n-api.service[61318]: Fri Apr 21 11:08:29 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 21 11:08:29 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:08:29 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell1:SELECT=2 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:08:29 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [req-c3be1789-f0c0-4564-a3e9-1d01ed765318 req-f294935c-6864-483d-814a-25a408997d30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09c483c1-f6c1-4529-afc7-b5774df793ab", "tag": "bad0b018-583e-4271-8585-5c56eba9fd6b"}]} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 11:08:29 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-c3be1789-f0c0-4564-a3e9-1d01ed765318 req-f294935c-6864-483d-814a-25a408997d30 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:08:29 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-c3be1789-f0c0-4564-a3e9-1d01ed765318 req-f294935c-6864-483d-814a-25a408997d30 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:08:29 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [req-c3be1789-f0c0-4564-a3e9-1d01ed765318 req-f294935c-6864-483d-814a-25a408997d30 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:08:29 user devstack@n-api.service[61318]: INFO nova.api.openstack.compute.server_external_events [req-c3be1789-f0c0-4564-a3e9-1d01ed765318 req-f294935c-6864-483d-814a-25a408997d30 service nova] Creating event network-changed:bad0b018-583e-4271-8585-5c56eba9fd6b for instance 09c483c1-f6c1-4529-afc7-b5774df793ab on user Apr 21 11:08:29 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_api:SELECT=2 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:08:29 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell1:SELECT=6 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:08:29 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [req-c3be1789-f0c0-4564-a3e9-1d01ed765318 req-f294935c-6864-483d-814a-25a408997d30 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047477 Apr 21 11:08:29 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 150/449] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 11:08:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 11:08:29 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-0957eee8-15ee-4f02-980e-ed63c06ebedc tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:08:29 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-0957eee8-15ee-4f02-980e-ed63c06ebedc tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] [instance: 09c483c1-f6c1-4529-afc7-b5774df793ab] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:08:29 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-0957eee8-15ee-4f02-980e-ed63c06ebedc tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:08:29 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-0957eee8-15ee-4f02-980e-ed63c06ebedc tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:08:29 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-0957eee8-15ee-4f02-980e-ed63c06ebedc tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:08:29 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-0957eee8-15ee-4f02-980e-ed63c06ebedc tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:08:29 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-0957eee8-15ee-4f02-980e-ed63c06ebedc tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:08:29 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-0957eee8-15ee-4f02-980e-ed63c06ebedc tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:08:29 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-0957eee8-15ee-4f02-980e-ed63c06ebedc tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] 10.0.0.210 "GET /compute/v2.1/servers/09c483c1-f6c1-4529-afc7-b5774df793ab/ips" status: 200 len: 110 microversion: 2.20 time: 0.039435 Apr 21 11:08:29 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 150/450] 10.0.0.210 () {64 vars in 1366 bytes} [Fri Apr 21 11:08:29 2023] GET /compute/v2.1/servers/09c483c1-f6c1-4529-afc7-b5774df793ab/ips => generated 110 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 11:08:30 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-1bb85399-b5a7-4932-8371-1764a78e9e85 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:08:30 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-1bb85399-b5a7-4932-8371-1764a78e9e85 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] [instance: 09c483c1-f6c1-4529-afc7-b5774df793ab] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:08:30 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-1bb85399-b5a7-4932-8371-1764a78e9e85 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:08:30 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-1bb85399-b5a7-4932-8371-1764a78e9e85 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:08:30 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-1bb85399-b5a7-4932-8371-1764a78e9e85 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:08:30 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-1bb85399-b5a7-4932-8371-1764a78e9e85 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:08:30 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-1bb85399-b5a7-4932-8371-1764a78e9e85 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:08:30 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-1bb85399-b5a7-4932-8371-1764a78e9e85 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:08:31 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-1bb85399-b5a7-4932-8371-1764a78e9e85 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] [instance: 09c483c1-f6c1-4529-afc7-b5774df793ab] Going to try to terminate instance {{(pid=61320) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 11:08:31 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-1bb85399-b5a7-4932-8371-1764a78e9e85 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/09c483c1-f6c1-4529-afc7-b5774df793ab" status: 204 len: 0 microversion: 2.20 time: 0.123145 Apr 21 11:08:31 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 151/451] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 21 11:08:30 2023] DELETE /compute/v2.1/servers/09c483c1-f6c1-4529-afc7-b5774df793ab => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 21 11:08:31 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-0e426569-c0db-4096-a237-3756f91d6c5f tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:08:31 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-0e426569-c0db-4096-a237-3756f91d6c5f tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] [instance: 09c483c1-f6c1-4529-afc7-b5774df793ab] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:08:31 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-0e426569-c0db-4096-a237-3756f91d6c5f tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:08:31 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-0e426569-c0db-4096-a237-3756f91d6c5f tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:08:31 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-0e426569-c0db-4096-a237-3756f91d6c5f tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:08:31 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-0e426569-c0db-4096-a237-3756f91d6c5f tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:08:31 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-0e426569-c0db-4096-a237-3756f91d6c5f tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:08:31 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-0e426569-c0db-4096-a237-3756f91d6c5f tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:08:31 user devstack@n-api.service[61318]: DEBUG nova.policy [None req-0e426569-c0db-4096-a237-3756f91d6c5f tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ef4e7c36ed43d9a00f7b7b9731917e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38ec5db9e7c744dcb2d4ae6737822da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61318) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 11:08:31 user devstack@n-api.service[61318]: DEBUG nova.policy [None req-0e426569-c0db-4096-a237-3756f91d6c5f tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3ef4e7c36ed43d9a00f7b7b9731917e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38ec5db9e7c744dcb2d4ae6737822da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61318) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 11:08:31 user devstack@n-api.service[61318]: DEBUG nova.policy [None req-0e426569-c0db-4096-a237-3756f91d6c5f tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3ef4e7c36ed43d9a00f7b7b9731917e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38ec5db9e7c744dcb2d4ae6737822da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61318) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 11:08:31 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-0e426569-c0db-4096-a237-3756f91d6c5f tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] 10.0.0.210 "GET /compute/v2.1/servers/09c483c1-f6c1-4529-afc7-b5774df793ab" status: 200 len: 1713 microversion: 2.20 time: 0.247718 Apr 21 11:08:31 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 151/452] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 11:08:31 2023] GET /compute/v2.1/servers/09c483c1-f6c1-4529-afc7-b5774df793ab => generated 1713 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 11:08:31 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [req-de59ff41-a353-40f1-8e99-1cab4ff8a71f req-c2ea727e-b26a-4988-829e-5726071b8f17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09c483c1-f6c1-4529-afc7-b5774df793ab", "name": "network-vif-unplugged", "status": "completed", "tag": "bad0b018-583e-4271-8585-5c56eba9fd6b"}]} {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 11:08:31 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-de59ff41-a353-40f1-8e99-1cab4ff8a71f req-c2ea727e-b26a-4988-829e-5726071b8f17 service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:08:31 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-de59ff41-a353-40f1-8e99-1cab4ff8a71f req-c2ea727e-b26a-4988-829e-5726071b8f17 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:08:31 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [req-de59ff41-a353-40f1-8e99-1cab4ff8a71f req-c2ea727e-b26a-4988-829e-5726071b8f17 service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:08:31 user devstack@n-api.service[61319]: INFO nova.api.openstack.compute.server_external_events [req-de59ff41-a353-40f1-8e99-1cab4ff8a71f req-c2ea727e-b26a-4988-829e-5726071b8f17 service nova] Creating event network-vif-unplugged:bad0b018-583e-4271-8585-5c56eba9fd6b for instance 09c483c1-f6c1-4529-afc7-b5774df793ab on user Apr 21 11:08:31 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [req-de59ff41-a353-40f1-8e99-1cab4ff8a71f req-c2ea727e-b26a-4988-829e-5726071b8f17 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.150247 Apr 21 11:08:31 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 151/453] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 11:08:31 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 11:08:33 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [req-fadb9c34-0ca2-43f4-a9a0-368b0167294e req-fadb2b06-ab81-4533-94a3-bd4f22d89e5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09c483c1-f6c1-4529-afc7-b5774df793ab", "name": "network-vif-plugged", "status": "completed", "tag": "bad0b018-583e-4271-8585-5c56eba9fd6b"}, {"server_uuid": "09c483c1-f6c1-4529-afc7-b5774df793ab", "name": "network-vif-deleted", "tag": "bad0b018-583e-4271-8585-5c56eba9fd6b"}]} {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 11:08:33 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-fadb9c34-0ca2-43f4-a9a0-368b0167294e req-fadb2b06-ab81-4533-94a3-bd4f22d89e5c service nova] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:08:33 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-fadb9c34-0ca2-43f4-a9a0-368b0167294e req-fadb2b06-ab81-4533-94a3-bd4f22d89e5c service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:08:33 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [req-fadb9c34-0ca2-43f4-a9a0-368b0167294e req-fadb2b06-ab81-4533-94a3-bd4f22d89e5c service nova] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:08:33 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-fadb9c34-0ca2-43f4-a9a0-368b0167294e req-fadb2b06-ab81-4533-94a3-bd4f22d89e5c service nova] Creating event network-vif-plugged:bad0b018-583e-4271-8585-5c56eba9fd6b for instance 09c483c1-f6c1-4529-afc7-b5774df793ab on user Apr 21 11:08:33 user devstack@n-api.service[61320]: INFO nova.api.openstack.compute.server_external_events [req-fadb9c34-0ca2-43f4-a9a0-368b0167294e req-fadb2b06-ab81-4533-94a3-bd4f22d89e5c service nova] Creating event network-vif-deleted:bad0b018-583e-4271-8585-5c56eba9fd6b for instance 09c483c1-f6c1-4529-afc7-b5774df793ab on user Apr 21 11:08:33 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [req-fadb9c34-0ca2-43f4-a9a0-368b0167294e req-fadb2b06-ab81-4533-94a3-bd4f22d89e5c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033230 Apr 21 11:08:33 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 152/454] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 11:08:33 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 11:09:21 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_api:SELECT=4 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:09:21 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell1:SELECT=8 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:09:21 user devstack@n-api.service[61318]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 21 11:09:21 user devstack@n-api.service[61318]: Fri Apr 21 11:09:21 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/09c483c1-f6c1-4529-afc7-b5774df793ab (ip 10.0.0.210) !!! Apr 21 11:09:21 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-062cfa1e-fde9-4e6e-a628-ff58fab77c0e tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:09:21 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-062cfa1e-fde9-4e6e-a628-ff58fab77c0e tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] [instance: 09c483c1-f6c1-4529-afc7-b5774df793ab] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:09:21 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-062cfa1e-fde9-4e6e-a628-ff58fab77c0e tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:09:21 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-062cfa1e-fde9-4e6e-a628-ff58fab77c0e tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:09:21 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-062cfa1e-fde9-4e6e-a628-ff58fab77c0e tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:09:21 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-062cfa1e-fde9-4e6e-a628-ff58fab77c0e tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:09:21 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-062cfa1e-fde9-4e6e-a628-ff58fab77c0e tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:09:21 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-062cfa1e-fde9-4e6e-a628-ff58fab77c0e tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:09:21 user devstack@n-api.service[61318]: INFO nova.api.openstack.wsgi [None req-062cfa1e-fde9-4e6e-a628-ff58fab77c0e tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] HTTP exception thrown: Instance 09c483c1-f6c1-4529-afc7-b5774df793ab could not be found. Apr 21 11:09:21 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-062cfa1e-fde9-4e6e-a628-ff58fab77c0e tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Request method failure captured: Apr 21 11:09:21 user devstack@n-api.service[61318]: request: GET /compute/v2.1/servers/09c483c1-f6c1-4529-afc7-b5774df793ab HTTP/1.1 Apr 21 11:09:21 user devstack@n-api.service[61318]: Accept: application/json Apr 21 11:09:21 user devstack@n-api.service[61318]: Accept-Encoding: identity Apr 21 11:09:21 user devstack@n-api.service[61318]: Connection: close Apr 21 11:09:21 user devstack@n-api.service[61318]: Content-Length: 0 Apr 21 11:09:21 user devstack@n-api.service[61318]: Content-Type: application/json Apr 21 11:09:21 user devstack@n-api.service[61318]: Host: 10.0.0.210 Apr 21 11:09:21 user devstack@n-api.service[61318]: Openstack-System-Scope: None Apr 21 11:09:21 user devstack@n-api.service[61318]: User-Agent: python-urllib3/1.26.15 Apr 21 11:09:21 user devstack@n-api.service[61318]: X-Auth-Token: gAAAAABkQm2TU-9xzOjf5oyHBvjSpZimUTyLGE8LvTfwFJV_0mSwWWdKJkzLytF7qIWDnt47Ld8NKe7Hc0w-GM35PAZ0qiaJYBZ71-cV47EgKzKlpXgBtQEXk1SmMH8BBegI6uxL9fAxooZHxTUolTlStuITYAXAoKBoWO5xKQj4OGOj7JR9egk Apr 21 11:09:21 user devstack@n-api.service[61318]: X-Domain-Id: None Apr 21 11:09:21 user devstack@n-api.service[61318]: X-Domain-Name: None Apr 21 11:09:21 user devstack@n-api.service[61318]: X-Identity-Status: Confirmed Apr 21 11:09:21 user devstack@n-api.service[61318]: X-Is-Admin-Project: True Apr 21 11:09:21 user devstack@n-api.service[61318]: X-Openstack-Nova-Api-Version: 2.20 Apr 21 11:09:21 user devstack@n-api.service[61318]: X-Project-Domain-Id: default Apr 21 11:09:21 user devstack@n-api.service[61318]: X-Project-Domain-Name: Default Apr 21 11:09:21 user devstack@n-api.service[61318]: X-Project-Id: 38ec5db9e7c744dcb2d4ae6737822da4 Apr 21 11:09:21 user devstack@n-api.service[61318]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1477853719 Apr 21 11:09:21 user devstack@n-api.service[61318]: X-Role: reader,member Apr 21 11:09:21 user devstack@n-api.service[61318]: X-Roles: reader,member Apr 21 11:09:21 user devstack@n-api.service[61318]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/38ec5db9e7c744dcb2d4ae6737822da4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/38ec5db9e7c744dcb2d4ae6737822da4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/38ec5db9e7c744dcb2d4ae6737822da4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 11:09:21 user devstack@n-api.service[61318]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1477853719 Apr 21 11:09:21 user devstack@n-api.service[61318]: X-Tenant-Id: 38ec5db9e7c744dcb2d4ae6737822da4 Apr 21 11:09:21 user devstack@n-api.service[61318]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1477853719 Apr 21 11:09:21 user devstack@n-api.service[61318]: X-User: tempest-AttachVolumeShelveTestJSON-1477853719-project-member Apr 21 11:09:21 user devstack@n-api.service[61318]: X-User-Domain-Id: default Apr 21 11:09:21 user devstack@n-api.service[61318]: X-User-Domain-Name: Default Apr 21 11:09:21 user devstack@n-api.service[61318]: X-User-Id: b3ef4e7c36ed43d9a00f7b7b9731917e Apr 21 11:09:21 user devstack@n-api.service[61318]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1477853719-project-member Apr 21 11:09:21 user devstack@n-api.service[61318]: method: > Apr 21 11:09:21 user devstack@n-api.service[61318]: exception: Instance 09c483c1-f6c1-4529-afc7-b5774df793ab could not be found. Apr 21 11:09:21 user devstack@n-api.service[61318]: action_args: {'id': '09c483c1-f6c1-4529-afc7-b5774df793ab'} Apr 21 11:09:21 user devstack@n-api.service[61318]: {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 11:09:21 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:09:21 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 11:09:21 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 11:09:21 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 11:09:21 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 11:09:21 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 11:09:21 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 11:09:21 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 11:09:21 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 11:09:21 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09c483c1-f6c1-4529-afc7-b5774df793ab could not be found. Apr 21 11:09:21 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 11:09:21 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 11:09:21 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 11:09:21 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:09:21 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 11:09:21 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 11:09:21 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 11:09:21 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 11:09:21 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 11:09:21 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 11:09:21 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 11:09:21 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 11:09:21 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 11:09:21 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 11:09:21 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 11:09:21 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 11:09:21 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09c483c1-f6c1-4529-afc7-b5774df793ab could not be found. Apr 21 11:09:21 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 11:09:21 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 11:09:21 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 11:09:21 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:09:21 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 11:09:21 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 11:09:21 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 11:09:21 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 11:09:21 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09c483c1-f6c1-4529-afc7-b5774df793ab could not be found. Apr 21 11:09:21 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 11:09:21 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-062cfa1e-fde9-4e6e-a628-ff58fab77c0e tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Returning 404 to user: Instance 09c483c1-f6c1-4529-afc7-b5774df793ab could not be found. {{(pid=61318) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 11:09:21 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-062cfa1e-fde9-4e6e-a628-ff58fab77c0e tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] 10.0.0.210 "GET /compute/v2.1/servers/09c483c1-f6c1-4529-afc7-b5774df793ab" status: 404 len: 111 microversion: 2.20 time: 0.091300 Apr 21 11:09:21 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 152/455] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 11:09:21 2023] GET /compute/v2.1/servers/09c483c1-f6c1-4529-afc7-b5774df793ab => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 21 11:09:21 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_api:SELECT=4 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:09:21 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell1:SELECT=6 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:09:21 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-1b9f81c0-2585-4647-85ec-801d08a9b229 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Calling method '.version_select at 0x7f91a5ec4c10>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:09:21 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-1b9f81c0-2585-4647-85ec-801d08a9b229 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1706068318" status: 204 len: 0 microversion: 2.20 time: 0.026545 Apr 21 11:09:21 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 152/456] 10.0.0.210 () {64 vars in 1339 bytes} [Fri Apr 21 11:09:21 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1706068318 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 21 11:09:22 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:09:22 user devstack@n-api.service[61320]: DEBUG dbcounter [-] [61320] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61320) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:09:22 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-ddc99245-dd3e-417a-953b-8d6fa50b7a48 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:09:22 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-ddc99245-dd3e-417a-953b-8d6fa50b7a48 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] [instance: 09c483c1-f6c1-4529-afc7-b5774df793ab] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:09:22 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-ddc99245-dd3e-417a-953b-8d6fa50b7a48 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:09:22 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-ddc99245-dd3e-417a-953b-8d6fa50b7a48 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:09:22 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-ddc99245-dd3e-417a-953b-8d6fa50b7a48 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:09:22 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-ddc99245-dd3e-417a-953b-8d6fa50b7a48 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:09:22 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-ddc99245-dd3e-417a-953b-8d6fa50b7a48 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:09:22 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-ddc99245-dd3e-417a-953b-8d6fa50b7a48 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:09:22 user devstack@n-api.service[61320]: INFO nova.api.openstack.wsgi [None req-ddc99245-dd3e-417a-953b-8d6fa50b7a48 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] HTTP exception thrown: Instance 09c483c1-f6c1-4529-afc7-b5774df793ab could not be found. Apr 21 11:09:22 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-ddc99245-dd3e-417a-953b-8d6fa50b7a48 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Request method failure captured: Apr 21 11:09:22 user devstack@n-api.service[61320]: request: DELETE /compute/v2.1/servers/09c483c1-f6c1-4529-afc7-b5774df793ab HTTP/1.1 Apr 21 11:09:22 user devstack@n-api.service[61320]: Accept: application/json Apr 21 11:09:22 user devstack@n-api.service[61320]: Accept-Encoding: identity Apr 21 11:09:22 user devstack@n-api.service[61320]: Connection: close Apr 21 11:09:22 user devstack@n-api.service[61320]: Content-Length: 0 Apr 21 11:09:22 user devstack@n-api.service[61320]: Content-Type: application/json Apr 21 11:09:22 user devstack@n-api.service[61320]: Host: 10.0.0.210 Apr 21 11:09:22 user devstack@n-api.service[61320]: Openstack-System-Scope: None Apr 21 11:09:22 user devstack@n-api.service[61320]: User-Agent: python-urllib3/1.26.15 Apr 21 11:09:22 user devstack@n-api.service[61320]: X-Auth-Token: gAAAAABkQm2TU-9xzOjf5oyHBvjSpZimUTyLGE8LvTfwFJV_0mSwWWdKJkzLytF7qIWDnt47Ld8NKe7Hc0w-GM35PAZ0qiaJYBZ71-cV47EgKzKlpXgBtQEXk1SmMH8BBegI6uxL9fAxooZHxTUolTlStuITYAXAoKBoWO5xKQj4OGOj7JR9egk Apr 21 11:09:22 user devstack@n-api.service[61320]: X-Domain-Id: None Apr 21 11:09:22 user devstack@n-api.service[61320]: X-Domain-Name: None Apr 21 11:09:22 user devstack@n-api.service[61320]: X-Identity-Status: Confirmed Apr 21 11:09:22 user devstack@n-api.service[61320]: X-Is-Admin-Project: True Apr 21 11:09:22 user devstack@n-api.service[61320]: X-Openstack-Nova-Api-Version: 2.20 Apr 21 11:09:22 user devstack@n-api.service[61320]: X-Project-Domain-Id: default Apr 21 11:09:22 user devstack@n-api.service[61320]: X-Project-Domain-Name: Default Apr 21 11:09:22 user devstack@n-api.service[61320]: X-Project-Id: 38ec5db9e7c744dcb2d4ae6737822da4 Apr 21 11:09:22 user devstack@n-api.service[61320]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1477853719 Apr 21 11:09:22 user devstack@n-api.service[61320]: X-Role: reader,member Apr 21 11:09:22 user devstack@n-api.service[61320]: X-Roles: reader,member Apr 21 11:09:22 user devstack@n-api.service[61320]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/38ec5db9e7c744dcb2d4ae6737822da4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/38ec5db9e7c744dcb2d4ae6737822da4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/38ec5db9e7c744dcb2d4ae6737822da4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 11:09:22 user devstack@n-api.service[61320]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1477853719 Apr 21 11:09:22 user devstack@n-api.service[61320]: X-Tenant-Id: 38ec5db9e7c744dcb2d4ae6737822da4 Apr 21 11:09:22 user devstack@n-api.service[61320]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1477853719 Apr 21 11:09:22 user devstack@n-api.service[61320]: X-User: tempest-AttachVolumeShelveTestJSON-1477853719-project-member Apr 21 11:09:22 user devstack@n-api.service[61320]: X-User-Domain-Id: default Apr 21 11:09:22 user devstack@n-api.service[61320]: X-User-Domain-Name: Default Apr 21 11:09:22 user devstack@n-api.service[61320]: X-User-Id: b3ef4e7c36ed43d9a00f7b7b9731917e Apr 21 11:09:22 user devstack@n-api.service[61320]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1477853719-project-member Apr 21 11:09:22 user devstack@n-api.service[61320]: method: > Apr 21 11:09:22 user devstack@n-api.service[61320]: exception: Instance 09c483c1-f6c1-4529-afc7-b5774df793ab could not be found. Apr 21 11:09:22 user devstack@n-api.service[61320]: action_args: {'id': '09c483c1-f6c1-4529-afc7-b5774df793ab'} Apr 21 11:09:22 user devstack@n-api.service[61320]: {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09c483c1-f6c1-4529-afc7-b5774df793ab could not be found. Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09c483c1-f6c1-4529-afc7-b5774df793ab could not be found. Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09c483c1-f6c1-4529-afc7-b5774df793ab could not be found. Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 11:09:22 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-ddc99245-dd3e-417a-953b-8d6fa50b7a48 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Returning 404 to user: Instance 09c483c1-f6c1-4529-afc7-b5774df793ab could not be found. {{(pid=61320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 11:09:22 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-ddc99245-dd3e-417a-953b-8d6fa50b7a48 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/09c483c1-f6c1-4529-afc7-b5774df793ab" status: 404 len: 111 microversion: 2.20 time: 0.037096 Apr 21 11:09:22 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 153/457] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 21 11:09:22 2023] DELETE /compute/v2.1/servers/09c483c1-f6c1-4529-afc7-b5774df793ab => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 21 11:09:22 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-ecd598bd-dcdd-4ec7-bdb0-c6c219309c00 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Calling method '>' {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:09:22 user devstack@n-api.service[61318]: DEBUG nova.compute.api [None req-ecd598bd-dcdd-4ec7-bdb0-c6c219309c00 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] [instance: 09c483c1-f6c1-4529-afc7-b5774df793ab] Fetching instance by UUID {{(pid=61318) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:09:22 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-ecd598bd-dcdd-4ec7-bdb0-c6c219309c00 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:09:22 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-ecd598bd-dcdd-4ec7-bdb0-c6c219309c00 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:09:22 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-ecd598bd-dcdd-4ec7-bdb0-c6c219309c00 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:09:22 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-ecd598bd-dcdd-4ec7-bdb0-c6c219309c00 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:09:22 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-ecd598bd-dcdd-4ec7-bdb0-c6c219309c00 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:09:22 user devstack@n-api.service[61318]: DEBUG oslo_concurrency.lockutils [None req-ecd598bd-dcdd-4ec7-bdb0-c6c219309c00 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61318) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:09:22 user devstack@n-api.service[61318]: INFO nova.api.openstack.wsgi [None req-ecd598bd-dcdd-4ec7-bdb0-c6c219309c00 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] HTTP exception thrown: Instance 09c483c1-f6c1-4529-afc7-b5774df793ab could not be found. Apr 21 11:09:22 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-ecd598bd-dcdd-4ec7-bdb0-c6c219309c00 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Request method failure captured: Apr 21 11:09:22 user devstack@n-api.service[61318]: request: GET /compute/v2.1/servers/09c483c1-f6c1-4529-afc7-b5774df793ab HTTP/1.1 Apr 21 11:09:22 user devstack@n-api.service[61318]: Accept: application/json Apr 21 11:09:22 user devstack@n-api.service[61318]: Accept-Encoding: identity Apr 21 11:09:22 user devstack@n-api.service[61318]: Connection: close Apr 21 11:09:22 user devstack@n-api.service[61318]: Content-Length: 0 Apr 21 11:09:22 user devstack@n-api.service[61318]: Content-Type: application/json Apr 21 11:09:22 user devstack@n-api.service[61318]: Host: 10.0.0.210 Apr 21 11:09:22 user devstack@n-api.service[61318]: Openstack-System-Scope: None Apr 21 11:09:22 user devstack@n-api.service[61318]: User-Agent: python-urllib3/1.26.15 Apr 21 11:09:22 user devstack@n-api.service[61318]: X-Auth-Token: gAAAAABkQm2TU-9xzOjf5oyHBvjSpZimUTyLGE8LvTfwFJV_0mSwWWdKJkzLytF7qIWDnt47Ld8NKe7Hc0w-GM35PAZ0qiaJYBZ71-cV47EgKzKlpXgBtQEXk1SmMH8BBegI6uxL9fAxooZHxTUolTlStuITYAXAoKBoWO5xKQj4OGOj7JR9egk Apr 21 11:09:22 user devstack@n-api.service[61318]: X-Domain-Id: None Apr 21 11:09:22 user devstack@n-api.service[61318]: X-Domain-Name: None Apr 21 11:09:22 user devstack@n-api.service[61318]: X-Identity-Status: Confirmed Apr 21 11:09:22 user devstack@n-api.service[61318]: X-Is-Admin-Project: True Apr 21 11:09:22 user devstack@n-api.service[61318]: X-Openstack-Nova-Api-Version: 2.20 Apr 21 11:09:22 user devstack@n-api.service[61318]: X-Project-Domain-Id: default Apr 21 11:09:22 user devstack@n-api.service[61318]: X-Project-Domain-Name: Default Apr 21 11:09:22 user devstack@n-api.service[61318]: X-Project-Id: 38ec5db9e7c744dcb2d4ae6737822da4 Apr 21 11:09:22 user devstack@n-api.service[61318]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1477853719 Apr 21 11:09:22 user devstack@n-api.service[61318]: X-Role: reader,member Apr 21 11:09:22 user devstack@n-api.service[61318]: X-Roles: reader,member Apr 21 11:09:22 user devstack@n-api.service[61318]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/38ec5db9e7c744dcb2d4ae6737822da4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/38ec5db9e7c744dcb2d4ae6737822da4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/38ec5db9e7c744dcb2d4ae6737822da4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 11:09:22 user devstack@n-api.service[61318]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1477853719 Apr 21 11:09:22 user devstack@n-api.service[61318]: X-Tenant-Id: 38ec5db9e7c744dcb2d4ae6737822da4 Apr 21 11:09:22 user devstack@n-api.service[61318]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1477853719 Apr 21 11:09:22 user devstack@n-api.service[61318]: X-User: tempest-AttachVolumeShelveTestJSON-1477853719-project-member Apr 21 11:09:22 user devstack@n-api.service[61318]: X-User-Domain-Id: default Apr 21 11:09:22 user devstack@n-api.service[61318]: X-User-Domain-Name: Default Apr 21 11:09:22 user devstack@n-api.service[61318]: X-User-Id: b3ef4e7c36ed43d9a00f7b7b9731917e Apr 21 11:09:22 user devstack@n-api.service[61318]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1477853719-project-member Apr 21 11:09:22 user devstack@n-api.service[61318]: method: > Apr 21 11:09:22 user devstack@n-api.service[61318]: exception: Instance 09c483c1-f6c1-4529-afc7-b5774df793ab could not be found. Apr 21 11:09:22 user devstack@n-api.service[61318]: action_args: {'id': '09c483c1-f6c1-4529-afc7-b5774df793ab'} Apr 21 11:09:22 user devstack@n-api.service[61318]: {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 11:09:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:09:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 11:09:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 11:09:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 11:09:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 11:09:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 11:09:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 11:09:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 11:09:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 11:09:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09c483c1-f6c1-4529-afc7-b5774df793ab could not be found. Apr 21 11:09:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 11:09:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 11:09:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 11:09:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:09:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 11:09:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 11:09:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 11:09:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 11:09:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 11:09:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 11:09:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 11:09:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 11:09:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 11:09:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 11:09:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 11:09:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 11:09:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09c483c1-f6c1-4529-afc7-b5774df793ab could not be found. Apr 21 11:09:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 11:09:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 11:09:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 11:09:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:09:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 11:09:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 11:09:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 11:09:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 11:09:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09c483c1-f6c1-4529-afc7-b5774df793ab could not be found. Apr 21 11:09:22 user devstack@n-api.service[61318]: ERROR nova.api.openstack.wsgi Apr 21 11:09:22 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-ecd598bd-dcdd-4ec7-bdb0-c6c219309c00 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Returning 404 to user: Instance 09c483c1-f6c1-4529-afc7-b5774df793ab could not be found. {{(pid=61318) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 11:09:22 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-ecd598bd-dcdd-4ec7-bdb0-c6c219309c00 tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] 10.0.0.210 "GET /compute/v2.1/servers/09c483c1-f6c1-4529-afc7-b5774df793ab" status: 404 len: 111 microversion: 2.20 time: 0.026205 Apr 21 11:09:22 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 153/458] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 11:09:22 2023] GET /compute/v2.1/servers/09c483c1-f6c1-4529-afc7-b5774df793ab => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 21 11:09:22 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-4608d753-46e3-4b4f-8c72-1c6e42480d8a tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Calling method '>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:09:22 user devstack@n-api.service[61319]: DEBUG nova.compute.api [None req-4608d753-46e3-4b4f-8c72-1c6e42480d8a tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] [instance: 4dc4e5a5-6f31-4466-a6bb-dae9a2a93585] Fetching instance by UUID {{(pid=61319) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:09:22 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-4608d753-46e3-4b4f-8c72-1c6e42480d8a tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:09:22 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-4608d753-46e3-4b4f-8c72-1c6e42480d8a tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:09:22 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-4608d753-46e3-4b4f-8c72-1c6e42480d8a tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:09:22 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-4608d753-46e3-4b4f-8c72-1c6e42480d8a tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:09:22 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-4608d753-46e3-4b4f-8c72-1c6e42480d8a tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:09:22 user devstack@n-api.service[61319]: DEBUG oslo_concurrency.lockutils [None req-4608d753-46e3-4b4f-8c72-1c6e42480d8a tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61319) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:09:22 user devstack@n-api.service[61319]: INFO nova.api.openstack.wsgi [None req-4608d753-46e3-4b4f-8c72-1c6e42480d8a tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] HTTP exception thrown: Instance 4dc4e5a5-6f31-4466-a6bb-dae9a2a93585 could not be found. Apr 21 11:09:22 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-4608d753-46e3-4b4f-8c72-1c6e42480d8a tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Request method failure captured: Apr 21 11:09:22 user devstack@n-api.service[61319]: request: DELETE /compute/v2.1/servers/4dc4e5a5-6f31-4466-a6bb-dae9a2a93585 HTTP/1.1 Apr 21 11:09:22 user devstack@n-api.service[61319]: Accept: application/json Apr 21 11:09:22 user devstack@n-api.service[61319]: Accept-Encoding: identity Apr 21 11:09:22 user devstack@n-api.service[61319]: Connection: close Apr 21 11:09:22 user devstack@n-api.service[61319]: Content-Length: 0 Apr 21 11:09:22 user devstack@n-api.service[61319]: Content-Type: application/json Apr 21 11:09:22 user devstack@n-api.service[61319]: Host: 10.0.0.210 Apr 21 11:09:22 user devstack@n-api.service[61319]: Openstack-System-Scope: None Apr 21 11:09:22 user devstack@n-api.service[61319]: User-Agent: python-urllib3/1.26.15 Apr 21 11:09:22 user devstack@n-api.service[61319]: X-Auth-Token: gAAAAABkQm2TU-9xzOjf5oyHBvjSpZimUTyLGE8LvTfwFJV_0mSwWWdKJkzLytF7qIWDnt47Ld8NKe7Hc0w-GM35PAZ0qiaJYBZ71-cV47EgKzKlpXgBtQEXk1SmMH8BBegI6uxL9fAxooZHxTUolTlStuITYAXAoKBoWO5xKQj4OGOj7JR9egk Apr 21 11:09:22 user devstack@n-api.service[61319]: X-Domain-Id: None Apr 21 11:09:22 user devstack@n-api.service[61319]: X-Domain-Name: None Apr 21 11:09:22 user devstack@n-api.service[61319]: X-Identity-Status: Confirmed Apr 21 11:09:22 user devstack@n-api.service[61319]: X-Is-Admin-Project: True Apr 21 11:09:22 user devstack@n-api.service[61319]: X-Openstack-Nova-Api-Version: 2.20 Apr 21 11:09:22 user devstack@n-api.service[61319]: X-Project-Domain-Id: default Apr 21 11:09:22 user devstack@n-api.service[61319]: X-Project-Domain-Name: Default Apr 21 11:09:22 user devstack@n-api.service[61319]: X-Project-Id: 38ec5db9e7c744dcb2d4ae6737822da4 Apr 21 11:09:22 user devstack@n-api.service[61319]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1477853719 Apr 21 11:09:22 user devstack@n-api.service[61319]: X-Role: reader,member Apr 21 11:09:22 user devstack@n-api.service[61319]: X-Roles: reader,member Apr 21 11:09:22 user devstack@n-api.service[61319]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/38ec5db9e7c744dcb2d4ae6737822da4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/38ec5db9e7c744dcb2d4ae6737822da4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/38ec5db9e7c744dcb2d4ae6737822da4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 11:09:22 user devstack@n-api.service[61319]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1477853719 Apr 21 11:09:22 user devstack@n-api.service[61319]: X-Tenant-Id: 38ec5db9e7c744dcb2d4ae6737822da4 Apr 21 11:09:22 user devstack@n-api.service[61319]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1477853719 Apr 21 11:09:22 user devstack@n-api.service[61319]: X-User: tempest-AttachVolumeShelveTestJSON-1477853719-project-member Apr 21 11:09:22 user devstack@n-api.service[61319]: X-User-Domain-Id: default Apr 21 11:09:22 user devstack@n-api.service[61319]: X-User-Domain-Name: Default Apr 21 11:09:22 user devstack@n-api.service[61319]: X-User-Id: b3ef4e7c36ed43d9a00f7b7b9731917e Apr 21 11:09:22 user devstack@n-api.service[61319]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1477853719-project-member Apr 21 11:09:22 user devstack@n-api.service[61319]: method: > Apr 21 11:09:22 user devstack@n-api.service[61319]: exception: Instance 4dc4e5a5-6f31-4466-a6bb-dae9a2a93585 could not be found. Apr 21 11:09:22 user devstack@n-api.service[61319]: action_args: {'id': '4dc4e5a5-6f31-4466-a6bb-dae9a2a93585'} Apr 21 11:09:22 user devstack@n-api.service[61319]: {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 11:09:22 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:09:22 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 11:09:22 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 11:09:22 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 11:09:22 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 11:09:22 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 11:09:22 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 11:09:22 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 11:09:22 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 11:09:22 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dc4e5a5-6f31-4466-a6bb-dae9a2a93585 could not be found. Apr 21 11:09:22 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 11:09:22 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 11:09:22 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 11:09:22 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:09:22 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 11:09:22 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 11:09:22 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 11:09:22 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 11:09:22 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 11:09:22 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 11:09:22 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 21 11:09:22 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 21 11:09:22 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 21 11:09:22 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 21 11:09:22 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 11:09:22 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 11:09:22 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 11:09:22 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 11:09:22 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dc4e5a5-6f31-4466-a6bb-dae9a2a93585 could not be found. Apr 21 11:09:22 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 11:09:22 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 11:09:22 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 11:09:22 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:09:22 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 11:09:22 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 11:09:22 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 11:09:22 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 11:09:22 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dc4e5a5-6f31-4466-a6bb-dae9a2a93585 could not be found. Apr 21 11:09:22 user devstack@n-api.service[61319]: ERROR nova.api.openstack.wsgi Apr 21 11:09:22 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-4608d753-46e3-4b4f-8c72-1c6e42480d8a tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Returning 404 to user: Instance 4dc4e5a5-6f31-4466-a6bb-dae9a2a93585 could not be found. {{(pid=61319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 11:09:22 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-4608d753-46e3-4b4f-8c72-1c6e42480d8a tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4dc4e5a5-6f31-4466-a6bb-dae9a2a93585" status: 404 len: 111 microversion: 2.20 time: 0.028989 Apr 21 11:09:22 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 153/459] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 21 11:09:22 2023] DELETE /compute/v2.1/servers/4dc4e5a5-6f31-4466-a6bb-dae9a2a93585 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 21 11:09:22 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-c20a5b93-7803-41a5-9a23-1fd4fcd174cb tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Calling method '>' {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:09:22 user devstack@n-api.service[61320]: DEBUG nova.compute.api [None req-c20a5b93-7803-41a5-9a23-1fd4fcd174cb tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] [instance: 4dc4e5a5-6f31-4466-a6bb-dae9a2a93585] Fetching instance by UUID {{(pid=61320) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 11:09:22 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-c20a5b93-7803-41a5-9a23-1fd4fcd174cb tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:09:22 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-c20a5b93-7803-41a5-9a23-1fd4fcd174cb tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:09:22 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-c20a5b93-7803-41a5-9a23-1fd4fcd174cb tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:09:22 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-c20a5b93-7803-41a5-9a23-1fd4fcd174cb tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Acquiring lock "bb5ee891-ceca-455b-842d-847784699b19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 11:09:22 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-c20a5b93-7803-41a5-9a23-1fd4fcd174cb tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 11:09:22 user devstack@n-api.service[61320]: DEBUG oslo_concurrency.lockutils [None req-c20a5b93-7803-41a5-9a23-1fd4fcd174cb tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Lock "bb5ee891-ceca-455b-842d-847784699b19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61320) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 11:09:22 user devstack@n-api.service[61320]: INFO nova.api.openstack.wsgi [None req-c20a5b93-7803-41a5-9a23-1fd4fcd174cb tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] HTTP exception thrown: Instance 4dc4e5a5-6f31-4466-a6bb-dae9a2a93585 could not be found. Apr 21 11:09:22 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-c20a5b93-7803-41a5-9a23-1fd4fcd174cb tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Request method failure captured: Apr 21 11:09:22 user devstack@n-api.service[61320]: request: GET /compute/v2.1/servers/4dc4e5a5-6f31-4466-a6bb-dae9a2a93585 HTTP/1.1 Apr 21 11:09:22 user devstack@n-api.service[61320]: Accept: application/json Apr 21 11:09:22 user devstack@n-api.service[61320]: Accept-Encoding: identity Apr 21 11:09:22 user devstack@n-api.service[61320]: Connection: close Apr 21 11:09:22 user devstack@n-api.service[61320]: Content-Length: 0 Apr 21 11:09:22 user devstack@n-api.service[61320]: Content-Type: application/json Apr 21 11:09:22 user devstack@n-api.service[61320]: Host: 10.0.0.210 Apr 21 11:09:22 user devstack@n-api.service[61320]: Openstack-System-Scope: None Apr 21 11:09:22 user devstack@n-api.service[61320]: User-Agent: python-urllib3/1.26.15 Apr 21 11:09:22 user devstack@n-api.service[61320]: X-Auth-Token: gAAAAABkQm2TU-9xzOjf5oyHBvjSpZimUTyLGE8LvTfwFJV_0mSwWWdKJkzLytF7qIWDnt47Ld8NKe7Hc0w-GM35PAZ0qiaJYBZ71-cV47EgKzKlpXgBtQEXk1SmMH8BBegI6uxL9fAxooZHxTUolTlStuITYAXAoKBoWO5xKQj4OGOj7JR9egk Apr 21 11:09:22 user devstack@n-api.service[61320]: X-Domain-Id: None Apr 21 11:09:22 user devstack@n-api.service[61320]: X-Domain-Name: None Apr 21 11:09:22 user devstack@n-api.service[61320]: X-Identity-Status: Confirmed Apr 21 11:09:22 user devstack@n-api.service[61320]: X-Is-Admin-Project: True Apr 21 11:09:22 user devstack@n-api.service[61320]: X-Openstack-Nova-Api-Version: 2.20 Apr 21 11:09:22 user devstack@n-api.service[61320]: X-Project-Domain-Id: default Apr 21 11:09:22 user devstack@n-api.service[61320]: X-Project-Domain-Name: Default Apr 21 11:09:22 user devstack@n-api.service[61320]: X-Project-Id: 38ec5db9e7c744dcb2d4ae6737822da4 Apr 21 11:09:22 user devstack@n-api.service[61320]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1477853719 Apr 21 11:09:22 user devstack@n-api.service[61320]: X-Role: reader,member Apr 21 11:09:22 user devstack@n-api.service[61320]: X-Roles: reader,member Apr 21 11:09:22 user devstack@n-api.service[61320]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/38ec5db9e7c744dcb2d4ae6737822da4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/38ec5db9e7c744dcb2d4ae6737822da4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/38ec5db9e7c744dcb2d4ae6737822da4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 21 11:09:22 user devstack@n-api.service[61320]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1477853719 Apr 21 11:09:22 user devstack@n-api.service[61320]: X-Tenant-Id: 38ec5db9e7c744dcb2d4ae6737822da4 Apr 21 11:09:22 user devstack@n-api.service[61320]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1477853719 Apr 21 11:09:22 user devstack@n-api.service[61320]: X-User: tempest-AttachVolumeShelveTestJSON-1477853719-project-member Apr 21 11:09:22 user devstack@n-api.service[61320]: X-User-Domain-Id: default Apr 21 11:09:22 user devstack@n-api.service[61320]: X-User-Domain-Name: Default Apr 21 11:09:22 user devstack@n-api.service[61320]: X-User-Id: b3ef4e7c36ed43d9a00f7b7b9731917e Apr 21 11:09:22 user devstack@n-api.service[61320]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1477853719-project-member Apr 21 11:09:22 user devstack@n-api.service[61320]: method: > Apr 21 11:09:22 user devstack@n-api.service[61320]: exception: Instance 4dc4e5a5-6f31-4466-a6bb-dae9a2a93585 could not be found. Apr 21 11:09:22 user devstack@n-api.service[61320]: action_args: {'id': '4dc4e5a5-6f31-4466-a6bb-dae9a2a93585'} Apr 21 11:09:22 user devstack@n-api.service[61320]: {{(pid=61320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dc4e5a5-6f31-4466-a6bb-dae9a2a93585 could not be found. Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dc4e5a5-6f31-4466-a6bb-dae9a2a93585 could not be found. Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dc4e5a5-6f31-4466-a6bb-dae9a2a93585 could not be found. Apr 21 11:09:22 user devstack@n-api.service[61320]: ERROR nova.api.openstack.wsgi Apr 21 11:09:22 user devstack@n-api.service[61320]: DEBUG nova.api.openstack.wsgi [None req-c20a5b93-7803-41a5-9a23-1fd4fcd174cb tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] Returning 404 to user: Instance 4dc4e5a5-6f31-4466-a6bb-dae9a2a93585 could not be found. {{(pid=61320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 11:09:22 user devstack@n-api.service[61320]: INFO nova.api.openstack.requestlog [None req-c20a5b93-7803-41a5-9a23-1fd4fcd174cb tempest-AttachVolumeShelveTestJSON-1477853719 tempest-AttachVolumeShelveTestJSON-1477853719-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4dc4e5a5-6f31-4466-a6bb-dae9a2a93585" status: 404 len: 111 microversion: 2.20 time: 0.032568 Apr 21 11:09:22 user devstack@n-api.service[61320]: [pid: 61320|app: 0|req: 154/460] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 11:09:22 2023] GET /compute/v2.1/servers/4dc4e5a5-6f31-4466-a6bb-dae9a2a93585 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 21 11:09:57 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_api:SELECT=4 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:09:57 user devstack@n-api.service[61318]: DEBUG dbcounter [-] [61318] Writing DB stats nova_cell1:SELECT=4 {{(pid=61318) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:09:57 user devstack@n-api.service[61318]: DEBUG nova.api.openstack.wsgi [None req-9a575ca6-0ed6-4d91-9951-cedd141c9d5f tempest-TestShelveInstance-853846892 tempest-TestShelveInstance-853846892-project-member] Action: 'create', calling method: .version_select at 0x7f91a5d50b80>, body: {"keypair": {"name": "tempest-TestShelveInstance-1930722466", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLhxiA4xKDLS+w9GYVFwZCMgMFfORweYSLzEeixF+hyOtzQx2vhfbQa/qiBKQgxXrfm6UO+iWG5VETIAEcR1lL58l9ERJSea1ZVOp/SE3JpaSrAJmdgQyRXRtEnWWl9ytA=="}} {{(pid=61318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 11:09:57 user devstack@n-api.service[61318]: DEBUG nova.quota [None req-9a575ca6-0ed6-4d91-9951-cedd141c9d5f tempest-TestShelveInstance-853846892 tempest-TestShelveInstance-853846892-project-member] Getting quotas for project d224d11334bb47a9bc2af5924cfc8df5. Resources: {'key_pairs'} {{(pid=61318) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 11:09:57 user devstack@n-api.service[61318]: DEBUG nova.quota [None req-9a575ca6-0ed6-4d91-9951-cedd141c9d5f tempest-TestShelveInstance-853846892 tempest-TestShelveInstance-853846892-project-member] Getting quotas for user 6c64095680c444729cd33da5e8ee757c and project d224d11334bb47a9bc2af5924cfc8df5. Resources: {'key_pairs'} {{(pid=61318) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 11:09:57 user devstack@n-api.service[61318]: INFO nova.api.openstack.requestlog [None req-9a575ca6-0ed6-4d91-9951-cedd141c9d5f tempest-TestShelveInstance-853846892 tempest-TestShelveInstance-853846892-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.265491 Apr 21 11:09:57 user devstack@n-api.service[61318]: [pid: 61318|app: 0|req: 154/461] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 21 11:09:57 2023] POST /compute/v2.1/os-keypairs => generated 397 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 11:10:00 user devstack@n-api.service[61319]: DEBUG nova.api.openstack.wsgi [None req-cb4cc27b-7bee-45a9-9379-7d74b06a7167 tempest-TestShelveInstance-853846892 tempest-TestShelveInstance-853846892-project-member] Calling method '.version_select at 0x7f91a5ec6830>' {{(pid=61319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 11:10:00 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:10:00 user devstack@n-api.service[61319]: DEBUG dbcounter [-] [61319] Writing DB stats nova_cell1:SELECT=2 {{(pid=61319) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 11:10:00 user devstack@n-api.service[61319]: INFO nova.api.openstack.requestlog [None req-cb4cc27b-7bee-45a9-9379-7d74b06a7167 tempest-TestShelveInstance-853846892 tempest-TestShelveInstance-853846892-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1930722466" status: 202 len: 0 microversion: 2.1 time: 0.025957 Apr 21 11:10:00 user devstack@n-api.service[61319]: [pid: 61319|app: 0|req: 154/462] 10.0.0.210 () {62 vars in 1331 bytes} [Fri Apr 21 11:10:00 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1930722466 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)